[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:10:56 dist-test-slave-6zbq krb5kdc[15072](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:10:56 dist-test-slave-6zbq krb5kdc[15072](info): set up 2 sockets
Aug 09 20:10:56 dist-test-slave-6zbq krb5kdc[15072](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260809 20:10:58.165688 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.332s user 0.001s sys 0.016s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:10:58 dist-test-slave-6zbq krb5kdc[15072](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:10:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:10:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:10:58.319540 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:33959
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:34295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:33959
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:10:58.670245 15096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:10:58.670620 15096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:10:58.670759 15096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:10:58.677636 15096 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:10:58.677726 15096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:10:58.677796 15096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:10:58.677875 15096 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:10:58.677937 15096 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:10:58.687618 15096 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:34295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:33959
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:33959
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:10:58.689220 15096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:10:58.691100 15096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:10:58.711225 15105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:10:58.711560 15104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:10:58.711810 15108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:10:58.712406 15096 server_base.cc:1034] running on GCE node
I20260809 20:10:58.713232 15096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:10:58.715173 15096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:10:58.716367 15096 hybrid_clock.cc:648] HybridClock initialized: now 1786306258716294 us; error 97 us; skew 500 ppm
I20260809 20:10:58.716858 15096 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:10:58 dist-test-slave-6zbq krb5kdc[15072](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306258, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:10:58.720134 15096 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:10:58.722465 15096 webserver.cc:460] Webserver started at http://127.14.181.62:44019/ using document root <none> and password file <none>
I20260809 20:10:58.723336 15096 fs_manager.cc:359] Metadata directory not provided
I20260809 20:10:58.723459 15096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:10:58.723739 15096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:10:58.727169 15096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "762dd8d9519442ee8b02407afee9ecc1"
format_stamp: "Formatted at 2026-08-09 20:10:58 on dist-test-slave-6zbq"
server_key: "a3f4206eb57afff7932fa34c76eb714f"
server_key_iv: "a56b3f45be2d1f429681e434a5675ec2"
server_key_version: "encryptionkey@0"
I20260809 20:10:58.728029 15096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "762dd8d9519442ee8b02407afee9ecc1"
format_stamp: "Formatted at 2026-08-09 20:10:58 on dist-test-slave-6zbq"
server_key: "a3f4206eb57afff7932fa34c76eb714f"
server_key_iv: "a56b3f45be2d1f429681e434a5675ec2"
server_key_version: "encryptionkey@0"
I20260809 20:10:58.733908 15096 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 20:10:58.737515 15121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:10:58.738819 15096 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 20:10:58.739065 15096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "762dd8d9519442ee8b02407afee9ecc1"
format_stamp: "Formatted at 2026-08-09 20:10:58 on dist-test-slave-6zbq"
server_key: "a3f4206eb57afff7932fa34c76eb714f"
server_key_iv: "a56b3f45be2d1f429681e434a5675ec2"
server_key_version: "encryptionkey@0"
I20260809 20:10:58.739252 15096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:10:58.767601 15096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:10:58.772174 15096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:10:58.772500 15096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:10:58.793337 15202 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:33959 every 8 connection(s)
I20260809 20:10:58.793335 15096 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:33959
I20260809 20:10:58.795492 15096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:10:58.800860 15206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:10:58.802778 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 15096
I20260809 20:10:58.803210 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:10:58.805783 15060 external_mini_cluster.cc:1428] Setting key 89de0a449f50d5ddb90589665cc15b65
I20260809 20:10:58.819101 15206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 762dd8d9519442ee8b02407afee9ecc1: Bootstrap starting.
I20260809 20:10:58.823980 15206 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 762dd8d9519442ee8b02407afee9ecc1: Neither blocks nor log segments found. Creating new log.
I20260809 20:10:58.826014 15206 log.cc:824] T 00000000000000000000000000000000 P 762dd8d9519442ee8b02407afee9ecc1: Log is configured to *not* fsync() on all Append() calls
I20260809 20:10:58.836773 15206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 762dd8d9519442ee8b02407afee9ecc1: No bootstrap required, opened a new log
I20260809 20:10:58.850481 15206 raft_consensus.cc:348] T 00000000000000000000000000000000 P 762dd8d9519442ee8b02407afee9ecc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "762dd8d9519442ee8b02407afee9ecc1" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33959 } }
I20260809 20:10:58.851058 15206 raft_consensus.cc:374] T 00000000000000000000000000000000 P 762dd8d9519442ee8b02407afee9ecc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:10:58.851260 15206 raft_consensus.cc:729] T 00000000000000000000000000000000 P 762dd8d9519442ee8b02407afee9ecc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762dd8d9519442ee8b02407afee9ecc1, State: Initialized, Role: FOLLOWER
I20260809 20:10:58.852571 15206 consensus_queue.cc:260] T 00000000000000000000000000000000 P 762dd8d9519442ee8b02407afee9ecc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "762dd8d9519442ee8b02407afee9ecc1" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33959 } }
I20260809 20:10:58.852911 15206 raft_consensus.cc:388] T 00000000000000000000000000000000 P 762dd8d9519442ee8b02407afee9ecc1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:10:58.853307 15206 raft_consensus.cc:482] T 00000000000000000000000000000000 P 762dd8d9519442ee8b02407afee9ecc1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:10:58.853546 15206 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 762dd8d9519442ee8b02407afee9ecc1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:10:58.856775 15206 raft_consensus.cc:504] T 00000000000000000000000000000000 P 762dd8d9519442ee8b02407afee9ecc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "762dd8d9519442ee8b02407afee9ecc1" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33959 } }
I20260809 20:10:58.858063 15206 leader_election.cc:302] T 00000000000000000000000000000000 P 762dd8d9519442ee8b02407afee9ecc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 762dd8d9519442ee8b02407afee9ecc1; no voters:
I20260809 20:10:58.859114 15206 leader_election.cc:288] T 00000000000000000000000000000000 P 762dd8d9519442ee8b02407afee9ecc1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:10:58.859441 15211 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 762dd8d9519442ee8b02407afee9ecc1 [term 1 FOLLOWER]: Leader election won for term 1
Aug 09 20:10:58 dist-test-slave-6zbq krb5kdc[15072](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:10:58.862262 15206 sys_catalog.cc:564] T 00000000000000000000000000000000 P 762dd8d9519442ee8b02407afee9ecc1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:10:58.862648 15211 raft_consensus.cc:686] T 00000000000000000000000000000000 P 762dd8d9519442ee8b02407afee9ecc1 [term 1 LEADER]: Becoming Leader. State: Replica: 762dd8d9519442ee8b02407afee9ecc1, State: Running, Role: LEADER
I20260809 20:10:58.863546 15211 consensus_queue.cc:237] T 00000000000000000000000000000000 P 762dd8d9519442ee8b02407afee9ecc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "762dd8d9519442ee8b02407afee9ecc1" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33959 } }
I20260809 20:10:58.868808 15216 sys_catalog.cc:455] T 00000000000000000000000000000000 P 762dd8d9519442ee8b02407afee9ecc1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 762dd8d9519442ee8b02407afee9ecc1. Latest consensus state: current_term: 1 leader_uuid: "762dd8d9519442ee8b02407afee9ecc1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "762dd8d9519442ee8b02407afee9ecc1" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33959 } } }
I20260809 20:10:58.869191 15216 sys_catalog.cc:458] T 00000000000000000000000000000000 P 762dd8d9519442ee8b02407afee9ecc1 [sys.catalog]: This master's current role is: LEADER
I20260809 20:10:58.869699 15212 sys_catalog.cc:455] T 00000000000000000000000000000000 P 762dd8d9519442ee8b02407afee9ecc1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "762dd8d9519442ee8b02407afee9ecc1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "762dd8d9519442ee8b02407afee9ecc1" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33959 } } }
I20260809 20:10:58.870042 15212 sys_catalog.cc:458] T 00000000000000000000000000000000 P 762dd8d9519442ee8b02407afee9ecc1 [sys.catalog]: This master's current role is: LEADER
I20260809 20:10:58.877102 15208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:10:58.813166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37450 (local address 127.14.181.62:33959)
0809 20:10:58.826468 (+ 13302us) server_negotiation.cc:206] Beginning negotiation
0809 20:10:58.826486 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 20:10:58.828677 (+ 2191us) server_negotiation.cc:407] Connection header received
0809 20:10:58.841356 (+ 12679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:10:58.841388 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:10:58.842159 (+ 771us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:10:58.842588 (+ 429us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:10:58.847681 (+ 5093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:10:58.849692 (+ 2011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:10:58.852313 (+ 2621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:10:58.853682 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:10:58.853924 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:10:58.862199 (+ 8275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:10:58.862334 (+ 135us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:10:58.862378 (+ 44us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:10:58.862437 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:10:58.867201 (+ 4764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:10:58.868315 (+ 1114us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:10:58.868324 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:10:58.868333 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:10:58.868627 (+ 294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:10:58.869255 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:10:58.869261 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:10:58.869264 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:10:58.870242 (+ 978us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:10:58.874479 (+ 4237us) server_negotiation.cc:1035] Waiting for connection context
0809 20:10:58.874770 (+ 291us) server_negotiation.cc:299] Negotiation successful
0809 20:10:58.875181 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12870,"thread_start_us":13067,"threads_started":1}
I20260809 20:10:58.882747 15226 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:10:58.889267 15226 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:10:58.903571 15226 catalog_manager.cc:1347] Generated new cluster ID: 9e6b71badbc545c5a2c1b3a18c1b6898
I20260809 20:10:58.903673 15226 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:10:58.930730 15226 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:10:58.932099 15226 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:10:58.940936 15226 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 762dd8d9519442ee8b02407afee9ecc1: Generated new TSK 0
I20260809 20:10:58.941946 15226 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.181.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
I20260809 20:10:58.999504 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:0
--local_ip_for_outbound_sockets=127.14.181.1
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:33959
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:34295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:10:59.309103 15249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:10:59.309347 15249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:10:59.309475 15249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:10:59.316557 15249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:10:59.316653 15249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:10:59.316799 15249 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:10:59.326089 15249 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:34295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:33959
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:10:59.327155 15249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:10:59.328329 15249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:10:59.341478 15258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:10:59.341508 15259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:10:59.341451 15261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:10:59.342188 15249 server_base.cc:1034] running on GCE node
I20260809 20:10:59.342762 15249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:10:59.343657 15249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:10:59.344837 15249 hybrid_clock.cc:648] HybridClock initialized: now 1786306259344804 us; error 37 us; skew 500 ppm
I20260809 20:10:59.345117 15249 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:10:59 dist-test-slave-6zbq krb5kdc[15072](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306259, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:10:59.347990 15249 init.cc:377] Logged in from keytab as kudu/127.14.181.1@KRBTEST.COM (short username kudu)
I20260809 20:10:59.349196 15249 webserver.cc:460] Webserver started at http://127.14.181.1:35783/ using document root <none> and password file <none>
I20260809 20:10:59.349772 15249 fs_manager.cc:359] Metadata directory not provided
I20260809 20:10:59.349866 15249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:10:59.350093 15249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:10:59.352766 15249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-0/data/instance:
uuid: "8eb2597317284228a5f245279a3b5771"
format_stamp: "Formatted at 2026-08-09 20:10:59 on dist-test-slave-6zbq"
server_key: "58d9878e8ce4d71f11139694bb5142c6"
server_key_iv: "a8bba99bac6977e5f6a89ffdd290961a"
server_key_version: "encryptionkey@0"
I20260809 20:10:59.353421 15249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance:
uuid: "8eb2597317284228a5f245279a3b5771"
format_stamp: "Formatted at 2026-08-09 20:10:59 on dist-test-slave-6zbq"
server_key: "58d9878e8ce4d71f11139694bb5142c6"
server_key_iv: "a8bba99bac6977e5f6a89ffdd290961a"
server_key_version: "encryptionkey@0"
I20260809 20:10:59.358129 15249 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 20:10:59.361263 15275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:10:59.362488 15249 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260809 20:10:59.362625 15249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "8eb2597317284228a5f245279a3b5771"
format_stamp: "Formatted at 2026-08-09 20:10:59 on dist-test-slave-6zbq"
server_key: "58d9878e8ce4d71f11139694bb5142c6"
server_key_iv: "a8bba99bac6977e5f6a89ffdd290961a"
server_key_version: "encryptionkey@0"
I20260809 20:10:59.362797 15249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:10:59.386700 15249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:10:59.390091 15249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:10:59.390329 15249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:10:59.391311 15249 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:10:59.392823 15249 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:10:59.392897 15249 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:10:59.393074 15249 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:10:59.393144 15249 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:10:59.425371 15249 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:36951
I20260809 20:10:59.425400 15454 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:36951 every 8 connection(s)
I20260809 20:10:59.426674 15249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:10:59.433247 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 15249
I20260809 20:10:59.433482 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance
I20260809 20:10:59.434067 15060 external_mini_cluster.cc:1428] Setting key 72f3ada4a6cefd353b39bcbe917b68ec
Aug 09 20:10:59 dist-test-slave-6zbq krb5kdc[15072](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306259, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:10:59.447372 15459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:10:59.429702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:48563 (local address 127.14.181.62:33959)
0809 20:10:59.430219 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0809 20:10:59.430227 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:10:59.431147 (+ 920us) server_negotiation.cc:407] Connection header received
0809 20:10:59.432976 (+ 1829us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:10:59.432982 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:10:59.433070 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:10:59.433208 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:10:59.434688 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:10:59.435440 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:10:59.437047 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:10:59.437659 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:10:59.437778 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:10:59.441253 (+ 3475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:10:59.441259 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:10:59.441263 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:10:59.441307 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:10:59.444418 (+ 3111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:10:59.445098 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:10:59.445104 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:10:59.445107 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:10:59.445251 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:10:59.445661 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:10:59.445665 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:10:59.445668 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:10:59.445979 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:10:59.446114 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 20:10:59.446808 (+ 694us) server_negotiation.cc:299] Negotiation successful
0809 20:10:59.447004 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":234,"threads_started":1}
I20260809 20:10:59.448096 15462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:10:59.430210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:33959 (local address 127.14.181.1:48563)
0809 20:10:59.430987 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0809 20:10:59.431025 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 20:10:59.432711 (+ 1686us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:10:59.433421 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:10:59.433429 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:10:59.433927 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:10:59.434522 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:10:59.434540 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:10:59.435595 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:10:59.435600 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:10:59.436896 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:10:59.436908 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:10:59.437835 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:10:59.437839 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:10:59.438017 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:10:59.438683 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:10:59.438712 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:10:59.440992 (+ 2280us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:10:59.444548 (+ 3556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:10:59.444554 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:10:59.444564 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:10:59.444964 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:10:59.445375 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:10:59.445379 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:10:59.445381 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:10:59.445551 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:10:59.446081 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:10:59.446086 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:10:59.446382 (+ 296us) client_negotiation.cc:769] Sending connection context
0809 20:10:59.446683 (+ 301us) client_negotiation.cc:240] Negotiation successful
0809 20:10:59.447018 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":321,"threads_started":1}
I20260809 20:10:59.449549 15457 heartbeater.cc:347] Connected to a master server at 127.14.181.62:33959
I20260809 20:10:59.449951 15457 heartbeater.cc:464] Registering TS with master...
I20260809 20:10:59.450815 15457 heartbeater.cc:511] Master 127.14.181.62:33959 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.14.181.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.2@KRBTEST.COM" created.
I20260809 20:10:59.454989 15145 ts_manager.cc:194] Registered new tserver with Master: 8eb2597317284228a5f245279a3b5771 (127.14.181.1:36951)
I20260809 20:10:59.457773 15145 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.1@KRBTEST.COM'} at 127.14.181.1:48563
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
I20260809 20:10:59.471320 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:0
--local_ip_for_outbound_sockets=127.14.181.2
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:33959
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:34295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:10:59.780058 15467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:10:59.780318 15467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:10:59.780447 15467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:10:59.787436 15467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:10:59.787528 15467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:10:59.787680 15467 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:10:59.799324 15467 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:34295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:33959
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:10:59.800631 15467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:10:59.802088 15467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:10:59.818485 15475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:10:59.819067 15477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:10:59.819124 15480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:10:59.819499 15467 server_base.cc:1034] running on GCE node
I20260809 20:10:59.820286 15467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:10:59.821097 15467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:10:59.822273 15467 hybrid_clock.cc:648] HybridClock initialized: now 1786306259822243 us; error 31 us; skew 500 ppm
I20260809 20:10:59.822563 15467 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:10:59 dist-test-slave-6zbq krb5kdc[15072](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306259, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:10:59.825340 15467 init.cc:377] Logged in from keytab as kudu/127.14.181.2@KRBTEST.COM (short username kudu)
I20260809 20:10:59.826689 15467 webserver.cc:460] Webserver started at http://127.14.181.2:45069/ using document root <none> and password file <none>
I20260809 20:10:59.827284 15467 fs_manager.cc:359] Metadata directory not provided
I20260809 20:10:59.827399 15467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:10:59.827677 15467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:10:59.830361 15467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-1/data/instance:
uuid: "be18eaefa21c41d88dd2bf7ae916dcd1"
format_stamp: "Formatted at 2026-08-09 20:10:59 on dist-test-slave-6zbq"
server_key: "d7e4d6ce028c9134d006dd297a43d30d"
server_key_iv: "e3912149cdbe98cb26f9b6db0af34c9c"
server_key_version: "encryptionkey@0"
I20260809 20:10:59.831205 15467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance:
uuid: "be18eaefa21c41d88dd2bf7ae916dcd1"
format_stamp: "Formatted at 2026-08-09 20:10:59 on dist-test-slave-6zbq"
server_key: "d7e4d6ce028c9134d006dd297a43d30d"
server_key_iv: "e3912149cdbe98cb26f9b6db0af34c9c"
server_key_version: "encryptionkey@0"
I20260809 20:10:59.835969 15467 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260809 20:10:59.839118 15492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:10:59.840305 15467 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 20:10:59.840442 15467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "be18eaefa21c41d88dd2bf7ae916dcd1"
format_stamp: "Formatted at 2026-08-09 20:10:59 on dist-test-slave-6zbq"
server_key: "d7e4d6ce028c9134d006dd297a43d30d"
server_key_iv: "e3912149cdbe98cb26f9b6db0af34c9c"
server_key_version: "encryptionkey@0"
I20260809 20:10:59.840607 15467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:10:59.854112 15467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:10:59.857563 15467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:10:59.857803 15467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:10:59.858676 15467 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:10:59.859843 15467 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:10:59.859920 15467 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:10:59.860029 15467 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:10:59.860086 15467 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:10:59.891345 15467 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:45595
I20260809 20:10:59.891399 15662 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:45595 every 8 connection(s)
I20260809 20:10:59.892477 15467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:10:59.893487 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 15467
I20260809 20:10:59.893702 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance
I20260809 20:10:59.894227 15060 external_mini_cluster.cc:1428] Setting key fdcefce428a6bb1efa2cf7035069f927
Aug 09 20:10:59 dist-test-slave-6zbq krb5kdc[15072](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306259, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.181.3@KRBTEST.COM; defaulting to no policy
I20260809 20:10:59.911516 15459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:10:59.895154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:44205 (local address 127.14.181.62:33959)
0809 20:10:59.895356 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 20:10:59.895362 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:10:59.896581 (+ 1219us) server_negotiation.cc:407] Connection header received
0809 20:10:59.898413 (+ 1832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:10:59.898420 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:10:59.898517 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:10:59.898626 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:10:59.899950 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:10:59.900869 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:10:59.902516 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:10:59.902927 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:10:59.903039 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:10:59.906165 (+ 3126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:10:59.906172 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:10:59.906176 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:10:59.906214 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:10:59.908781 (+ 2567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:10:59.909421 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:10:59.909426 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:10:59.909429 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:10:59.909557 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:10:59.909955 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:10:59.909959 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:10:59.909961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:10:59.910220 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:10:59.910378 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 20:10:59.911053 (+ 675us) server_negotiation.cc:299] Negotiation successful
0809 20:10:59.911269 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 20:10:59.912374 15667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:10:59.895556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:33959 (local address 127.14.181.2:44205)
0809 20:10:59.896411 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0809 20:10:59.896461 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 20:10:59.898124 (+ 1663us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:10:59.898790 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:10:59.898798 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:10:59.899272 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:10:59.899786 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:10:59.899803 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:10:59.901004 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:10:59.901008 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:10:59.902389 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:10:59.902402 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:10:59.903136 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:10:59.903144 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:10:59.903360 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:10:59.903927 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:10:59.903948 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:10:59.905949 (+ 2001us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:10:59.908913 (+ 2964us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:10:59.908922 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:10:59.908936 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:10:59.909311 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:10:59.909659 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:10:59.909664 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:10:59.909668 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:10:59.909851 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:10:59.910385 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:10:59.910393 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:10:59.910739 (+ 346us) client_negotiation.cc:769] Sending connection context
0809 20:10:59.910963 (+ 224us) client_negotiation.cc:240] Negotiation successful
0809 20:10:59.911353 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":400,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.3@KRBTEST.COM" created.
I20260809 20:10:59.913645 15663 heartbeater.cc:347] Connected to a master server at 127.14.181.62:33959
I20260809 20:10:59.913955 15663 heartbeater.cc:464] Registering TS with master...
I20260809 20:10:59.914814 15663 heartbeater.cc:511] Master 127.14.181.62:33959 requested a full tablet report, sending...
I20260809 20:10:59.916327 15145 ts_manager.cc:194] Registered new tserver with Master: be18eaefa21c41d88dd2bf7ae916dcd1 (127.14.181.2:45595)
I20260809 20:10:59.917088 15145 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.2@KRBTEST.COM'} at 127.14.181.2:44205
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
I20260809 20:10:59.932590 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:0
--local_ip_for_outbound_sockets=127.14.181.3
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:33959
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:34295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:00.240983 15671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:00.241261 15671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:00.241401 15671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:00.248515 15671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:00.248625 15671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:00.248790 15671 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:11:00.258013 15671 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:34295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:33959
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:00.259119 15671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:00.260310 15671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:00.272418 15679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:00.272534 15677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:00.272491 15682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:00.273329 15671 server_base.cc:1034] running on GCE node
I20260809 20:11:00.273833 15671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:00.274652 15671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:00.275842 15671 hybrid_clock.cc:648] HybridClock initialized: now 1786306260275799 us; error 35 us; skew 500 ppm
I20260809 20:11:00.276113 15671 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:00 dist-test-slave-6zbq krb5kdc[15072](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306260, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:00.279012 15671 init.cc:377] Logged in from keytab as kudu/127.14.181.3@KRBTEST.COM (short username kudu)
I20260809 20:11:00.280313 15671 webserver.cc:460] Webserver started at http://127.14.181.3:42085/ using document root <none> and password file <none>
I20260809 20:11:00.280895 15671 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:00.281009 15671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:00.281303 15671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:00.284024 15671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-2/data/instance:
uuid: "868f70d86c8c4aee945bb1ed1e362e3c"
format_stamp: "Formatted at 2026-08-09 20:11:00 on dist-test-slave-6zbq"
server_key: "1df546f56c1be29c184375c7645e9342"
server_key_iv: "2844d1d5295d5e05947b19790e4b35fa"
server_key_version: "encryptionkey@0"
I20260809 20:11:00.284840 15671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance:
uuid: "868f70d86c8c4aee945bb1ed1e362e3c"
format_stamp: "Formatted at 2026-08-09 20:11:00 on dist-test-slave-6zbq"
server_key: "1df546f56c1be29c184375c7645e9342"
server_key_iv: "2844d1d5295d5e05947b19790e4b35fa"
server_key_version: "encryptionkey@0"
I20260809 20:11:00.289743 15671 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 20:11:00.292969 15691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:00.294111 15671 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 20:11:00.294278 15671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "868f70d86c8c4aee945bb1ed1e362e3c"
format_stamp: "Formatted at 2026-08-09 20:11:00 on dist-test-slave-6zbq"
server_key: "1df546f56c1be29c184375c7645e9342"
server_key_iv: "2844d1d5295d5e05947b19790e4b35fa"
server_key_version: "encryptionkey@0"
I20260809 20:11:00.294503 15671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:00.305084 15671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:00.308557 15671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:00.308795 15671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:00.309610 15671 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:11:00.310864 15671 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:00.310942 15671 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:00.311053 15671 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:00.311106 15671 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:00.342093 15671 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:45419
I20260809 20:11:00.342152 15883 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:45419 every 8 connection(s)
I20260809 20:11:00.343300 15671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:11:00.344971 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 15671
I20260809 20:11:00.345219 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance
I20260809 20:11:00.345676 15060 external_mini_cluster.cc:1428] Setting key 37df6cdf4631c8b632695fed4e74b968
Aug 09 20:11:00 dist-test-slave-6zbq krb5kdc[15072](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306260, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:00.362587 15459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:00.345977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:60417 (local address 127.14.181.62:33959)
0809 20:11:00.346168 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:00.346174 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:00.347448 (+ 1274us) server_negotiation.cc:407] Connection header received
0809 20:11:00.349789 (+ 2341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:00.349794 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:00.349879 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:00.349985 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:00.351518 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:00.352236 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:00.353669 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:00.354052 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:00.354136 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:00.357218 (+ 3082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:00.357222 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:00.357226 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:00.357255 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:00.359676 (+ 2421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:00.360279 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:00.360282 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:00.360284 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:00.360389 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:00.360748 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:00.360752 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:00.360755 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:00.361060 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:00.361239 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:00.361994 (+ 755us) server_negotiation.cc:299] Negotiation successful
0809 20:11:00.362216 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 20:11:00.363245 15890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:00.346498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:33959 (local address 127.14.181.3:60417)
0809 20:11:00.347278 (+ 780us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:00.347325 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:00.349535 (+ 2210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:00.350161 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:00.350169 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:00.350839 (+ 670us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:00.351380 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:00.351398 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:00.352362 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:00.352365 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:00.353559 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:00.353576 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:00.354209 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:00.354214 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:00.354434 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:00.355012 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:00.355033 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:00.357054 (+ 2021us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:00.359794 (+ 2740us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:00.359800 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:00.359810 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:00.360191 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:00.360459 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:00.360462 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:00.360465 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:00.360640 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:00.361200 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:00.361208 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:00.361495 (+ 287us) client_negotiation.cc:769] Sending connection context
0809 20:11:00.361791 (+ 296us) client_negotiation.cc:240] Negotiation successful
0809 20:11:00.362168 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":299,"threads_started":1}
I20260809 20:11:00.364454 15886 heartbeater.cc:347] Connected to a master server at 127.14.181.62:33959
I20260809 20:11:00.364686 15886 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:00.365309 15886 heartbeater.cc:511] Master 127.14.181.62:33959 requested a full tablet report, sending...
I20260809 20:11:00.366626 15145 ts_manager.cc:194] Registered new tserver with Master: 868f70d86c8c4aee945bb1ed1e362e3c (127.14.181.3:45419)
I20260809 20:11:00.367375 15145 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.3@KRBTEST.COM'} at 127.14.181.3:60417
I20260809 20:11:00.374292 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 20:11:00 dist-test-slave-6zbq krb5kdc[15072](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306260, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 20:11:00 dist-test-slave-6zbq krb5kdc[15072](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306260, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.181.1@KRBTEST.COM
I20260809 20:11:00.417654 15900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:00.403435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33704 (local address 127.14.181.1:36951)
0809 20:11:00.404302 (+ 867us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:00.404309 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:00.404333 (+ 24us) server_negotiation.cc:407] Connection header received
0809 20:11:00.404390 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:00.404396 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:00.404588 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:00.404705 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:00.406002 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:00.407033 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:00.408234 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:00.408736 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:00.408833 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:00.412437 (+ 3604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:00.412448 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:00.412461 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:00.412491 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:00.415138 (+ 2647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:00.415723 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:00.415730 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:00.415733 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:00.415847 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:00.416199 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:00.416203 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:00.416205 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:00.416516 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:00.416796 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:00.417079 (+ 283us) server_negotiation.cc:299] Negotiation successful
0809 20:11:00.417333 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":724,"thread_start_us":595,"threads_started":1}
W20260809 20:11:00.418870 15323 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33704
Aug 09 20:11:00 dist-test-slave-6zbq krb5kdc[15072](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306260, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 20:11:00 dist-test-slave-6zbq krb5kdc[15072](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306260, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.1@KRBTEST.COM
I20260809 20:11:00.459731 15900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:00.447333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33714 (local address 127.14.181.1:36951)
0809 20:11:00.447501 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:00.447507 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:00.447810 (+ 303us) server_negotiation.cc:407] Connection header received
0809 20:11:00.447964 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:00.447968 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:00.448054 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:00.448135 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:00.449375 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:00.450033 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:00.451256 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:00.451632 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:00.451737 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:00.455211 (+ 3474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:00.455216 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:00.455219 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:00.455248 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:00.457420 (+ 2172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:00.457997 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:00.458003 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:00.458006 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:00.458118 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:00.458473 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:00.458479 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:00.458483 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:00.458723 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:00.458933 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:00.459249 (+ 316us) server_negotiation.cc:299] Negotiation successful
0809 20:11:00.459446 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 20:11:00.461006 15457 heartbeater.cc:503] Master 127.14.181.62:33959 was elected leader, sending a full tablet report...
I20260809 20:11:00.461385 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 15249
I20260809 20:11:00.473387 15900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:00.462467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33726 (local address 127.14.181.1:36951)
0809 20:11:00.462649 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:00.462654 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:00.462928 (+ 274us) server_negotiation.cc:407] Connection header received
0809 20:11:00.463068 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:00.463072 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:00.463127 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:00.463200 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:00.464371 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:00.465007 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:00.466280 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:00.466790 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:00.466889 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:00.468964 (+ 2075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:00.468970 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:00.468973 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:00.469000 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:00.471118 (+ 2118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:00.471688 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:00.471694 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:00.471697 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:00.471810 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:00.472135 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:00.472140 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:00.472144 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:00.472385 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:00.472601 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:00.472886 (+ 285us) server_negotiation.cc:299] Negotiation successful
0809 20:11:00.473074 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 20:11:00.474061 15448 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:00.559409 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 15249
I20260809 20:11:00.582046 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 15467
Aug 09 20:11:00 dist-test-slave-6zbq krb5kdc[15072](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306260, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.2@KRBTEST.COM
I20260809 20:11:00.596931 15912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:00.582898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57698 (local address 127.14.181.2:45595)
0809 20:11:00.583394 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:00.583401 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:00.583426 (+ 25us) server_negotiation.cc:407] Connection header received
0809 20:11:00.583484 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:00.583492 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:00.583692 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:00.583841 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:00.585054 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:00.586030 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:00.587313 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:00.587874 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:00.587984 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:00.591781 (+ 3797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:00.591792 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:00.591804 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:00.591836 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:00.594309 (+ 2473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:00.594909 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:00.594916 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:00.594919 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:00.595042 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:00.595417 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:00.595420 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:00.595423 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:00.595735 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:00.596039 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:00.596348 (+ 309us) server_negotiation.cc:299] Negotiation successful
0809 20:11:00.596601 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":233,"threads_started":1}
I20260809 20:11:00.598150 15656 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:00.679736 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 15467
I20260809 20:11:00.702124 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 15671
Aug 09 20:11:00 dist-test-slave-6zbq krb5kdc[15072](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306260, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.3@KRBTEST.COM
I20260809 20:11:00.717181 15914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:00.703114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33718 (local address 127.14.181.3:45419)
0809 20:11:00.703718 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:00.703725 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:00.703753 (+ 28us) server_negotiation.cc:407] Connection header received
0809 20:11:00.703813 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:00.703819 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:00.704018 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:00.704158 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:00.705305 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:00.706325 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:00.707645 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:00.708194 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:00.708295 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:00.712138 (+ 3843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:00.712149 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:00.712163 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:00.712195 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:00.714983 (+ 2788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:00.715547 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:00.715553 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:00.715555 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:00.715666 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:00.715929 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:00.715932 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:00.715934 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:00.716233 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:00.716468 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:00.716660 (+ 192us) server_negotiation.cc:299] Negotiation successful
0809 20:11:00.716845 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":306,"threads_started":1}
I20260809 20:11:00.718405 15877 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:00.800705 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 15671
I20260809 20:11:00.820719 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 15096
I20260809 20:11:00.821825 15195 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:00.921532 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 15096
2026-08-09T20:11:00Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4142 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:11:01 dist-test-slave-6zbq krb5kdc[15922](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:11:01 dist-test-slave-6zbq krb5kdc[15922](info): set up 2 sockets
Aug 09 20:11:01 dist-test-slave-6zbq krb5kdc[15922](info): commencing operation
krb5kdc: starting...
W20260809 20:11:02.087975 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.002s sys 0.014s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:11:02 dist-test-slave-6zbq krb5kdc[15922](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:11:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:11:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:11:02.241479 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:43871
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:43871
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:02.539299 15944 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:02.539542 15944 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:02.539669 15944 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:02.546489 15944 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:11:02.546576 15944 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:02.546646 15944 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:02.546720 15944 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:11:02.546777 15944 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:11:02.555789 15944 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:43871
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:43871
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:02.556854 15944 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:02.557996 15944 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:02.568653 15953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:02.568609 15954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:02.568686 15958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:02.569535 15944 server_base.cc:1034] running on GCE node
I20260809 20:11:02.570209 15944 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:02.571412 15944 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:02.572611 15944 hybrid_clock.cc:648] HybridClock initialized: now 1786306262572568 us; error 27 us; skew 500 ppm
I20260809 20:11:02.572904 15944 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:02 dist-test-slave-6zbq krb5kdc[15922](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306262, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:02.580305 15944 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:11:02.581578 15944 webserver.cc:460] Webserver started at http://127.14.181.62:34775/ using document root <none> and password file <none>
I20260809 20:11:02.582208 15944 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:02.582321 15944 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:02.582649 15944 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:02.585331 15944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "368460c7215a4398b74efc57bfa0422f"
format_stamp: "Formatted at 2026-08-09 20:11:02 on dist-test-slave-6zbq"
server_key: "42e7342325ed018a2cd4a33f92b458e5"
server_key_iv: "2878595daf3b90125fcfc919ee5f3096"
server_key_version: "encryptionkey@0"
I20260809 20:11:02.586020 15944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "368460c7215a4398b74efc57bfa0422f"
format_stamp: "Formatted at 2026-08-09 20:11:02 on dist-test-slave-6zbq"
server_key: "42e7342325ed018a2cd4a33f92b458e5"
server_key_iv: "2878595daf3b90125fcfc919ee5f3096"
server_key_version: "encryptionkey@0"
I20260809 20:11:02.590662 15944 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 20:11:02.593750 15967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:02.594966 15944 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:11:02.595115 15944 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "368460c7215a4398b74efc57bfa0422f"
format_stamp: "Formatted at 2026-08-09 20:11:02 on dist-test-slave-6zbq"
server_key: "42e7342325ed018a2cd4a33f92b458e5"
server_key_iv: "2878595daf3b90125fcfc919ee5f3096"
server_key_version: "encryptionkey@0"
I20260809 20:11:02.595286 15944 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:02.613097 15944 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:02.616834 15944 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:02.617063 15944 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:02.633188 15944 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:43871
I20260809 20:11:02.633213 16053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:43871 every 8 connection(s)
I20260809 20:11:02.634335 15944 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:11:02.637768 16054 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:02.643081 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 15944
I20260809 20:11:02.643324 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:11:02.644140 15060 external_mini_cluster.cc:1428] Setting key 68cd1e090fc72ba006fe8915b89e72cf
I20260809 20:11:02.648188 16054 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 368460c7215a4398b74efc57bfa0422f: Bootstrap starting.
I20260809 20:11:02.651525 16054 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 368460c7215a4398b74efc57bfa0422f: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:02.652542 16054 log.cc:824] T 00000000000000000000000000000000 P 368460c7215a4398b74efc57bfa0422f: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:02.655241 16054 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 368460c7215a4398b74efc57bfa0422f: No bootstrap required, opened a new log
Aug 09 20:11:02 dist-test-slave-6zbq krb5kdc[15922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:02.663812 16054 raft_consensus.cc:348] T 00000000000000000000000000000000 P 368460c7215a4398b74efc57bfa0422f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "368460c7215a4398b74efc57bfa0422f" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 43871 } }
I20260809 20:11:02.664216 16054 raft_consensus.cc:374] T 00000000000000000000000000000000 P 368460c7215a4398b74efc57bfa0422f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:02.664323 16054 raft_consensus.cc:729] T 00000000000000000000000000000000 P 368460c7215a4398b74efc57bfa0422f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 368460c7215a4398b74efc57bfa0422f, State: Initialized, Role: FOLLOWER
I20260809 20:11:02.664860 16054 consensus_queue.cc:260] T 00000000000000000000000000000000 P 368460c7215a4398b74efc57bfa0422f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "368460c7215a4398b74efc57bfa0422f" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 43871 } }
I20260809 20:11:02.665087 16054 raft_consensus.cc:388] T 00000000000000000000000000000000 P 368460c7215a4398b74efc57bfa0422f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:11:02.665218 16054 raft_consensus.cc:482] T 00000000000000000000000000000000 P 368460c7215a4398b74efc57bfa0422f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:11:02.665377 16054 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 368460c7215a4398b74efc57bfa0422f [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:02.665602 16057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:02.646019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56318 (local address 127.14.181.62:43871)
0809 20:11:02.646785 (+ 766us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:02.646794 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:02.646831 (+ 37us) server_negotiation.cc:407] Connection header received
0809 20:11:02.648464 (+ 1633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:02.648484 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:02.648824 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:02.649100 (+ 276us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:02.650836 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:02.652079 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:02.653599 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:02.654223 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:02.654385 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:02.658778 (+ 4393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:02.658786 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:02.658798 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:02.658839 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:02.661709 (+ 2870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:02.662478 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:02.662484 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:02.662489 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:02.662656 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:02.662995 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:02.662999 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:02.663001 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:02.663469 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:02.663682 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:02.664169 (+ 487us) server_negotiation.cc:299] Negotiation successful
0809 20:11:02.664577 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":576,"thread_start_us":370,"threads_started":1}
I20260809 20:11:02.667557 16054 raft_consensus.cc:504] T 00000000000000000000000000000000 P 368460c7215a4398b74efc57bfa0422f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "368460c7215a4398b74efc57bfa0422f" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 43871 } }
I20260809 20:11:02.668038 16054 leader_election.cc:302] T 00000000000000000000000000000000 P 368460c7215a4398b74efc57bfa0422f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 368460c7215a4398b74efc57bfa0422f; no voters:
I20260809 20:11:02.668516 16054 leader_election.cc:288] T 00000000000000000000000000000000 P 368460c7215a4398b74efc57bfa0422f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:11:02.668628 16060 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 368460c7215a4398b74efc57bfa0422f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:02.669217 16060 raft_consensus.cc:686] T 00000000000000000000000000000000 P 368460c7215a4398b74efc57bfa0422f [term 1 LEADER]: Becoming Leader. State: Replica: 368460c7215a4398b74efc57bfa0422f, State: Running, Role: LEADER
I20260809 20:11:02.669695 16060 consensus_queue.cc:237] T 00000000000000000000000000000000 P 368460c7215a4398b74efc57bfa0422f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "368460c7215a4398b74efc57bfa0422f" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 43871 } }
I20260809 20:11:02.670200 16054 sys_catalog.cc:564] T 00000000000000000000000000000000 P 368460c7215a4398b74efc57bfa0422f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:11:02.672101 16062 sys_catalog.cc:455] T 00000000000000000000000000000000 P 368460c7215a4398b74efc57bfa0422f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "368460c7215a4398b74efc57bfa0422f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "368460c7215a4398b74efc57bfa0422f" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 43871 } } }
I20260809 20:11:02.672573 16062 sys_catalog.cc:458] T 00000000000000000000000000000000 P 368460c7215a4398b74efc57bfa0422f [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:02.672744 16063 sys_catalog.cc:455] T 00000000000000000000000000000000 P 368460c7215a4398b74efc57bfa0422f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 368460c7215a4398b74efc57bfa0422f. Latest consensus state: current_term: 1 leader_uuid: "368460c7215a4398b74efc57bfa0422f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "368460c7215a4398b74efc57bfa0422f" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 43871 } } }
I20260809 20:11:02.673432 16063 sys_catalog.cc:458] T 00000000000000000000000000000000 P 368460c7215a4398b74efc57bfa0422f [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:02.673811 16073 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:11:02.684260 16073 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:11:02.692041 16073 catalog_manager.cc:1347] Generated new cluster ID: 866e1f4c95e4400e8b1df192972121c3
I20260809 20:11:02.692139 16073 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:11:02.704926 16073 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:11:02.706103 16073 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:11:02.713111 16073 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 368460c7215a4398b74efc57bfa0422f: Generated new TSK 0
I20260809 20:11:02.713711 16073 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.181.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
I20260809 20:11:02.757504 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:0
--local_ip_for_outbound_sockets=127.14.181.1
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:43871
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:03.062139 16094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:03.062400 16094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:03.062528 16094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:03.069254 16094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:03.069336 16094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:03.069445 16094 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:11:03.078693 16094 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:43871
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:03.079735 16094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:03.080940 16094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:03.092695 16099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:03.092705 16106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:03.092705 16100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:03.093453 16094 server_base.cc:1034] running on GCE node
I20260809 20:11:03.093955 16094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:03.094780 16094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:03.095961 16094 hybrid_clock.cc:648] HybridClock initialized: now 1786306263095923 us; error 31 us; skew 500 ppm
I20260809 20:11:03.096233 16094 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:03 dist-test-slave-6zbq krb5kdc[15922](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306263, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:03.099085 16094 init.cc:377] Logged in from keytab as kudu/127.14.181.1@KRBTEST.COM (short username kudu)
I20260809 20:11:03.100425 16094 webserver.cc:460] Webserver started at http://127.14.181.1:37245/ using document root <none> and password file <none>
I20260809 20:11:03.101012 16094 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:03.101135 16094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:03.101410 16094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:03.104008 16094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-0/data/instance:
uuid: "5a6a2d56313641d8a72f55c655816071"
format_stamp: "Formatted at 2026-08-09 20:11:03 on dist-test-slave-6zbq"
server_key: "95fd110464f417972f1e0fb58340700c"
server_key_iv: "caa18a2a468b7059e21d4ea25c164154"
server_key_version: "encryptionkey@0"
I20260809 20:11:03.104734 16094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance:
uuid: "5a6a2d56313641d8a72f55c655816071"
format_stamp: "Formatted at 2026-08-09 20:11:03 on dist-test-slave-6zbq"
server_key: "95fd110464f417972f1e0fb58340700c"
server_key_iv: "caa18a2a468b7059e21d4ea25c164154"
server_key_version: "encryptionkey@0"
I20260809 20:11:03.109287 16094 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 20:11:03.112330 16117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:03.113445 16094 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 20:11:03.113585 16094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "5a6a2d56313641d8a72f55c655816071"
format_stamp: "Formatted at 2026-08-09 20:11:03 on dist-test-slave-6zbq"
server_key: "95fd110464f417972f1e0fb58340700c"
server_key_iv: "caa18a2a468b7059e21d4ea25c164154"
server_key_version: "encryptionkey@0"
I20260809 20:11:03.113756 16094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:03.129769 16094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:03.133070 16094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:03.133308 16094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:03.134094 16094 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:11:03.135315 16094 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:03.135390 16094 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:03.135504 16094 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:03.135555 16094 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:03.164323 16094 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:35507
I20260809 20:11:03.164351 16308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:35507 every 8 connection(s)
I20260809 20:11:03.165401 16094 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:11:03.171336 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 16094
I20260809 20:11:03.171542 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance
I20260809 20:11:03.172290 15060 external_mini_cluster.cc:1428] Setting key bfd73b2e4ede3dbd0534259fa96a5a26
Aug 09 20:11:03 dist-test-slave-6zbq krb5kdc[15922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306263, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:03.184629 16313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:03.167560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:37461 (local address 127.14.181.62:43871)
0809 20:11:03.167927 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:03.167932 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:03.168687 (+ 755us) server_negotiation.cc:407] Connection header received
0809 20:11:03.170414 (+ 1727us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:03.170421 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:03.170498 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:03.170602 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:03.172447 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:03.173374 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:03.175348 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:03.175741 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:03.175836 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:03.179394 (+ 3558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:03.179401 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:03.179405 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:03.179442 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:03.181854 (+ 2412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:03.182633 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:03.182637 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:03.182639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:03.182750 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:03.183165 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:03.183168 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:03.183170 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:03.183421 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:03.183525 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:03.184229 (+ 704us) server_negotiation.cc:299] Negotiation successful
0809 20:11:03.184387 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":188,"threads_started":1}
I20260809 20:11:03.185787 16316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:03.167915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:43871 (local address 127.14.181.1:37461)
0809 20:11:03.168545 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:03.168578 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:03.170139 (+ 1561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:03.170803 (+ 664us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:03.170810 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:03.171554 (+ 744us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:03.172276 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:03.172301 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:03.173563 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:03.173567 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:03.175208 (+ 1641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:03.175222 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:03.175956 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:03.175963 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:03.176217 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:03.176827 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:03.176860 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:03.179178 (+ 2318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:03.181990 (+ 2812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:03.181997 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:03.182010 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:03.182539 (+ 529us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:03.182855 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:03.182860 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:03.182863 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:03.183077 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:03.183541 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:03.183548 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:03.183904 (+ 356us) client_negotiation.cc:769] Sending connection context
0809 20:11:03.184162 (+ 258us) client_negotiation.cc:240] Negotiation successful
0809 20:11:03.184582 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":253,"threads_started":1}
I20260809 20:11:03.187127 16309 heartbeater.cc:347] Connected to a master server at 127.14.181.62:43871
I20260809 20:11:03.187371 16309 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:03.187992 16309 heartbeater.cc:511] Master 127.14.181.62:43871 requested a full tablet report, sending...
I20260809 20:11:03.189838 15997 ts_manager.cc:194] Registered new tserver with Master: 5a6a2d56313641d8a72f55c655816071 (127.14.181.1:35507)
WARNING: no policy specified for kudu/127.14.181.2@KRBTEST.COM; defaulting to no policy
I20260809 20:11:03.191285 15997 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.1@KRBTEST.COM'} at 127.14.181.1:37461
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
I20260809 20:11:03.210901 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:0
--local_ip_for_outbound_sockets=127.14.181.2
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:43871
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:03.516296 16319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:03.516552 16319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:03.516697 16319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:03.523634 16319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:03.523737 16319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:03.523885 16319 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:11:03.532919 16319 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:43871
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:03.533989 16319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:03.535240 16319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:03.547024 16329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:03.546993 16327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:03.547065 16326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:03.547821 16319 server_base.cc:1034] running on GCE node
I20260809 20:11:03.548369 16319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:03.549156 16319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:03.550369 16319 hybrid_clock.cc:648] HybridClock initialized: now 1786306263550300 us; error 43 us; skew 500 ppm
I20260809 20:11:03.550652 16319 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:03 dist-test-slave-6zbq krb5kdc[15922](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306263, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:03.553426 16319 init.cc:377] Logged in from keytab as kudu/127.14.181.2@KRBTEST.COM (short username kudu)
I20260809 20:11:03.554667 16319 webserver.cc:460] Webserver started at http://127.14.181.2:44279/ using document root <none> and password file <none>
I20260809 20:11:03.555233 16319 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:03.555327 16319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:03.555559 16319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:03.558219 16319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-1/data/instance:
uuid: "a243c87e5853423b8290d0b121c0d89d"
format_stamp: "Formatted at 2026-08-09 20:11:03 on dist-test-slave-6zbq"
server_key: "c82918dd0d4af8ef006e82d3c306432d"
server_key_iv: "c9239f19394f6ae8cfcb8b812cddbac3"
server_key_version: "encryptionkey@0"
I20260809 20:11:03.559041 16319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance:
uuid: "a243c87e5853423b8290d0b121c0d89d"
format_stamp: "Formatted at 2026-08-09 20:11:03 on dist-test-slave-6zbq"
server_key: "c82918dd0d4af8ef006e82d3c306432d"
server_key_iv: "c9239f19394f6ae8cfcb8b812cddbac3"
server_key_version: "encryptionkey@0"
I20260809 20:11:03.563570 16319 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260809 20:11:03.566633 16341 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:03.567750 16319 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260809 20:11:03.567891 16319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "a243c87e5853423b8290d0b121c0d89d"
format_stamp: "Formatted at 2026-08-09 20:11:03 on dist-test-slave-6zbq"
server_key: "c82918dd0d4af8ef006e82d3c306432d"
server_key_iv: "c9239f19394f6ae8cfcb8b812cddbac3"
server_key_version: "encryptionkey@0"
I20260809 20:11:03.568053 16319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:03.591588 16319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:03.595021 16319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:03.595257 16319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:03.596057 16319 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:11:03.597198 16319 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:03.597265 16319 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:03.597373 16319 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:03.597420 16319 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:03.638643 16319 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:38713
I20260809 20:11:03.638718 16528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:38713 every 8 connection(s)
I20260809 20:11:03.640033 16319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:11:03.645170 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 16319
I20260809 20:11:03.645347 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance
I20260809 20:11:03.645896 15060 external_mini_cluster.cc:1428] Setting key e20332f72760d2c52a44a8f9e92c6907
Aug 09 20:11:03 dist-test-slave-6zbq krb5kdc[15922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306263, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:03.659413 16313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:03.642561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:55649 (local address 127.14.181.62:43871)
0809 20:11:03.642729 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:03.642733 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:03.643936 (+ 1203us) server_negotiation.cc:407] Connection header received
0809 20:11:03.646203 (+ 2267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:03.646210 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:03.646291 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:03.646398 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:03.648279 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:03.648982 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:03.650460 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:03.650879 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:03.650984 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:03.654255 (+ 3271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:03.654259 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:03.654263 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:03.654294 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:03.656598 (+ 2304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:03.657353 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:03.657357 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:03.657360 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:03.657486 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:03.657927 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:03.657930 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:03.657932 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:03.658169 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:03.658277 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:03.659028 (+ 751us) server_negotiation.cc:299] Negotiation successful
0809 20:11:03.659198 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 20:11:03.660625 16532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:03.643086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:43871 (local address 127.14.181.2:55649)
0809 20:11:03.643798 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:03.643832 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:03.645756 (+ 1924us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:03.646779 (+ 1023us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:03.646787 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:03.647449 (+ 662us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:03.648119 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:03.648138 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:03.649131 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:03.649135 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:03.650288 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:03.650299 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:03.651079 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:03.651087 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:03.651299 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:03.651862 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:03.651883 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:03.654041 (+ 2158us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:03.656731 (+ 2690us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:03.656739 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:03.656751 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:03.657247 (+ 496us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:03.657588 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:03.657592 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:03.657595 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:03.657823 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:03.658298 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:03.658305 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:03.658664 (+ 359us) client_negotiation.cc:769] Sending connection context
0809 20:11:03.658930 (+ 266us) client_negotiation.cc:240] Negotiation successful
0809 20:11:03.659387 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":280,"threads_started":1}
I20260809 20:11:03.662055 16529 heartbeater.cc:347] Connected to a master server at 127.14.181.62:43871
I20260809 20:11:03.662322 16529 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:03.662961 16529 heartbeater.cc:511] Master 127.14.181.62:43871 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.14.181.3@KRBTEST.COM; defaulting to no policy
I20260809 20:11:03.664242 15997 ts_manager.cc:194] Registered new tserver with Master: a243c87e5853423b8290d0b121c0d89d (127.14.181.2:38713)
I20260809 20:11:03.665060 15997 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.2@KRBTEST.COM'} at 127.14.181.2:55649
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
I20260809 20:11:03.685151 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:0
--local_ip_for_outbound_sockets=127.14.181.3
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:43871
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:03.992234 16538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:03.992519 16538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:03.992622 16538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:03.999788 16538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:03.999888 16538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:04.000010 16538 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:11:04.009552 16538 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:43871
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:04.010782 16538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:04.012053 16538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:04.024443 16543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:04.024524 16548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:04.024559 16546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:04.025309 16538 server_base.cc:1034] running on GCE node
I20260809 20:11:04.025906 16538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:04.026827 16538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:04.028023 16538 hybrid_clock.cc:648] HybridClock initialized: now 1786306264027969 us; error 42 us; skew 500 ppm
I20260809 20:11:04.028339 16538 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:04 dist-test-slave-6zbq krb5kdc[15922](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306264, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:04.031394 16538 init.cc:377] Logged in from keytab as kudu/127.14.181.3@KRBTEST.COM (short username kudu)
I20260809 20:11:04.032773 16538 webserver.cc:460] Webserver started at http://127.14.181.3:42025/ using document root <none> and password file <none>
I20260809 20:11:04.033424 16538 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:04.033540 16538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:04.033823 16538 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:04.036686 16538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-2/data/instance:
uuid: "c044d6768e7c422296e2779d8e0a8610"
format_stamp: "Formatted at 2026-08-09 20:11:04 on dist-test-slave-6zbq"
server_key: "d5ee4a0ffa95fd30979e218c1eff29c4"
server_key_iv: "16368508b7b16db59a43248270a38c74"
server_key_version: "encryptionkey@0"
I20260809 20:11:04.037484 16538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance:
uuid: "c044d6768e7c422296e2779d8e0a8610"
format_stamp: "Formatted at 2026-08-09 20:11:04 on dist-test-slave-6zbq"
server_key: "d5ee4a0ffa95fd30979e218c1eff29c4"
server_key_iv: "16368508b7b16db59a43248270a38c74"
server_key_version: "encryptionkey@0"
I20260809 20:11:04.042264 16538 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260809 20:11:04.045482 16559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:04.046746 16538 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260809 20:11:04.046895 16538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "c044d6768e7c422296e2779d8e0a8610"
format_stamp: "Formatted at 2026-08-09 20:11:04 on dist-test-slave-6zbq"
server_key: "d5ee4a0ffa95fd30979e218c1eff29c4"
server_key_iv: "16368508b7b16db59a43248270a38c74"
server_key_version: "encryptionkey@0"
I20260809 20:11:04.047066 16538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:04.059514 16538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:04.063285 16538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:04.063529 16538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:04.064356 16538 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:11:04.065519 16538 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:04.065594 16538 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:04.065699 16538 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:04.065757 16538 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:04.094820 16538 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:36971
I20260809 20:11:04.094877 16757 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:36971 every 8 connection(s)
I20260809 20:11:04.095947 16538 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:11:04.098148 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 16538
I20260809 20:11:04.098335 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance
I20260809 20:11:04.098806 15060 external_mini_cluster.cc:1428] Setting key ffc46025d0bfd71abdb40ba634d503ee
Aug 09 20:11:04 dist-test-slave-6zbq krb5kdc[15922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306264, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:04.114318 16313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:04.098262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:42177 (local address 127.14.181.62:43871)
0809 20:11:04.098511 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:04.098517 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:04.099712 (+ 1195us) server_negotiation.cc:407] Connection header received
0809 20:11:04.101911 (+ 2199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:04.101916 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:04.101982 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:04.102059 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:04.103531 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.104245 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.105629 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.106029 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.106119 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:04.109044 (+ 2925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:04.109049 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:04.109053 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:04.109083 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:04.111530 (+ 2447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:04.112252 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:04.112256 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:04.112259 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:04.112406 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:04.112794 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:04.112798 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:04.112800 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:04.113114 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:04.113234 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:04.113928 (+ 694us) server_negotiation.cc:299] Negotiation successful
0809 20:11:04.114082 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260809 20:11:04.115098 16764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:04.098745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:43871 (local address 127.14.181.3:42177)
0809 20:11:04.099528 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:04.099594 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:04.101642 (+ 2048us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:04.102232 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:04.102248 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:04.102862 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:04.103391 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:04.103409 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.104357 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.104361 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:04.105522 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:04.105534 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.106182 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.106186 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:04.106420 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:04.106936 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:04.106956 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:04.108858 (+ 1902us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:04.111652 (+ 2794us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:04.111658 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:04.111667 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:04.112136 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:04.112511 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:04.112516 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:04.112519 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:04.112693 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:04.113234 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:04.113242 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:04.113559 (+ 317us) client_negotiation.cc:769] Sending connection context
0809 20:11:04.113822 (+ 263us) client_negotiation.cc:240] Negotiation successful
0809 20:11:04.114152 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":296,"threads_started":1}
I20260809 20:11:04.116377 16758 heartbeater.cc:347] Connected to a master server at 127.14.181.62:43871
I20260809 20:11:04.116686 16758 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:04.117352 16758 heartbeater.cc:511] Master 127.14.181.62:43871 requested a full tablet report, sending...
I20260809 20:11:04.118692 15997 ts_manager.cc:194] Registered new tserver with Master: c044d6768e7c422296e2779d8e0a8610 (127.14.181.3:36971)
I20260809 20:11:04.119441 15997 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.3@KRBTEST.COM'} at 127.14.181.3:42177
I20260809 20:11:04.125479 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 20:11:04.143396 16313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:04.131916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56326 (local address 127.14.181.62:43871)
0809 20:11:04.132056 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:04.132060 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:04.132516 (+ 456us) server_negotiation.cc:407] Connection header received
0809 20:11:04.132659 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:04.132664 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:04.132727 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:04.132812 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:04.134186 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.135049 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.136288 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.136676 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.136787 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:04.138848 (+ 2061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:04.138853 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:04.138856 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:04.138883 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:04.140967 (+ 2084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:04.141577 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:04.141582 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:04.141586 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:04.141705 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:04.142041 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:04.142046 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:04.142050 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:04.142377 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:04.142608 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:04.142918 (+ 310us) server_negotiation.cc:299] Negotiation successful
0809 20:11:04.143106 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 20:11:04.151131 15997 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56326:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 20:11:04.157904 15997 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 20:11:04.186793 16779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:04.172398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:36971 (local address 127.0.0.1:48458)
0809 20:11:04.173160 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:04.173198 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:04.173437 (+ 239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:04.179963 (+ 6526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:04.179967 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:04.179992 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:04.180567 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:04.180580 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.182412 (+ 1832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.182418 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:04.184245 (+ 1827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:04.184257 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.185859 (+ 1602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.185865 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:04.186050 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:04.186099 (+ 49us) client_negotiation.cc:769] Sending connection context
0809 20:11:04.186221 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 20:11:04.186433 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"mutex_wait_us":127,"thread_start_us":355,"threads_started":1}
I20260809 20:11:04.186839 16781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:04.172586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48458 (local address 127.14.181.3:36971)
0809 20:11:04.179385 (+ 6799us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:04.179393 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:04.179424 (+ 31us) server_negotiation.cc:407] Connection header received
0809 20:11:04.179518 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:04.179525 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:04.179736 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:04.180282 (+ 546us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:04.180775 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.182212 (+ 1437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.184389 (+ 2177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.185656 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.185788 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:04.186001 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:04.186305 (+ 304us) server_negotiation.cc:299] Negotiation successful
0809 20:11:04.186480 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6638,"thread_start_us":6499,"threads_started":1}
I20260809 20:11:04.187696 16789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:04.174016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56068 (local address 127.14.181.2:38713)
0809 20:11:04.174618 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:04.174628 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:04.179837 (+ 5209us) server_negotiation.cc:407] Connection header received
0809 20:11:04.180156 (+ 319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:04.180163 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:04.180368 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:04.180627 (+ 259us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:04.181285 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.182728 (+ 1443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.185165 (+ 2437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.186459 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.186591 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:04.186761 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:04.187251 (+ 490us) server_negotiation.cc:299] Negotiation successful
0809 20:11:04.187406 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":317,"threads_started":1}
I20260809 20:11:04.187755 16787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:04.173555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:38713 (local address 127.0.0.1:56068)
0809 20:11:04.179724 (+ 6169us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:04.179749 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:04.179958 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:04.180772 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:04.180776 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:04.180800 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:04.181114 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:04.181126 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.182884 (+ 1758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.182890 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:04.185015 (+ 2125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:04.185028 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.186911 (+ 1883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.186917 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:04.187083 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:04.187110 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 20:11:04.187188 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 20:11:04.187320 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6051,"mutex_wait_us":4,"spinlock_wait_cycles":16640,"thread_start_us":5935,"threads_started":1}
I20260809 20:11:04.187816 16782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:04.173080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:35507 (local address 127.0.0.1:36670)
0809 20:11:04.179020 (+ 5940us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:04.179036 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:04.179268 (+ 232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:04.179879 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:04.179886 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:04.179936 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:04.180388 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:04.180406 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.182289 (+ 1883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.182294 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:04.184611 (+ 2317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:04.184627 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.186978 (+ 2351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.186985 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:04.187145 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:04.187175 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 20:11:04.187261 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 20:11:04.187376 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5830,"mutex_wait_us":56,"spinlock_wait_cycles":2816,"thread_start_us":5711,"threads_started":1}
I20260809 20:11:04.188489 16786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:04.173561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36670 (local address 127.14.181.1:35507)
0809 20:11:04.174086 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:04.174095 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:04.179165 (+ 5070us) server_negotiation.cc:407] Connection header received
0809 20:11:04.179443 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:04.179452 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:04.179682 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:04.179854 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:04.180567 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.182131 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.184801 (+ 2670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.186468 (+ 1667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.186613 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:04.186829 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:04.188063 (+ 1234us) server_negotiation.cc:299] Negotiation successful
0809 20:11:04.188223 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":254,"threads_started":1}
I20260809 20:11:04.191282 16640 tablet_service.cc:1467] Processing CreateTablet for tablet c7f21ca974b140898fabdc4602b65fb6 (DEFAULT_TABLE table=test-table [id=94c9e21d522e4b28be3ab47a9100dc8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:04.191496 16417 tablet_service.cc:1467] Processing CreateTablet for tablet c7f21ca974b140898fabdc4602b65fb6 (DEFAULT_TABLE table=test-table [id=94c9e21d522e4b28be3ab47a9100dc8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:04.191954 16203 tablet_service.cc:1467] Processing CreateTablet for tablet c7f21ca974b140898fabdc4602b65fb6 (DEFAULT_TABLE table=test-table [id=94c9e21d522e4b28be3ab47a9100dc8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:04.192958 16640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7f21ca974b140898fabdc4602b65fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:04.193013 16203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7f21ca974b140898fabdc4602b65fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:04.194157 16309 heartbeater.cc:503] Master 127.14.181.62:43871 was elected leader, sending a full tablet report...
I20260809 20:11:04.195350 16417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7f21ca974b140898fabdc4602b65fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:04.205449 16790 tablet_bootstrap.cc:492] T c7f21ca974b140898fabdc4602b65fb6 P c044d6768e7c422296e2779d8e0a8610: Bootstrap starting.
I20260809 20:11:04.207353 16792 tablet_bootstrap.cc:492] T c7f21ca974b140898fabdc4602b65fb6 P 5a6a2d56313641d8a72f55c655816071: Bootstrap starting.
I20260809 20:11:04.209371 16795 tablet_bootstrap.cc:492] T c7f21ca974b140898fabdc4602b65fb6 P a243c87e5853423b8290d0b121c0d89d: Bootstrap starting.
I20260809 20:11:04.210072 16790 tablet_bootstrap.cc:654] T c7f21ca974b140898fabdc4602b65fb6 P c044d6768e7c422296e2779d8e0a8610: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:04.210692 16792 tablet_bootstrap.cc:654] T c7f21ca974b140898fabdc4602b65fb6 P 5a6a2d56313641d8a72f55c655816071: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:04.211398 16790 log.cc:824] T c7f21ca974b140898fabdc4602b65fb6 P c044d6768e7c422296e2779d8e0a8610: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:04.211843 16792 log.cc:824] T c7f21ca974b140898fabdc4602b65fb6 P 5a6a2d56313641d8a72f55c655816071: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:04.212128 16795 tablet_bootstrap.cc:654] T c7f21ca974b140898fabdc4602b65fb6 P a243c87e5853423b8290d0b121c0d89d: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:04.213238 16795 log.cc:824] T c7f21ca974b140898fabdc4602b65fb6 P a243c87e5853423b8290d0b121c0d89d: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:04.214360 16790 tablet_bootstrap.cc:492] T c7f21ca974b140898fabdc4602b65fb6 P c044d6768e7c422296e2779d8e0a8610: No bootstrap required, opened a new log
I20260809 20:11:04.214573 16792 tablet_bootstrap.cc:492] T c7f21ca974b140898fabdc4602b65fb6 P 5a6a2d56313641d8a72f55c655816071: No bootstrap required, opened a new log
I20260809 20:11:04.214610 16790 ts_tablet_manager.cc:1397] T c7f21ca974b140898fabdc4602b65fb6 P c044d6768e7c422296e2779d8e0a8610: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260809 20:11:04.214845 16792 ts_tablet_manager.cc:1397] T c7f21ca974b140898fabdc4602b65fb6 P 5a6a2d56313641d8a72f55c655816071: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260809 20:11:04.216082 16795 tablet_bootstrap.cc:492] T c7f21ca974b140898fabdc4602b65fb6 P a243c87e5853423b8290d0b121c0d89d: No bootstrap required, opened a new log
I20260809 20:11:04.216337 16795 ts_tablet_manager.cc:1397] T c7f21ca974b140898fabdc4602b65fb6 P a243c87e5853423b8290d0b121c0d89d: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260809 20:11:04.222247 16790 raft_consensus.cc:348] T c7f21ca974b140898fabdc4602b65fb6 P c044d6768e7c422296e2779d8e0a8610 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c044d6768e7c422296e2779d8e0a8610" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36971 } } peers { permanent_uuid: "a243c87e5853423b8290d0b121c0d89d" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 38713 } } peers { permanent_uuid: "5a6a2d56313641d8a72f55c655816071" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35507 } }
I20260809 20:11:04.222601 16790 raft_consensus.cc:374] T c7f21ca974b140898fabdc4602b65fb6 P c044d6768e7c422296e2779d8e0a8610 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:04.222697 16790 raft_consensus.cc:729] T c7f21ca974b140898fabdc4602b65fb6 P c044d6768e7c422296e2779d8e0a8610 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c044d6768e7c422296e2779d8e0a8610, State: Initialized, Role: FOLLOWER
I20260809 20:11:04.223227 16790 consensus_queue.cc:260] T c7f21ca974b140898fabdc4602b65fb6 P c044d6768e7c422296e2779d8e0a8610 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c044d6768e7c422296e2779d8e0a8610" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36971 } } peers { permanent_uuid: "a243c87e5853423b8290d0b121c0d89d" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 38713 } } peers { permanent_uuid: "5a6a2d56313641d8a72f55c655816071" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35507 } }
I20260809 20:11:04.224304 16758 heartbeater.cc:503] Master 127.14.181.62:43871 was elected leader, sending a full tablet report...
I20260809 20:11:04.224831 16790 ts_tablet_manager.cc:1428] T c7f21ca974b140898fabdc4602b65fb6 P c044d6768e7c422296e2779d8e0a8610: Time spent starting tablet: real 0.010s user 0.009s sys 0.000s
I20260809 20:11:04.224834 16792 raft_consensus.cc:348] T c7f21ca974b140898fabdc4602b65fb6 P 5a6a2d56313641d8a72f55c655816071 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c044d6768e7c422296e2779d8e0a8610" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36971 } } peers { permanent_uuid: "a243c87e5853423b8290d0b121c0d89d" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 38713 } } peers { permanent_uuid: "5a6a2d56313641d8a72f55c655816071" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35507 } }
I20260809 20:11:04.225216 16792 raft_consensus.cc:374] T c7f21ca974b140898fabdc4602b65fb6 P 5a6a2d56313641d8a72f55c655816071 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:04.225311 16792 raft_consensus.cc:729] T c7f21ca974b140898fabdc4602b65fb6 P 5a6a2d56313641d8a72f55c655816071 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a6a2d56313641d8a72f55c655816071, State: Initialized, Role: FOLLOWER
I20260809 20:11:04.225853 16792 consensus_queue.cc:260] T c7f21ca974b140898fabdc4602b65fb6 P 5a6a2d56313641d8a72f55c655816071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c044d6768e7c422296e2779d8e0a8610" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36971 } } peers { permanent_uuid: "a243c87e5853423b8290d0b121c0d89d" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 38713 } } peers { permanent_uuid: "5a6a2d56313641d8a72f55c655816071" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35507 } }
I20260809 20:11:04.226143 16795 raft_consensus.cc:348] T c7f21ca974b140898fabdc4602b65fb6 P a243c87e5853423b8290d0b121c0d89d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c044d6768e7c422296e2779d8e0a8610" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36971 } } peers { permanent_uuid: "a243c87e5853423b8290d0b121c0d89d" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 38713 } } peers { permanent_uuid: "5a6a2d56313641d8a72f55c655816071" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35507 } }
I20260809 20:11:04.226625 16795 raft_consensus.cc:374] T c7f21ca974b140898fabdc4602b65fb6 P a243c87e5853423b8290d0b121c0d89d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:04.226737 16795 raft_consensus.cc:729] T c7f21ca974b140898fabdc4602b65fb6 P a243c87e5853423b8290d0b121c0d89d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a243c87e5853423b8290d0b121c0d89d, State: Initialized, Role: FOLLOWER
I20260809 20:11:04.227413 16795 consensus_queue.cc:260] T c7f21ca974b140898fabdc4602b65fb6 P a243c87e5853423b8290d0b121c0d89d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c044d6768e7c422296e2779d8e0a8610" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36971 } } peers { permanent_uuid: "a243c87e5853423b8290d0b121c0d89d" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 38713 } } peers { permanent_uuid: "5a6a2d56313641d8a72f55c655816071" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35507 } }
I20260809 20:11:04.228621 16529 heartbeater.cc:503] Master 127.14.181.62:43871 was elected leader, sending a full tablet report...
I20260809 20:11:04.229182 16795 ts_tablet_manager.cc:1428] T c7f21ca974b140898fabdc4602b65fb6 P a243c87e5853423b8290d0b121c0d89d: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260809 20:11:04.231142 16792 ts_tablet_manager.cc:1428] T c7f21ca974b140898fabdc4602b65fb6 P 5a6a2d56313641d8a72f55c655816071: Time spent starting tablet: real 0.016s user 0.016s sys 0.000s
W20260809 20:11:04.347486 16761 tablet.cc:2369] T c7f21ca974b140898fabdc4602b65fb6 P c044d6768e7c422296e2779d8e0a8610: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 20:11:04.391999 16530 tablet.cc:2369] T c7f21ca974b140898fabdc4602b65fb6 P a243c87e5853423b8290d0b121c0d89d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:11:04.405968 16801 raft_consensus.cc:482] T c7f21ca974b140898fabdc4602b65fb6 P c044d6768e7c422296e2779d8e0a8610 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:11:04.406260 16801 raft_consensus.cc:504] T c7f21ca974b140898fabdc4602b65fb6 P c044d6768e7c422296e2779d8e0a8610 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c044d6768e7c422296e2779d8e0a8610" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36971 } } peers { permanent_uuid: "a243c87e5853423b8290d0b121c0d89d" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 38713 } } peers { permanent_uuid: "5a6a2d56313641d8a72f55c655816071" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35507 } }
I20260809 20:11:04.408355 16801 leader_election.cc:288] T c7f21ca974b140898fabdc4602b65fb6 P c044d6768e7c422296e2779d8e0a8610 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a243c87e5853423b8290d0b121c0d89d (127.14.181.2:38713), 5a6a2d56313641d8a72f55c655816071 (127.14.181.1:35507)
I20260809 20:11:04.410288 16804 raft_consensus.cc:482] T c7f21ca974b140898fabdc4602b65fb6 P a243c87e5853423b8290d0b121c0d89d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:11:04.410609 16804 raft_consensus.cc:504] T c7f21ca974b140898fabdc4602b65fb6 P a243c87e5853423b8290d0b121c0d89d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c044d6768e7c422296e2779d8e0a8610" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36971 } } peers { permanent_uuid: "a243c87e5853423b8290d0b121c0d89d" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 38713 } } peers { permanent_uuid: "5a6a2d56313641d8a72f55c655816071" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35507 } }
I20260809 20:11:04.412356 16804 leader_election.cc:288] T c7f21ca974b140898fabdc4602b65fb6 P a243c87e5853423b8290d0b121c0d89d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c044d6768e7c422296e2779d8e0a8610 (127.14.181.3:36971), 5a6a2d56313641d8a72f55c655816071 (127.14.181.1:35507)
I20260809 20:11:04.417057 16786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:04.408916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:53177 (local address 127.14.181.1:35507)
0809 20:11:04.409143 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:04.409149 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:04.409691 (+ 542us) server_negotiation.cc:407] Connection header received
0809 20:11:04.409815 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:04.409820 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:04.409893 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:04.409973 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:04.410576 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.411430 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.414716 (+ 3286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.415975 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.416127 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:04.416192 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:04.416681 (+ 489us) server_negotiation.cc:299] Negotiation successful
0809 20:11:04.416810 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 20:11:04.417152 16789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:04.408655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:42777 (local address 127.14.181.2:38713)
0809 20:11:04.408851 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:04.408857 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:04.409093 (+ 236us) server_negotiation.cc:407] Connection header received
0809 20:11:04.409295 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:04.409299 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:04.409361 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:04.409435 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:04.409861 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.410977 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.414134 (+ 3157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.415589 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.415730 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:04.415814 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:04.416707 (+ 893us) server_negotiation.cc:299] Negotiation successful
0809 20:11:04.416853 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260809 20:11:04.417659 16311 tablet.cc:2369] T c7f21ca974b140898fabdc4602b65fb6 P 5a6a2d56313641d8a72f55c655816071: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:11:04.418751 16764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:04.408631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:38713 (local address 127.14.181.3:42777)
0809 20:11:04.408974 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:04.409000 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:04.409134 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:04.409484 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:04.409489 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:04.409516 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:04.409716 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:04.409729 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.411138 (+ 1409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.411143 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:04.413784 (+ 2641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:04.413798 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.415909 (+ 2111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.415916 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:04.416204 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:04.416239 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 20:11:04.416342 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 20:11:04.416486 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"mutex_wait_us":732}
I20260809 20:11:04.419886 16807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:04.408784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:35507 (local address 127.14.181.3:53177)
0809 20:11:04.409592 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:04.409606 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:04.409713 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:04.409991 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:04.409995 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:04.410018 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:04.410386 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:04.410399 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.411570 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.411574 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:04.414540 (+ 2966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:04.414555 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.416331 (+ 1776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.416338 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:04.416503 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:04.416534 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 20:11:04.418468 (+ 1934us) client_negotiation.cc:240] Negotiation successful
0809 20:11:04.418598 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":701,"mutex_wait_us":1182,"thread_start_us":493,"threads_started":1}
I20260809 20:11:04.419787 16458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7f21ca974b140898fabdc4602b65fb6" candidate_uuid: "c044d6768e7c422296e2779d8e0a8610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a243c87e5853423b8290d0b121c0d89d" is_pre_election: true
I20260809 20:11:04.420584 16458 raft_consensus.cc:2454] T c7f21ca974b140898fabdc4602b65fb6 P a243c87e5853423b8290d0b121c0d89d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c044d6768e7c422296e2779d8e0a8610 in term 0.
I20260809 20:11:04.421476 16781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:04.412746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:55499 (local address 127.14.181.3:36971)
0809 20:11:04.413085 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:04.413090 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:04.413592 (+ 502us) server_negotiation.cc:407] Connection header received
0809 20:11:04.413854 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:04.413860 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:04.413926 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:04.413983 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:04.415268 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.416296 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.419105 (+ 2809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.420359 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.420464 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:04.420528 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:04.421131 (+ 603us) server_negotiation.cc:299] Negotiation successful
0809 20:11:04.421251 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206}
I20260809 20:11:04.421597 16562 leader_election.cc:302] T c7f21ca974b140898fabdc4602b65fb6 P c044d6768e7c422296e2779d8e0a8610 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a243c87e5853423b8290d0b121c0d89d, c044d6768e7c422296e2779d8e0a8610; no voters:
I20260809 20:11:04.422022 16801 raft_consensus.cc:2781] T c7f21ca974b140898fabdc4602b65fb6 P c044d6768e7c422296e2779d8e0a8610 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:11:04.422152 16808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:04.412686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:36971 (local address 127.14.181.2:55499)
0809 20:11:04.413496 (+ 810us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:04.413513 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:04.413691 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:04.414571 (+ 880us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:04.414575 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:04.414620 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:04.415041 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:04.415053 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.416886 (+ 1833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.416891 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:04.418928 (+ 2037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:04.418943 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.420761 (+ 1818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.420767 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:04.420923 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:04.420960 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 20:11:04.421694 (+ 734us) client_negotiation.cc:240] Negotiation successful
0809 20:11:04.421817 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":699,"thread_start_us":786,"threads_started":1}
I20260809 20:11:04.422165 16801 raft_consensus.cc:482] T c7f21ca974b140898fabdc4602b65fb6 P c044d6768e7c422296e2779d8e0a8610 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:11:04.422257 16801 raft_consensus.cc:3037] T c7f21ca974b140898fabdc4602b65fb6 P c044d6768e7c422296e2779d8e0a8610 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:04.423280 16238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7f21ca974b140898fabdc4602b65fb6" candidate_uuid: "c044d6768e7c422296e2779d8e0a8610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a6a2d56313641d8a72f55c655816071" is_pre_election: true
I20260809 20:11:04.423420 16677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7f21ca974b140898fabdc4602b65fb6" candidate_uuid: "a243c87e5853423b8290d0b121c0d89d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c044d6768e7c422296e2779d8e0a8610" is_pre_election: true
I20260809 20:11:04.423806 16238 raft_consensus.cc:2454] T c7f21ca974b140898fabdc4602b65fb6 P 5a6a2d56313641d8a72f55c655816071 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c044d6768e7c422296e2779d8e0a8610 in term 0.
I20260809 20:11:04.425225 16801 raft_consensus.cc:504] T c7f21ca974b140898fabdc4602b65fb6 P c044d6768e7c422296e2779d8e0a8610 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c044d6768e7c422296e2779d8e0a8610" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36971 } } peers { permanent_uuid: "a243c87e5853423b8290d0b121c0d89d" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 38713 } } peers { permanent_uuid: "5a6a2d56313641d8a72f55c655816071" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35507 } }
I20260809 20:11:04.425668 16786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:04.413210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:45853 (local address 127.14.181.1:35507)
0809 20:11:04.417504 (+ 4294us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:04.417510 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:04.417526 (+ 16us) server_negotiation.cc:407] Connection header received
0809 20:11:04.417579 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:04.417583 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:04.417647 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:04.417730 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:04.418991 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.420333 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.423641 (+ 3308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.424827 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.424948 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:04.425000 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:04.425339 (+ 339us) server_negotiation.cc:299] Negotiation successful
0809 20:11:04.425417 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4204,"thread_start_us":9185,"threads_started":1}
I20260809 20:11:04.425706 16809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:04.412899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:35507 (local address 127.14.181.2:45853)
0809 20:11:04.416670 (+ 3771us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:04.416687 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:04.416782 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:04.417944 (+ 1162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:04.417948 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:04.417972 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:04.418303 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:04.418313 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.420508 (+ 2195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.420513 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:04.423006 (+ 2493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:04.423020 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.425023 (+ 2003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.425030 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:04.425187 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:04.425221 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 20:11:04.425310 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 20:11:04.425428 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3635,"thread_start_us":1354,"threads_started":1}
I20260809 20:11:04.425884 16677 raft_consensus.cc:2379] T c7f21ca974b140898fabdc4602b65fb6 P c044d6768e7c422296e2779d8e0a8610 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a243c87e5853423b8290d0b121c0d89d in current term 1: Already voted for candidate c044d6768e7c422296e2779d8e0a8610 in this term.
I20260809 20:11:04.426232 16801 leader_election.cc:288] T c7f21ca974b140898fabdc4602b65fb6 P c044d6768e7c422296e2779d8e0a8610 [CANDIDATE]: Term 1 election: Requested vote from peers a243c87e5853423b8290d0b121c0d89d (127.14.181.2:38713), 5a6a2d56313641d8a72f55c655816071 (127.14.181.1:35507)
I20260809 20:11:04.426247 16458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7f21ca974b140898fabdc4602b65fb6" candidate_uuid: "c044d6768e7c422296e2779d8e0a8610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a243c87e5853423b8290d0b121c0d89d"
I20260809 20:11:04.426311 16238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7f21ca974b140898fabdc4602b65fb6" candidate_uuid: "a243c87e5853423b8290d0b121c0d89d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a6a2d56313641d8a72f55c655816071" is_pre_election: true
I20260809 20:11:04.426441 16458 raft_consensus.cc:3037] T c7f21ca974b140898fabdc4602b65fb6 P a243c87e5853423b8290d0b121c0d89d [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:04.426524 16238 raft_consensus.cc:2454] T c7f21ca974b140898fabdc4602b65fb6 P 5a6a2d56313641d8a72f55c655816071 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a243c87e5853423b8290d0b121c0d89d in term 0.
I20260809 20:11:04.426942 16347 leader_election.cc:302] T c7f21ca974b140898fabdc4602b65fb6 P a243c87e5853423b8290d0b121c0d89d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a6a2d56313641d8a72f55c655816071, a243c87e5853423b8290d0b121c0d89d; no voters:
I20260809 20:11:04.427124 16238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7f21ca974b140898fabdc4602b65fb6" candidate_uuid: "c044d6768e7c422296e2779d8e0a8610" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a6a2d56313641d8a72f55c655816071"
I20260809 20:11:04.427309 16238 raft_consensus.cc:3037] T c7f21ca974b140898fabdc4602b65fb6 P 5a6a2d56313641d8a72f55c655816071 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:04.429144 16458 raft_consensus.cc:2454] T c7f21ca974b140898fabdc4602b65fb6 P a243c87e5853423b8290d0b121c0d89d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c044d6768e7c422296e2779d8e0a8610 in term 1.
I20260809 20:11:04.429324 16804 raft_consensus.cc:2741] T c7f21ca974b140898fabdc4602b65fb6 P a243c87e5853423b8290d0b121c0d89d [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260809 20:11:04.429490 16562 leader_election.cc:302] T c7f21ca974b140898fabdc4602b65fb6 P c044d6768e7c422296e2779d8e0a8610 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a243c87e5853423b8290d0b121c0d89d, c044d6768e7c422296e2779d8e0a8610; no voters:
I20260809 20:11:04.429546 16238 raft_consensus.cc:2454] T c7f21ca974b140898fabdc4602b65fb6 P 5a6a2d56313641d8a72f55c655816071 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c044d6768e7c422296e2779d8e0a8610 in term 1.
I20260809 20:11:04.429740 16801 raft_consensus.cc:2781] T c7f21ca974b140898fabdc4602b65fb6 P c044d6768e7c422296e2779d8e0a8610 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:04.430229 16801 raft_consensus.cc:686] T c7f21ca974b140898fabdc4602b65fb6 P c044d6768e7c422296e2779d8e0a8610 [term 1 LEADER]: Becoming Leader. State: Replica: c044d6768e7c422296e2779d8e0a8610, State: Running, Role: LEADER
I20260809 20:11:04.430676 16801 consensus_queue.cc:237] T c7f21ca974b140898fabdc4602b65fb6 P c044d6768e7c422296e2779d8e0a8610 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c044d6768e7c422296e2779d8e0a8610" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36971 } } peers { permanent_uuid: "a243c87e5853423b8290d0b121c0d89d" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 38713 } } peers { permanent_uuid: "5a6a2d56313641d8a72f55c655816071" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35507 } }
I20260809 20:11:04.435091 15993 catalog_manager.cc:5495] T c7f21ca974b140898fabdc4602b65fb6 P c044d6768e7c422296e2779d8e0a8610 reported cstate change: term changed from 0 to 1, leader changed from <none> to c044d6768e7c422296e2779d8e0a8610 (127.14.181.3). New cstate: current_term: 1 leader_uuid: "c044d6768e7c422296e2779d8e0a8610" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c044d6768e7c422296e2779d8e0a8610" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a243c87e5853423b8290d0b121c0d89d" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 38713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a6a2d56313641d8a72f55c655816071" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35507 } health_report { overall_health: UNKNOWN } } }
Aug 09 20:11:04 dist-test-slave-6zbq krb5kdc[15922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.1@KRBTEST.COM
I20260809 20:11:04.485903 16786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:04.472901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36684 (local address 127.14.181.1:35507)
0809 20:11:04.473093 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:04.473109 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:04.473496 (+ 387us) server_negotiation.cc:407] Connection header received
0809 20:11:04.473644 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:04.473648 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:04.473724 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:04.473803 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:04.475199 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.475899 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.477046 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.477453 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.477541 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:04.481061 (+ 3520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:04.481074 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:04.481111 (+ 37us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:04.481141 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:04.483768 (+ 2627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:04.484286 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:04.484291 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:04.484294 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:04.484406 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:04.484661 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:04.484664 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:04.484666 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:04.484993 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:04.485215 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:04.485389 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 20:11:04.485537 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
Aug 09 20:11:04 dist-test-slave-6zbq krb5kdc[15922](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306264, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 20:11:04 dist-test-slave-6zbq krb5kdc[15922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306264, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.181.1@KRBTEST.COM
I20260809 20:11:04.530615 16786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:04.517838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36692 (local address 127.14.181.1:35507)
0809 20:11:04.517981 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:04.517986 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:04.518631 (+ 645us) server_negotiation.cc:407] Connection header received
0809 20:11:04.518781 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:04.518786 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:04.518848 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:04.518929 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:04.520193 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.520908 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.522160 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.522609 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.522712 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:04.526199 (+ 3487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:04.526203 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:04.526207 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:04.526238 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:04.528657 (+ 2419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:04.529171 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:04.529174 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:04.529177 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:04.529289 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:04.529559 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:04.529562 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:04.529564 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:04.529824 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:04.530003 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:04.530167 (+ 164us) server_negotiation.cc:299] Negotiation successful
0809 20:11:04.530312 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
Aug 09 20:11:04 dist-test-slave-6zbq krb5kdc[15922](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306264, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 20:11:04 dist-test-slave-6zbq krb5kdc[15922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306264, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.1@KRBTEST.COM
I20260809 20:11:04.570892 16786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:04.558481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36696 (local address 127.14.181.1:35507)
0809 20:11:04.558657 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:04.558662 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:04.558992 (+ 330us) server_negotiation.cc:407] Connection header received
0809 20:11:04.559155 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:04.559161 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:04.559221 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:04.559300 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:04.560575 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.561274 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.562486 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.562911 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.563017 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:04.566518 (+ 3501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:04.566523 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:04.566526 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:04.566556 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:04.568895 (+ 2339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:04.569414 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:04.569418 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:04.569420 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:04.569530 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:04.569791 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:04.569794 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:04.569796 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:04.570048 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:04.570234 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:04.570443 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 20:11:04.570621 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260809 20:11:04.573210 16165 tablet_service.cc:2908] Rejecting scan request for tablet c7f21ca974b140898fabdc4602b65fb6: Uninitialized: clean time has not yet been initialized
I20260809 20:11:04.576853 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 16094
I20260809 20:11:04.588496 16786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:04.577874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36712 (local address 127.14.181.1:35507)
0809 20:11:04.578048 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:04.578054 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:04.578126 (+ 72us) server_negotiation.cc:407] Connection header received
0809 20:11:04.578299 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:04.578302 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:04.578377 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:04.578453 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:04.579534 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.580290 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.581450 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.582026 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.582132 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:04.584131 (+ 1999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:04.584136 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:04.584139 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:04.584166 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:04.586194 (+ 2028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:04.586822 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:04.586827 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:04.586831 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:04.586943 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:04.587265 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:04.587270 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:04.587274 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:04.587510 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:04.587747 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:04.588019 (+ 272us) server_negotiation.cc:299] Negotiation successful
0809 20:11:04.588202 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 20:11:04.589066 16296 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:04.690131 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 16094
I20260809 20:11:04.708207 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 16319
Aug 09 20:11:04 dist-test-slave-6zbq krb5kdc[15922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306264, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.2@KRBTEST.COM
I20260809 20:11:04.721356 16789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:04.708877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56070 (local address 127.14.181.2:38713)
0809 20:11:04.709060 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:04.709065 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:04.709100 (+ 35us) server_negotiation.cc:407] Connection header received
0809 20:11:04.709211 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:04.709214 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:04.709287 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:04.709366 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:04.710472 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.711225 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.712414 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.712812 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.712931 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:04.716715 (+ 3784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:04.716727 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:04.716741 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:04.716777 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:04.719212 (+ 2435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:04.719784 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:04.719789 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:04.719792 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:04.719902 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:04.720179 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:04.720192 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:04.720194 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:04.720528 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:04.720738 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:04.720939 (+ 201us) server_negotiation.cc:299] Negotiation successful
0809 20:11:04.721104 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 20:11:04.722009 16522 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:04.808265 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 16319
I20260809 20:11:04.828518 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 16538
Aug 09 20:11:04 dist-test-slave-6zbq krb5kdc[15922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306264, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.3@KRBTEST.COM
I20260809 20:11:04.841583 16781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:04.829153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48468 (local address 127.14.181.3:36971)
0809 20:11:04.829302 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:04.829307 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:04.829324 (+ 17us) server_negotiation.cc:407] Connection header received
0809 20:11:04.829475 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:04.829479 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:04.829541 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:04.829630 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:04.830832 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.831567 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.832738 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:04.833115 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:04.833203 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:04.837034 (+ 3831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:04.837048 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:04.837065 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:04.837099 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:04.839490 (+ 2391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:04.840042 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:04.840049 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:04.840052 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:04.840186 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:04.840453 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:04.840456 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:04.840458 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:04.840793 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:04.841007 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:04.841187 (+ 180us) server_negotiation.cc:299] Negotiation successful
0809 20:11:04.841338 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 20:11:04.842161 16751 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:04.927490 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 16538
I20260809 20:11:04.949517 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 15944
I20260809 20:11:04.950567 16044 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:05.054469 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 15944
2026-08-09T20:11:05Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4138 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:11:05 dist-test-slave-6zbq krb5kdc[16841](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:11:05 dist-test-slave-6zbq krb5kdc[16841](info): set up 2 sockets
Aug 09 20:11:05 dist-test-slave-6zbq krb5kdc[16841](info): commencing operation
krb5kdc: starting...
W20260809 20:11:06.242278 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.141s user 0.004s sys 0.011s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:11:06 dist-test-slave-6zbq krb5kdc[16841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306266, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:11:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:11:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:11:06.403452 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:33119
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:37201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:33119
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:06.702853 16858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:06.703081 16858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:06.703178 16858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:06.709856 16858 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:11:06.709936 16858 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 20:11:06.709983 16858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:06.710040 16858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:06.710086 16858 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:11:06.710168 16858 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:11:06.719138 16858 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:37201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:33119
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:33119
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:06.720070 16858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:06.721246 16858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:06.731779 16870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:06.731841 16865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:06.732050 16864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:06.732597 16858 server_base.cc:1034] running on GCE node
I20260809 20:11:06.733247 16858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:06.734438 16858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:06.735657 16858 hybrid_clock.cc:648] HybridClock initialized: now 1786306266735602 us; error 24 us; skew 500 ppm
I20260809 20:11:06.735920 16858 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:06 dist-test-slave-6zbq krb5kdc[16841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306266, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:06.738677 16858 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:11:06.739928 16858 webserver.cc:460] Webserver started at http://127.14.181.62:35473/ using document root <none> and password file <none>
I20260809 20:11:06.740521 16858 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:06.740600 16858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:06.740845 16858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:06.743527 16858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "2dcaa14b9e6b4454853956902ebed12b"
format_stamp: "Formatted at 2026-08-09 20:11:06 on dist-test-slave-6zbq"
server_key: "5210aa4f4fb1fa47b4fb1e905a6c90da"
server_key_iv: "b929ba11da68fc8c0179b7d2182c40df"
server_key_version: "encryptionkey@0"
I20260809 20:11:06.744199 16858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "2dcaa14b9e6b4454853956902ebed12b"
format_stamp: "Formatted at 2026-08-09 20:11:06 on dist-test-slave-6zbq"
server_key: "5210aa4f4fb1fa47b4fb1e905a6c90da"
server_key_iv: "b929ba11da68fc8c0179b7d2182c40df"
server_key_version: "encryptionkey@0"
I20260809 20:11:06.748701 16858 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 20:11:06.751747 16881 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:06.752871 16858 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 20:11:06.752993 16858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "2dcaa14b9e6b4454853956902ebed12b"
format_stamp: "Formatted at 2026-08-09 20:11:06 on dist-test-slave-6zbq"
server_key: "5210aa4f4fb1fa47b4fb1e905a6c90da"
server_key_iv: "b929ba11da68fc8c0179b7d2182c40df"
server_key_version: "encryptionkey@0"
I20260809 20:11:06.753166 16858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:06.781237 16858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:06.784603 16858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:06.784799 16858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:06.804020 16858 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:33119
I20260809 20:11:06.804039 16989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:33119 every 8 connection(s)
I20260809 20:11:06.805181 16858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:11:06.808559 16991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:06.815145 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 16858
I20260809 20:11:06.815376 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:11:06.816172 15060 external_mini_cluster.cc:1428] Setting key 783a8065659bd06d9ed134ba7046baf0
I20260809 20:11:06.818925 16991 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2dcaa14b9e6b4454853956902ebed12b: Bootstrap starting.
I20260809 20:11:06.822023 16991 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2dcaa14b9e6b4454853956902ebed12b: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:06.823169 16991 log.cc:824] T 00000000000000000000000000000000 P 2dcaa14b9e6b4454853956902ebed12b: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:06.826035 16991 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2dcaa14b9e6b4454853956902ebed12b: No bootstrap required, opened a new log
Aug 09 20:11:06 dist-test-slave-6zbq krb5kdc[16841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306266, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:06.835347 16991 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2dcaa14b9e6b4454853956902ebed12b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dcaa14b9e6b4454853956902ebed12b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33119 } }
I20260809 20:11:06.835683 16991 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2dcaa14b9e6b4454853956902ebed12b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:06.835794 16991 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2dcaa14b9e6b4454853956902ebed12b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dcaa14b9e6b4454853956902ebed12b, State: Initialized, Role: FOLLOWER
I20260809 20:11:06.836366 16991 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2dcaa14b9e6b4454853956902ebed12b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dcaa14b9e6b4454853956902ebed12b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33119 } }
I20260809 20:11:06.836643 16991 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2dcaa14b9e6b4454853956902ebed12b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:11:06.836787 16991 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2dcaa14b9e6b4454853956902ebed12b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:11:06.836964 16991 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2dcaa14b9e6b4454853956902ebed12b [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:06.839213 16996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:06.818019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45810 (local address 127.14.181.62:33119)
0809 20:11:06.818720 (+ 701us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:06.818730 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:06.818768 (+ 38us) server_negotiation.cc:407] Connection header received
0809 20:11:06.820402 (+ 1634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:06.820423 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:06.820746 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:06.821016 (+ 270us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:06.822710 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:06.824331 (+ 1621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:06.825969 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:06.826683 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:06.826804 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:06.831182 (+ 4378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:06.831193 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:06.831211 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:06.831255 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:06.835015 (+ 3760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:06.835663 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:06.835675 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:06.835683 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:06.835894 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:06.836286 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:06.836291 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:06.836295 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:06.836995 (+ 700us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:06.837269 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:06.837921 (+ 652us) server_negotiation.cc:299] Negotiation successful
0809 20:11:06.838279 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":331,"threads_started":1}
I20260809 20:11:06.839454 16991 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2dcaa14b9e6b4454853956902ebed12b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dcaa14b9e6b4454853956902ebed12b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33119 } }
I20260809 20:11:06.839905 16991 leader_election.cc:302] T 00000000000000000000000000000000 P 2dcaa14b9e6b4454853956902ebed12b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2dcaa14b9e6b4454853956902ebed12b; no voters:
I20260809 20:11:06.840519 16991 leader_election.cc:288] T 00000000000000000000000000000000 P 2dcaa14b9e6b4454853956902ebed12b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:11:06.840624 16998 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2dcaa14b9e6b4454853956902ebed12b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:06.841928 16998 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2dcaa14b9e6b4454853956902ebed12b [term 1 LEADER]: Becoming Leader. State: Replica: 2dcaa14b9e6b4454853956902ebed12b, State: Running, Role: LEADER
I20260809 20:11:06.842612 16991 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2dcaa14b9e6b4454853956902ebed12b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:11:06.842514 16998 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2dcaa14b9e6b4454853956902ebed12b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dcaa14b9e6b4454853956902ebed12b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33119 } }
I20260809 20:11:06.847827 16999 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2dcaa14b9e6b4454853956902ebed12b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2dcaa14b9e6b4454853956902ebed12b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dcaa14b9e6b4454853956902ebed12b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33119 } } }
I20260809 20:11:06.847898 17000 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2dcaa14b9e6b4454853956902ebed12b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2dcaa14b9e6b4454853956902ebed12b. Latest consensus state: current_term: 1 leader_uuid: "2dcaa14b9e6b4454853956902ebed12b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2dcaa14b9e6b4454853956902ebed12b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33119 } } }
I20260809 20:11:06.848218 16999 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2dcaa14b9e6b4454853956902ebed12b [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:06.848220 17000 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2dcaa14b9e6b4454853956902ebed12b [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:06.849071 17022 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:11:06.854245 17022 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:11:06.862361 17022 catalog_manager.cc:1347] Generated new cluster ID: 2ce259cebed049beaa5b238fa0d1d7af
I20260809 20:11:06.862473 17022 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:11:06.889045 17022 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:11:06.890249 17022 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:11:06.899856 17022 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2dcaa14b9e6b4454853956902ebed12b: Generated new TSK 0
I20260809 20:11:06.900517 17022 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.181.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
I20260809 20:11:06.957523 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:0
--local_ip_for_outbound_sockets=127.14.181.1
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:33119
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:37201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:07.265383 17037 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:07.265622 17037 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:07.265723 17037 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:07.272636 17037 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:07.272727 17037 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:07.272817 17037 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 20:11:07.272893 17037 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:11:07.281919 17037 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:37201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.181.62:33119
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:07.282972 17037 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:07.284132 17037 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:07.295925 17045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:07.295847 17048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:07.295893 17046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:07.296775 17037 server_base.cc:1034] running on GCE node
I20260809 20:11:07.297291 17037 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:07.298105 17037 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:07.299306 17037 hybrid_clock.cc:648] HybridClock initialized: now 1786306267299246 us; error 32 us; skew 500 ppm
I20260809 20:11:07.299571 17037 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:07 dist-test-slave-6zbq krb5kdc[16841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306267, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:07.302490 17037 init.cc:377] Logged in from keytab as kudu/127.14.181.1@KRBTEST.COM (short username kudu)
I20260809 20:11:07.303709 17037 webserver.cc:460] Webserver started at http://127.14.181.1:36413/ using document root <none> and password file <none>
I20260809 20:11:07.304308 17037 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:07.304404 17037 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:07.304692 17037 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:07.307324 17037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-0/data/instance:
uuid: "b01671cb66cd450888dd319256d9ac30"
format_stamp: "Formatted at 2026-08-09 20:11:07 on dist-test-slave-6zbq"
server_key: "1cdf65f5d2afc266f022b4083165b166"
server_key_iv: "d9ae07103a3449b9fc509e06f2db22ce"
server_key_version: "encryptionkey@0"
I20260809 20:11:07.308056 17037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance:
uuid: "b01671cb66cd450888dd319256d9ac30"
format_stamp: "Formatted at 2026-08-09 20:11:07 on dist-test-slave-6zbq"
server_key: "1cdf65f5d2afc266f022b4083165b166"
server_key_iv: "d9ae07103a3449b9fc509e06f2db22ce"
server_key_version: "encryptionkey@0"
I20260809 20:11:07.312668 17037 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 20:11:07.315737 17056 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:07.316875 17037 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 20:11:07.317009 17037 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "b01671cb66cd450888dd319256d9ac30"
format_stamp: "Formatted at 2026-08-09 20:11:07 on dist-test-slave-6zbq"
server_key: "1cdf65f5d2afc266f022b4083165b166"
server_key_iv: "d9ae07103a3449b9fc509e06f2db22ce"
server_key_version: "encryptionkey@0"
I20260809 20:11:07.317186 17037 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:07.339419 17037 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:07.343349 17037 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:07.343577 17037 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:07.346138 17037 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:07.346225 17037 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:07.346375 17037 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:07.346443 17037 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 09 20:11:07 dist-test-slave-6zbq krb5kdc[16841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306267, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:07.369429 17071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:07.346733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:51259 (local address 127.14.181.62:33119)
0809 20:11:07.352838 (+ 6105us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:07.352843 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:07.352860 (+ 17us) server_negotiation.cc:407] Connection header received
0809 20:11:07.352913 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:07.352916 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:07.352981 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:07.353069 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:07.355409 (+ 2340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:07.356399 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:07.358760 (+ 2361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:07.359253 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:07.359375 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:07.363708 (+ 4333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:07.363715 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:07.363720 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:07.363761 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:07.366657 (+ 2896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:07.367315 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:07.367319 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:07.367321 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:07.367432 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:07.367847 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:07.367851 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:07.367853 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:07.368106 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:07.368236 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:07.368873 (+ 637us) server_negotiation.cc:299] Negotiation successful
0809 20:11:07.369077 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5997,"thread_start_us":5909,"threads_started":1}
I20260809 20:11:07.370481 17073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:07.347356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:33119 (local address 127.14.181.1:51259)
0809 20:11:07.348288 (+ 932us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:07.348344 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:07.350806 (+ 2462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:07.353349 (+ 2543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:07.353362 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:07.354171 (+ 809us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:07.355152 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:07.355181 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:07.356577 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:07.356583 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:07.358620 (+ 2037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:07.358634 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:07.359665 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:07.359672 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:07.359936 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:07.360555 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:07.360583 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:07.363431 (+ 2848us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:07.366787 (+ 3356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:07.366796 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:07.366809 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:07.367184 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:07.367532 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:07.367537 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:07.367541 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:07.367732 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:07.368244 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:07.368251 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:07.368539 (+ 288us) client_negotiation.cc:769] Sending connection context
0809 20:11:07.368756 (+ 217us) client_negotiation.cc:240] Negotiation successful
0809 20:11:07.369212 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"thread_start_us":375,"threads_started":1}
I20260809 20:11:07.388250 17249 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:34635 every 8 connection(s)
I20260809 20:11:07.388276 17037 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:34635
I20260809 20:11:07.389621 17037 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:11:07.391752 17071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:07.376649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:59295 (local address 127.14.181.62:33119)
0809 20:11:07.377237 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:07.377242 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:07.377593 (+ 351us) server_negotiation.cc:407] Connection header received
0809 20:11:07.377726 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:07.377731 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:07.377807 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:07.377899 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:07.379530 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:07.380539 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:07.382410 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:07.383060 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:07.383184 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:07.385488 (+ 2304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:07.385496 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:07.385501 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:07.385535 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:07.388589 (+ 3054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:07.389171 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:07.389176 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:07.389180 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:07.389332 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:07.389652 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:07.389657 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:07.389660 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:07.390005 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:07.390160 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:07.390652 (+ 492us) server_negotiation.cc:299] Negotiation successful
0809 20:11:07.390891 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":462}
I20260809 20:11:07.391340 17200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:07.376877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:33119 (local address 127.14.181.1:59295)
0809 20:11:07.377512 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:07.377527 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:07.377633 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:07.378066 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:07.378071 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:07.378879 (+ 808us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:07.379333 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:07.379347 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:07.380672 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:07.380676 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:07.382228 (+ 1552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:07.382248 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:07.383276 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:07.383283 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:07.383490 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:07.384148 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:07.384174 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:07.385283 (+ 1109us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:07.388701 (+ 3418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:07.388705 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:07.388708 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:07.389058 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:07.389432 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:07.389435 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:07.389437 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:07.389548 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:07.390129 (+ 581us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:07.390134 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:07.390374 (+ 240us) client_negotiation.cc:769] Sending connection context
0809 20:11:07.390532 (+ 158us) client_negotiation.cc:240] Negotiation successful
0809 20:11:07.390867 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":365,"threads_started":1}
I20260809 20:11:07.391666 17250 heartbeater.cc:347] Connected to a master server at 127.14.181.62:33119
I20260809 20:11:07.392305 17250 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:07.392905 17250 heartbeater.cc:511] Master 127.14.181.62:33119 requested a full tablet report, sending...
I20260809 20:11:07.393409 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 17037
I20260809 20:11:07.393637 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance
I20260809 20:11:07.394461 15060 external_mini_cluster.cc:1428] Setting key 36f54fdff885e84cda089e221b4f9b4c
I20260809 20:11:07.395223 16909 ts_manager.cc:194] Registered new tserver with Master: b01671cb66cd450888dd319256d9ac30 (127.14.181.1:34635)
I20260809 20:11:07.396831 16909 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.1@KRBTEST.COM'} at 127.14.181.1:51259
WARNING: no policy specified for kudu/127.14.181.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
I20260809 20:11:07.430972 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:0
--local_ip_for_outbound_sockets=127.14.181.2
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:33119
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:37201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:07.727084 17257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:07.727334 17257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:07.727460 17257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:07.734198 17257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:07.734297 17257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:07.734432 17257 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 20:11:07.734547 17257 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:11:07.743443 17257 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:37201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.181.62:33119
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:07.744488 17257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:07.745689 17257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:07.757450 17270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:07.757501 17267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:07.757457 17268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:07.758632 17257 server_base.cc:1034] running on GCE node
I20260809 20:11:07.759197 17257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:07.759979 17257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:07.761193 17257 hybrid_clock.cc:648] HybridClock initialized: now 1786306267761123 us; error 35 us; skew 500 ppm
I20260809 20:11:07.761445 17257 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:07 dist-test-slave-6zbq krb5kdc[16841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306267, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:07.768906 17257 init.cc:377] Logged in from keytab as kudu/127.14.181.2@KRBTEST.COM (short username kudu)
I20260809 20:11:07.770157 17257 webserver.cc:460] Webserver started at http://127.14.181.2:37753/ using document root <none> and password file <none>
I20260809 20:11:07.770793 17257 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:07.770892 17257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:07.771174 17257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:07.773934 17257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-1/data/instance:
uuid: "a54c15d250c4486ebf60d244e0d85c78"
format_stamp: "Formatted at 2026-08-09 20:11:07 on dist-test-slave-6zbq"
server_key: "29b19d5e022af69f8e26a9b56fabd27f"
server_key_iv: "03ebf66163d83029d8732ae9b60b7dd2"
server_key_version: "encryptionkey@0"
I20260809 20:11:07.774709 17257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance:
uuid: "a54c15d250c4486ebf60d244e0d85c78"
format_stamp: "Formatted at 2026-08-09 20:11:07 on dist-test-slave-6zbq"
server_key: "29b19d5e022af69f8e26a9b56fabd27f"
server_key_iv: "03ebf66163d83029d8732ae9b60b7dd2"
server_key_version: "encryptionkey@0"
I20260809 20:11:07.779198 17257 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 20:11:07.782213 17280 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:07.783349 17257 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 20:11:07.783489 17257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "a54c15d250c4486ebf60d244e0d85c78"
format_stamp: "Formatted at 2026-08-09 20:11:07 on dist-test-slave-6zbq"
server_key: "29b19d5e022af69f8e26a9b56fabd27f"
server_key_iv: "03ebf66163d83029d8732ae9b60b7dd2"
server_key_version: "encryptionkey@0"
I20260809 20:11:07.783675 17257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:07.799278 17257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:07.802986 17257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:07.803218 17257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:07.805670 17257 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:07.805750 17257 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:07.805884 17257 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:07.805943 17257 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 20:11:07 dist-test-slave-6zbq krb5kdc[16841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306267, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:07.828555 17071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:07.806423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:37561 (local address 127.14.181.62:33119)
0809 20:11:07.806591 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:07.806598 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:07.807845 (+ 1247us) server_negotiation.cc:407] Connection header received
0809 20:11:07.810533 (+ 2688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:07.810539 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:07.810617 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:07.810717 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:07.812762 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:07.813952 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:07.816768 (+ 2816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:07.817462 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:07.817581 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:07.821975 (+ 4394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:07.821982 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:07.821988 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:07.822030 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:07.825472 (+ 3442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:07.826178 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:07.826183 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:07.826187 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:07.826308 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:07.826907 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:07.826912 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:07.826916 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:07.827266 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:07.827405 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:07.828035 (+ 630us) server_negotiation.cc:299] Negotiation successful
0809 20:11:07.828239 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 20:11:07.829483 17292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:07.806814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:33119 (local address 127.14.181.2:37561)
0809 20:11:07.807679 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:07.807738 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:07.810211 (+ 2473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:07.810980 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:07.810991 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:07.811694 (+ 703us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:07.812524 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:07.812554 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:07.814143 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:07.814153 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:07.816553 (+ 2400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:07.816569 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:07.817715 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:07.817724 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:07.817985 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:07.818686 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:07.818716 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:07.821702 (+ 2986us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:07.825613 (+ 3911us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:07.825621 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:07.825634 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:07.826053 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:07.826444 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:07.826450 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:07.826455 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:07.826761 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:07.827404 (+ 643us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:07.827411 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:07.827713 (+ 302us) client_negotiation.cc:769] Sending connection context
0809 20:11:07.827914 (+ 201us) client_negotiation.cc:240] Negotiation successful
0809 20:11:07.828353 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":360,"threads_started":1}
I20260809 20:11:07.851261 17257 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:37599
I20260809 20:11:07.851329 17485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:37599 every 8 connection(s)
I20260809 20:11:07.852241 17071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:07.835930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:35365 (local address 127.14.181.62:33119)
0809 20:11:07.836100 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:07.836105 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:07.838876 (+ 2771us) server_negotiation.cc:407] Connection header received
0809 20:11:07.838993 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:07.838998 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:07.839070 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:07.839178 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:07.840509 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:07.841583 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:07.843660 (+ 2077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:07.844086 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:07.844177 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:07.846389 (+ 2212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:07.846396 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:07.846400 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:07.846434 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:07.849583 (+ 3149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:07.850187 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:07.850193 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:07.850197 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:07.850378 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:07.850829 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:07.850834 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:07.850837 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:07.851278 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:07.851470 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:07.851874 (+ 404us) server_negotiation.cc:299] Negotiation successful
0809 20:11:07.852033 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 20:11:07.852512 17420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:07.835924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:33119 (local address 127.14.181.2:35365)
0809 20:11:07.838789 (+ 2865us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:07.838806 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:07.838906 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:07.839229 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:07.839234 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:07.839854 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:07.840342 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:07.840357 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:07.841725 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:07.841731 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:07.843478 (+ 1747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:07.843497 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:07.844268 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:07.844275 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:07.844458 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:07.845071 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:07.845093 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:07.846162 (+ 1069us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:07.849698 (+ 3536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:07.849701 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:07.849704 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:07.850053 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:07.850526 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:07.850532 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:07.850537 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:07.850705 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:07.851442 (+ 737us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:07.851447 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:07.851625 (+ 178us) client_negotiation.cc:769] Sending connection context
0809 20:11:07.851800 (+ 175us) client_negotiation.cc:240] Negotiation successful
0809 20:11:07.852095 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2733,"thread_start_us":2599,"threads_started":1}
I20260809 20:11:07.852702 17257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:11:07.853242 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 17257
I20260809 20:11:07.853449 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance
I20260809 20:11:07.853998 15060 external_mini_cluster.cc:1428] Setting key 039bb7742800dcb5a40c839f4581f855
I20260809 20:11:07.856031 17487 heartbeater.cc:347] Connected to a master server at 127.14.181.62:33119
I20260809 20:11:07.856329 17487 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:07.857188 17487 heartbeater.cc:511] Master 127.14.181.62:33119 requested a full tablet report, sending...
I20260809 20:11:07.858896 16909 ts_manager.cc:194] Registered new tserver with Master: a54c15d250c4486ebf60d244e0d85c78 (127.14.181.2:37599)
I20260809 20:11:07.859671 16909 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.2@KRBTEST.COM'} at 127.14.181.2:37561
WARNING: no policy specified for kudu/127.14.181.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
I20260809 20:11:07.890692 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:0
--local_ip_for_outbound_sockets=127.14.181.3
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:33119
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:37201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:08.195093 17492 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:08.195324 17492 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:08.195454 17492 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:08.202419 17492 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:08.202515 17492 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:08.202636 17492 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 20:11:08.202772 17492 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:11:08.211843 17492 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:37201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.181.62:33119
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:08.212903 17492 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:08.214111 17492 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:08.226071 17500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:08.226150 17503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:08.226168 17501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:08.226919 17492 server_base.cc:1034] running on GCE node
I20260809 20:11:08.227412 17492 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:08.228181 17492 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:08.229379 17492 hybrid_clock.cc:648] HybridClock initialized: now 1786306268229317 us; error 40 us; skew 500 ppm
I20260809 20:11:08.229605 17492 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:08 dist-test-slave-6zbq krb5kdc[16841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306268, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:08.232654 17492 init.cc:377] Logged in from keytab as kudu/127.14.181.3@KRBTEST.COM (short username kudu)
I20260809 20:11:08.233955 17492 webserver.cc:460] Webserver started at http://127.14.181.3:41901/ using document root <none> and password file <none>
I20260809 20:11:08.234597 17492 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:08.234685 17492 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:08.234943 17492 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:08.237514 17492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-2/data/instance:
uuid: "afa3f8adc472405ea4452e70467d2a67"
format_stamp: "Formatted at 2026-08-09 20:11:08 on dist-test-slave-6zbq"
server_key: "310a0a12972ee92e3fcbe346db7279d9"
server_key_iv: "63d9fa1405d6d9c454511b00b8f9ac1c"
server_key_version: "encryptionkey@0"
I20260809 20:11:08.238230 17492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance:
uuid: "afa3f8adc472405ea4452e70467d2a67"
format_stamp: "Formatted at 2026-08-09 20:11:08 on dist-test-slave-6zbq"
server_key: "310a0a12972ee92e3fcbe346db7279d9"
server_key_iv: "63d9fa1405d6d9c454511b00b8f9ac1c"
server_key_version: "encryptionkey@0"
I20260809 20:11:08.242794 17492 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 20:11:08.245968 17516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:08.247164 17492 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:11:08.247285 17492 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "afa3f8adc472405ea4452e70467d2a67"
format_stamp: "Formatted at 2026-08-09 20:11:08 on dist-test-slave-6zbq"
server_key: "310a0a12972ee92e3fcbe346db7279d9"
server_key_iv: "63d9fa1405d6d9c454511b00b8f9ac1c"
server_key_version: "encryptionkey@0"
I20260809 20:11:08.247445 17492 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:08.261337 17492 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:08.265228 17492 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:08.265434 17492 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:08.267861 17492 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:08.267951 17492 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:08.268100 17492 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:08.268193 17492 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 20:11:08 dist-test-slave-6zbq krb5kdc[16841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306268, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:08.288765 17071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:08.268166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:35967 (local address 127.14.181.62:33119)
0809 20:11:08.268359 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:08.268366 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:08.269701 (+ 1335us) server_negotiation.cc:407] Connection header received
0809 20:11:08.271676 (+ 1975us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:08.271683 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:08.271805 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:08.271926 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:08.273720 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.274910 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.277071 (+ 2161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.277609 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.277753 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:08.282269 (+ 4516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:08.282274 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:08.282277 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:08.282308 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:08.285357 (+ 3049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:08.286244 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:08.286250 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:08.286253 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:08.286462 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:08.286990 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:08.286995 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:08.286998 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:08.287306 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:08.287432 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:08.288173 (+ 741us) server_negotiation.cc:299] Negotiation successful
0809 20:11:08.288405 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 20:11:08.289713 17531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:08.268705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:33119 (local address 127.14.181.3:35967)
0809 20:11:08.269516 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:08.269572 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:08.271413 (+ 1841us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:08.272183 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:08.272194 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:08.272964 (+ 770us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:08.273553 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:08.273572 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.275074 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.275083 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:08.276936 (+ 1853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:08.276949 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.277868 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.277878 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:08.278178 (+ 300us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:08.278973 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:08.279004 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:08.282081 (+ 3077us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:08.285481 (+ 3400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:08.285490 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:08.285507 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:08.286113 (+ 606us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:08.286615 (+ 502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:08.286620 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:08.286625 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:08.286825 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:08.287492 (+ 667us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:08.287500 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:08.287799 (+ 299us) client_negotiation.cc:769] Sending connection context
0809 20:11:08.288021 (+ 222us) client_negotiation.cc:240] Negotiation successful
0809 20:11:08.288487 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":338,"threads_started":1}
I20260809 20:11:08.310750 17661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:08.297164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:33119 (local address 127.14.181.3:34539)
0809 20:11:08.297711 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:08.297726 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:08.297849 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:08.298166 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:08.298171 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:08.298752 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:08.299406 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:08.299428 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.300778 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.300783 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:08.302368 (+ 1585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:08.302387 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.303280 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.303287 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:08.303431 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:08.304012 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:08.304029 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:08.304718 (+ 689us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:08.307631 (+ 2913us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:08.307636 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:08.307641 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:08.308074 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:08.308462 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:08.308467 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:08.308471 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:08.308659 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:08.309275 (+ 616us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:08.309282 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:08.309518 (+ 236us) client_negotiation.cc:769] Sending connection context
0809 20:11:08.309694 (+ 176us) client_negotiation.cc:240] Negotiation successful
0809 20:11:08.310086 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":300,"threads_started":1}
I20260809 20:11:08.310962 17071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:08.297082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:34539 (local address 127.14.181.62:33119)
0809 20:11:08.297241 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:08.297245 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:08.297809 (+ 564us) server_negotiation.cc:407] Connection header received
0809 20:11:08.297961 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:08.297967 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:08.298032 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:08.298110 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:08.299607 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.300570 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.302558 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.303083 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.303196 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:08.304908 (+ 1712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:08.304914 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:08.304920 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:08.304953 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:08.307506 (+ 2553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:08.308195 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:08.308200 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:08.308203 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:08.308334 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:08.308793 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:08.308798 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:08.308802 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:08.309104 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:08.309314 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:08.310535 (+ 1221us) server_negotiation.cc:299] Negotiation successful
0809 20:11:08.310735 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 20:11:08.318636 17492 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:40659
I20260809 20:11:08.318681 17726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:40659 every 8 connection(s)
I20260809 20:11:08.319741 17492 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:11:08.321636 17729 heartbeater.cc:347] Connected to a master server at 127.14.181.62:33119
I20260809 20:11:08.321828 17729 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:08.322449 17729 heartbeater.cc:511] Master 127.14.181.62:33119 requested a full tablet report, sending...
I20260809 20:11:08.323669 16909 ts_manager.cc:194] Registered new tserver with Master: afa3f8adc472405ea4452e70467d2a67 (127.14.181.3:40659)
I20260809 20:11:08.324424 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 17492
I20260809 20:11:08.324429 16909 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.3@KRBTEST.COM'} at 127.14.181.3:35967
I20260809 20:11:08.324596 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance
I20260809 20:11:08.325078 15060 external_mini_cluster.cc:1428] Setting key 1b202038bd04c30415e1c96cf15853f3
I20260809 20:11:08.327925 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 20:11:08 dist-test-slave-6zbq krb5kdc[16841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306268, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 20:11:08 dist-test-slave-6zbq krb5kdc[16841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306268, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:08.372867 17071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:08.359709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45816 (local address 127.14.181.62:33119)
0809 20:11:08.359885 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:08.359892 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:08.360234 (+ 342us) server_negotiation.cc:407] Connection header received
0809 20:11:08.360416 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:08.360420 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:08.360488 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:08.360571 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:08.361890 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.362669 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.363908 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.364333 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.364442 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:08.367950 (+ 3508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:08.367955 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:08.367958 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:08.367990 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:08.370420 (+ 2430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:08.371040 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:08.371045 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:08.371047 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:08.371180 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:08.371522 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:08.371526 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:08.371528 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:08.371788 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:08.372021 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:08.372314 (+ 293us) server_negotiation.cc:299] Negotiation successful
0809 20:11:08.372516 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 20:11:08.376498 16909 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45816:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 20:11:08.383172 16909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 20:11:08.399890 17250 heartbeater.cc:503] Master 127.14.181.62:33119 was elected leader, sending a full tablet report...
I20260809 20:11:08.416193 17752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:08.395236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33186 (local address 127.14.181.2:37599)
0809 20:11:08.409008 (+ 13772us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:08.409013 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:08.409036 (+ 23us) server_negotiation.cc:407] Connection header received
0809 20:11:08.409110 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:08.409116 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:08.409294 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:08.409461 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:08.410194 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.411822 (+ 1628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.413865 (+ 2043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.415059 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.415185 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:08.415412 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:08.415719 (+ 307us) server_negotiation.cc:299] Negotiation successful
0809 20:11:08.415895 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13631,"thread_start_us":13497,"threads_started":1}
I20260809 20:11:08.416294 17746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:08.394966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:37599 (local address 127.0.0.1:33186)
0809 20:11:08.408017 (+ 13051us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:08.408035 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:08.408141 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:08.409488 (+ 1347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:08.409495 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:08.409525 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:08.409989 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:08.410002 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.412003 (+ 2001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.412008 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:08.413717 (+ 1709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:08.413732 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.415289 (+ 1557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.415297 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:08.415493 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:08.415534 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 20:11:08.415650 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 20:11:08.415896 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12939,"mutex_wait_us":36,"thread_start_us":14832,"threads_started":1}
I20260809 20:11:08.418263 17749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:08.396771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:40659 (local address 127.0.0.1:57118)
0809 20:11:08.410047 (+ 13276us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:08.410063 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:08.410169 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:08.411364 (+ 1195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:08.411367 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:08.411386 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:08.411670 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:08.411678 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.413413 (+ 1735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.413418 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:08.415705 (+ 2287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:08.415719 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.417571 (+ 1852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.417577 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:08.417751 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:08.417774 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 20:11:08.417850 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 20:11:08.417964 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13163,"thread_start_us":7106,"threads_started":1}
I20260809 20:11:08.418382 17754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:08.397385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57118 (local address 127.14.181.3:40659)
0809 20:11:08.405218 (+ 7833us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:08.405227 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:08.410271 (+ 5044us) server_negotiation.cc:407] Connection header received
0809 20:11:08.410385 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:08.410392 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:08.410770 (+ 378us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:08.410948 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:08.411872 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.413248 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.415890 (+ 2642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.417300 (+ 1410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.417425 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:08.417647 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:08.417906 (+ 259us) server_negotiation.cc:299] Negotiation successful
0809 20:11:08.418058 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7636,"thread_start_us":7925,"threads_started":1}
I20260809 20:11:08.420079 17753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:08.394772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:34635 (local address 127.0.0.1:51440)
0809 20:11:08.404311 (+ 9539us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:08.404362 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:08.404539 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:08.412693 (+ 8154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:08.412698 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:08.412724 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:08.413097 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:08.413108 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.415245 (+ 2137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.415256 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:08.417351 (+ 2095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:08.417365 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.419339 (+ 1974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.419345 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:08.419509 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:08.419542 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 20:11:08.419635 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 20:11:08.419750 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9243,"mutex_wait_us":1,"thread_start_us":13579,"threads_started":1}
I20260809 20:11:08.420146 17747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:08.394964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51440 (local address 127.14.181.1:34635)
0809 20:11:08.412167 (+ 17203us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:08.412175 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:08.412200 (+ 25us) server_negotiation.cc:407] Connection header received
0809 20:11:08.412283 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:08.412290 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:08.412489 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:08.412665 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:08.413276 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.415073 (+ 1797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.417499 (+ 2426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.418868 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.419000 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:08.419181 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:08.419699 (+ 518us) server_negotiation.cc:299] Negotiation successful
0809 20:11:08.419862 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17050,"thread_start_us":16908,"threads_started":1}
I20260809 20:11:08.420226 17363 tablet_service.cc:1467] Processing CreateTablet for tablet b5eaa181d07a45fe9791a4e5e4bcfd20 (DEFAULT_TABLE table=test-table [id=e6df37549b6b42d1b04728703e302d17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:08.421512 17363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5eaa181d07a45fe9791a4e5e4bcfd20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:08.421695 17602 tablet_service.cc:1467] Processing CreateTablet for tablet b5eaa181d07a45fe9791a4e5e4bcfd20 (DEFAULT_TABLE table=test-table [id=e6df37549b6b42d1b04728703e302d17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:08.422869 17602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5eaa181d07a45fe9791a4e5e4bcfd20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:08.425521 17135 tablet_service.cc:1467] Processing CreateTablet for tablet b5eaa181d07a45fe9791a4e5e4bcfd20 (DEFAULT_TABLE table=test-table [id=e6df37549b6b42d1b04728703e302d17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:08.426805 17135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5eaa181d07a45fe9791a4e5e4bcfd20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:08.432287 17755 tablet_bootstrap.cc:492] T b5eaa181d07a45fe9791a4e5e4bcfd20 P a54c15d250c4486ebf60d244e0d85c78: Bootstrap starting.
I20260809 20:11:08.435241 17755 tablet_bootstrap.cc:654] T b5eaa181d07a45fe9791a4e5e4bcfd20 P a54c15d250c4486ebf60d244e0d85c78: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:08.436527 17757 tablet_bootstrap.cc:492] T b5eaa181d07a45fe9791a4e5e4bcfd20 P afa3f8adc472405ea4452e70467d2a67: Bootstrap starting.
I20260809 20:11:08.436288 17755 log.cc:824] T b5eaa181d07a45fe9791a4e5e4bcfd20 P a54c15d250c4486ebf60d244e0d85c78: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:08.439513 17757 tablet_bootstrap.cc:654] T b5eaa181d07a45fe9791a4e5e4bcfd20 P afa3f8adc472405ea4452e70467d2a67: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:08.440006 17755 tablet_bootstrap.cc:492] T b5eaa181d07a45fe9791a4e5e4bcfd20 P a54c15d250c4486ebf60d244e0d85c78: No bootstrap required, opened a new log
I20260809 20:11:08.440068 17761 tablet_bootstrap.cc:492] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30: Bootstrap starting.
I20260809 20:11:08.440354 17755 ts_tablet_manager.cc:1397] T b5eaa181d07a45fe9791a4e5e4bcfd20 P a54c15d250c4486ebf60d244e0d85c78: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.002s
I20260809 20:11:08.440753 17757 log.cc:824] T b5eaa181d07a45fe9791a4e5e4bcfd20 P afa3f8adc472405ea4452e70467d2a67: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:08.443261 17761 tablet_bootstrap.cc:654] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:08.443697 17757 tablet_bootstrap.cc:492] T b5eaa181d07a45fe9791a4e5e4bcfd20 P afa3f8adc472405ea4452e70467d2a67: No bootstrap required, opened a new log
I20260809 20:11:08.443953 17757 ts_tablet_manager.cc:1397] T b5eaa181d07a45fe9791a4e5e4bcfd20 P afa3f8adc472405ea4452e70467d2a67: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 20:11:08.444839 17761 log.cc:824] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:08.447598 17761 tablet_bootstrap.cc:492] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30: No bootstrap required, opened a new log
I20260809 20:11:08.447844 17761 ts_tablet_manager.cc:1397] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 20:11:08.448509 17755 raft_consensus.cc:348] T b5eaa181d07a45fe9791a4e5e4bcfd20 P a54c15d250c4486ebf60d244e0d85c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } }
I20260809 20:11:08.448843 17755 raft_consensus.cc:374] T b5eaa181d07a45fe9791a4e5e4bcfd20 P a54c15d250c4486ebf60d244e0d85c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:08.448937 17755 raft_consensus.cc:729] T b5eaa181d07a45fe9791a4e5e4bcfd20 P a54c15d250c4486ebf60d244e0d85c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54c15d250c4486ebf60d244e0d85c78, State: Initialized, Role: FOLLOWER
I20260809 20:11:08.449451 17755 consensus_queue.cc:260] T b5eaa181d07a45fe9791a4e5e4bcfd20 P a54c15d250c4486ebf60d244e0d85c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } }
I20260809 20:11:08.450392 17487 heartbeater.cc:503] Master 127.14.181.62:33119 was elected leader, sending a full tablet report...
I20260809 20:11:08.452383 17755 ts_tablet_manager.cc:1428] T b5eaa181d07a45fe9791a4e5e4bcfd20 P a54c15d250c4486ebf60d244e0d85c78: Time spent starting tablet: real 0.012s user 0.008s sys 0.002s
I20260809 20:11:08.454681 17757 raft_consensus.cc:348] T b5eaa181d07a45fe9791a4e5e4bcfd20 P afa3f8adc472405ea4452e70467d2a67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } }
I20260809 20:11:08.454989 17757 raft_consensus.cc:374] T b5eaa181d07a45fe9791a4e5e4bcfd20 P afa3f8adc472405ea4452e70467d2a67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:08.455083 17757 raft_consensus.cc:729] T b5eaa181d07a45fe9791a4e5e4bcfd20 P afa3f8adc472405ea4452e70467d2a67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afa3f8adc472405ea4452e70467d2a67, State: Initialized, Role: FOLLOWER
I20260809 20:11:08.455595 17757 consensus_queue.cc:260] T b5eaa181d07a45fe9791a4e5e4bcfd20 P afa3f8adc472405ea4452e70467d2a67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } }
I20260809 20:11:08.456698 17729 heartbeater.cc:503] Master 127.14.181.62:33119 was elected leader, sending a full tablet report...
I20260809 20:11:08.457491 17761 raft_consensus.cc:348] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } }
I20260809 20:11:08.457890 17761 raft_consensus.cc:374] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:08.457993 17761 raft_consensus.cc:729] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b01671cb66cd450888dd319256d9ac30, State: Initialized, Role: FOLLOWER
I20260809 20:11:08.458453 17757 ts_tablet_manager.cc:1428] T b5eaa181d07a45fe9791a4e5e4bcfd20 P afa3f8adc472405ea4452e70467d2a67: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260809 20:11:08.458618 17761 consensus_queue.cc:260] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } }
I20260809 20:11:08.460103 17761 ts_tablet_manager.cc:1428] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30: Time spent starting tablet: real 0.012s user 0.009s sys 0.004s
I20260809 20:11:08.483456 17767 raft_consensus.cc:482] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:11:08.483669 17767 raft_consensus.cc:504] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } }
I20260809 20:11:08.485087 17767 leader_election.cc:288] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54c15d250c4486ebf60d244e0d85c78 (127.14.181.2:37599), afa3f8adc472405ea4452e70467d2a67 (127.14.181.3:40659)
I20260809 20:11:08.491427 17752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:08.485499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:38187 (local address 127.14.181.2:37599)
0809 20:11:08.485852 (+ 353us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:08.485857 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:08.485952 (+ 95us) server_negotiation.cc:407] Connection header received
0809 20:11:08.486151 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:08.486156 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:08.486238 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:08.486356 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:08.486954 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.487843 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.489673 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.490499 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.490615 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:08.490665 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:08.491049 (+ 384us) server_negotiation.cc:299] Negotiation successful
0809 20:11:08.491174 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221}
I20260809 20:11:08.491510 17754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:08.485817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:44551 (local address 127.14.181.3:40659)
0809 20:11:08.485983 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:08.485989 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:08.486392 (+ 403us) server_negotiation.cc:407] Connection header received
0809 20:11:08.486605 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:08.486610 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:08.486679 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:08.486766 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:08.487377 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.488142 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.489819 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.490650 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.490801 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:08.490868 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:08.491163 (+ 295us) server_negotiation.cc:299] Negotiation successful
0809 20:11:08.491288 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 20:11:08.491771 17768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:08.485252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:37599 (local address 127.14.181.1:38187)
0809 20:11:08.485851 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:08.485872 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:08.486014 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:08.486383 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:08.486388 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:08.486444 (+ 56us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:08.486824 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:08.486838 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.487969 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.487974 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:08.489517 (+ 1543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:08.489530 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.490706 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.490713 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:08.490904 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:08.490930 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 20:11:08.490999 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 20:11:08.491089 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"mutex_wait_us":8,"spinlock_wait_cycles":38016,"thread_start_us":287,"threads_started":1}
I20260809 20:11:08.491809 17770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:08.485526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:40659 (local address 127.14.181.1:44551)
0809 20:11:08.486288 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:08.486305 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:08.486458 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:08.486801 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:08.486806 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:08.486831 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:08.487219 (+ 388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:08.487231 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.488268 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.488272 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:08.489652 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:08.489667 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.490846 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.490850 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:08.490978 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:08.491010 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 20:11:08.491100 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 20:11:08.491266 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"mutex_wait_us":6,"spinlock_wait_cycles":6784,"thread_start_us":474,"threads_started":1}
I20260809 20:11:08.492918 17648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5eaa181d07a45fe9791a4e5e4bcfd20" candidate_uuid: "b01671cb66cd450888dd319256d9ac30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afa3f8adc472405ea4452e70467d2a67" is_pre_election: true
I20260809 20:11:08.492970 17410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5eaa181d07a45fe9791a4e5e4bcfd20" candidate_uuid: "b01671cb66cd450888dd319256d9ac30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54c15d250c4486ebf60d244e0d85c78" is_pre_election: true
I20260809 20:11:08.493330 17648 raft_consensus.cc:2454] T b5eaa181d07a45fe9791a4e5e4bcfd20 P afa3f8adc472405ea4452e70467d2a67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b01671cb66cd450888dd319256d9ac30 in term 0.
I20260809 20:11:08.493346 17410 raft_consensus.cc:2454] T b5eaa181d07a45fe9791a4e5e4bcfd20 P a54c15d250c4486ebf60d244e0d85c78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b01671cb66cd450888dd319256d9ac30 in term 0.
I20260809 20:11:08.493904 17058 leader_election.cc:302] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afa3f8adc472405ea4452e70467d2a67, b01671cb66cd450888dd319256d9ac30; no voters:
I20260809 20:11:08.494205 17767 raft_consensus.cc:2781] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:11:08.494328 17767 raft_consensus.cc:482] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:11:08.494453 17767 raft_consensus.cc:3037] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:08.496495 17767 raft_consensus.cc:504] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } }
I20260809 20:11:08.497041 17767 leader_election.cc:288] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30 [CANDIDATE]: Term 1 election: Requested vote from peers a54c15d250c4486ebf60d244e0d85c78 (127.14.181.2:37599), afa3f8adc472405ea4452e70467d2a67 (127.14.181.3:40659)
I20260809 20:11:08.497407 17410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5eaa181d07a45fe9791a4e5e4bcfd20" candidate_uuid: "b01671cb66cd450888dd319256d9ac30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54c15d250c4486ebf60d244e0d85c78"
I20260809 20:11:08.497488 17648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5eaa181d07a45fe9791a4e5e4bcfd20" candidate_uuid: "b01671cb66cd450888dd319256d9ac30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afa3f8adc472405ea4452e70467d2a67"
I20260809 20:11:08.497598 17410 raft_consensus.cc:3037] T b5eaa181d07a45fe9791a4e5e4bcfd20 P a54c15d250c4486ebf60d244e0d85c78 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:08.497663 17648 raft_consensus.cc:3037] T b5eaa181d07a45fe9791a4e5e4bcfd20 P afa3f8adc472405ea4452e70467d2a67 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:08.500720 17410 raft_consensus.cc:2454] T b5eaa181d07a45fe9791a4e5e4bcfd20 P a54c15d250c4486ebf60d244e0d85c78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b01671cb66cd450888dd319256d9ac30 in term 1.
I20260809 20:11:08.500710 17648 raft_consensus.cc:2454] T b5eaa181d07a45fe9791a4e5e4bcfd20 P afa3f8adc472405ea4452e70467d2a67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b01671cb66cd450888dd319256d9ac30 in term 1.
I20260809 20:11:08.501070 17058 leader_election.cc:302] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afa3f8adc472405ea4452e70467d2a67, b01671cb66cd450888dd319256d9ac30; no voters:
I20260809 20:11:08.501322 17767 raft_consensus.cc:2781] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:08.501708 17767 raft_consensus.cc:686] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30 [term 1 LEADER]: Becoming Leader. State: Replica: b01671cb66cd450888dd319256d9ac30, State: Running, Role: LEADER
I20260809 20:11:08.502156 17767 consensus_queue.cc:237] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } }
I20260809 20:11:08.505963 16907 catalog_manager.cc:5495] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30 reported cstate change: term changed from 0 to 1, leader changed from <none> to b01671cb66cd450888dd319256d9ac30 (127.14.181.1). New cstate: current_term: 1 leader_uuid: "b01671cb66cd450888dd319256d9ac30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } health_report { overall_health: UNKNOWN } } }
I20260809 20:11:08.534148 17747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:08.529224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51444 (local address 127.14.181.1:34635)
0809 20:11:08.529380 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:08.529385 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:08.529523 (+ 138us) server_negotiation.cc:407] Connection header received
0809 20:11:08.529851 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:08.529855 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:08.529924 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:08.530027 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:11:08.530297 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.531035 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.532359 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.532746 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.532833 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:08.533230 (+ 397us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:11:08.533721 (+ 491us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:11:08.533821 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:08.533898 (+ 77us) server_negotiation.cc:299] Negotiation successful
0809 20:11:08.533961 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 20:11:08.542675 17648 raft_consensus.cc:1261] T b5eaa181d07a45fe9791a4e5e4bcfd20 P afa3f8adc472405ea4452e70467d2a67 [term 1 FOLLOWER]: Refusing update from remote peer b01671cb66cd450888dd319256d9ac30: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:11:08.543731 17772 consensus_queue.cc:1035] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:11:08.544215 17410 raft_consensus.cc:1261] T b5eaa181d07a45fe9791a4e5e4bcfd20 P a54c15d250c4486ebf60d244e0d85c78 [term 1 FOLLOWER]: Refusing update from remote peer b01671cb66cd450888dd319256d9ac30: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:11:08.544912 17772 consensus_queue.cc:1035] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:11:08.554368 17775 mvcc.cc:205] Tried to move back new op lower bound from 7316710475938959360 to 7316710475788283904. Current Snapshot: MvccSnapshot[applied={T|T < 7316710475938959360}]
I20260809 20:11:08.575853 16909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45816:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:11:08.576172 16909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45816:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:11:08.579928 16909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2dcaa14b9e6b4454853956902ebed12b: Sending DeleteTablet for 3 replicas of tablet b5eaa181d07a45fe9791a4e5e4bcfd20
I20260809 20:11:08.581188 17363 tablet_service.cc:1514] Processing DeleteTablet for tablet b5eaa181d07a45fe9791a4e5e4bcfd20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:08 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:33186
I20260809 20:11:08.581449 17602 tablet_service.cc:1514] Processing DeleteTablet for tablet b5eaa181d07a45fe9791a4e5e4bcfd20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:08 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:57118
I20260809 20:11:08.583199 17135 tablet_service.cc:1514] Processing DeleteTablet for tablet b5eaa181d07a45fe9791a4e5e4bcfd20 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:08 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:51440
I20260809 20:11:08.585402 16909 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45816:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 20:11:08.586241 16909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 20:11:08.589403 17795 tablet_replica.cc:330] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30: stopping tablet replica
I20260809 20:11:08.591765 17795 raft_consensus.cc:2229] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30 [term 1 LEADER]: Raft consensus shutting down.
I20260809 20:11:08.594081 17600 tablet_service.cc:1467] Processing CreateTablet for tablet 9c87b059645949a5aafbf1bc455b7580 (DEFAULT_TABLE table=test-table [id=305c90edb25945b08456c94c8abf6d77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:08.594753 17600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c87b059645949a5aafbf1bc455b7580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:08.594928 17795 raft_consensus.cc:2258] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:08.597965 17794 tablet_replica.cc:330] T b5eaa181d07a45fe9791a4e5e4bcfd20 P afa3f8adc472405ea4452e70467d2a67: stopping tablet replica
I20260809 20:11:08.598439 17135 tablet_service.cc:1467] Processing CreateTablet for tablet 9c87b059645949a5aafbf1bc455b7580 (DEFAULT_TABLE table=test-table [id=305c90edb25945b08456c94c8abf6d77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:08.598699 17792 tablet_replica.cc:330] T b5eaa181d07a45fe9791a4e5e4bcfd20 P a54c15d250c4486ebf60d244e0d85c78: stopping tablet replica
I20260809 20:11:08.598870 17135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c87b059645949a5aafbf1bc455b7580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:08.598749 17361 tablet_service.cc:1467] Processing CreateTablet for tablet 9c87b059645949a5aafbf1bc455b7580 (DEFAULT_TABLE table=test-table [id=305c90edb25945b08456c94c8abf6d77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:08.599352 17792 raft_consensus.cc:2229] T b5eaa181d07a45fe9791a4e5e4bcfd20 P a54c15d250c4486ebf60d244e0d85c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:11:08.599644 17795 ts_tablet_manager.cc:1905] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:08.599752 17794 raft_consensus.cc:2229] T b5eaa181d07a45fe9791a4e5e4bcfd20 P afa3f8adc472405ea4452e70467d2a67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:11:08.600338 17794 raft_consensus.cc:2258] T b5eaa181d07a45fe9791a4e5e4bcfd20 P afa3f8adc472405ea4452e70467d2a67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:08.599408 17361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c87b059645949a5aafbf1bc455b7580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:08.600895 17792 raft_consensus.cc:2258] T b5eaa181d07a45fe9791a4e5e4bcfd20 P a54c15d250c4486ebf60d244e0d85c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:08.603062 17792 ts_tablet_manager.cc:1905] T b5eaa181d07a45fe9791a4e5e4bcfd20 P a54c15d250c4486ebf60d244e0d85c78: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:08.607040 17794 ts_tablet_manager.cc:1905] T b5eaa181d07a45fe9791a4e5e4bcfd20 P afa3f8adc472405ea4452e70467d2a67: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:08.611676 17761 tablet_bootstrap.cc:492] T 9c87b059645949a5aafbf1bc455b7580 P b01671cb66cd450888dd319256d9ac30: Bootstrap starting.
I20260809 20:11:08.612754 17755 tablet_bootstrap.cc:492] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78: Bootstrap starting.
I20260809 20:11:08.613334 17761 tablet_bootstrap.cc:654] T 9c87b059645949a5aafbf1bc455b7580 P b01671cb66cd450888dd319256d9ac30: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:08.614271 17755 tablet_bootstrap.cc:654] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:08.614986 17795 ts_tablet_manager.cc:1918] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:11:08.615195 17795 log.cc:1196] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-0/wal/wals/b5eaa181d07a45fe9791a4e5e4bcfd20
I20260809 20:11:08.615797 17795 ts_tablet_manager.cc:1939] T b5eaa181d07a45fe9791a4e5e4bcfd20 P b01671cb66cd450888dd319256d9ac30: Deleting consensus metadata
I20260809 20:11:08.616812 17757 tablet_bootstrap.cc:492] T 9c87b059645949a5aafbf1bc455b7580 P afa3f8adc472405ea4452e70467d2a67: Bootstrap starting.
I20260809 20:11:08.618518 17757 tablet_bootstrap.cc:654] T 9c87b059645949a5aafbf1bc455b7580 P afa3f8adc472405ea4452e70467d2a67: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:08.617614 16887 catalog_manager.cc:4841] TS b01671cb66cd450888dd319256d9ac30 (127.14.181.1:34635): tablet b5eaa181d07a45fe9791a4e5e4bcfd20 (table test-table [id=e6df37549b6b42d1b04728703e302d17]) successfully deleted
I20260809 20:11:08.622844 17755 tablet_bootstrap.cc:492] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78: No bootstrap required, opened a new log
I20260809 20:11:08.622993 17755 ts_tablet_manager.cc:1397] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260809 20:11:08.623808 17755 raft_consensus.cc:348] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } }
I20260809 20:11:08.624022 17755 raft_consensus.cc:374] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:08.624112 17755 raft_consensus.cc:729] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54c15d250c4486ebf60d244e0d85c78, State: Initialized, Role: FOLLOWER
I20260809 20:11:08.624372 17794 ts_tablet_manager.cc:1918] T b5eaa181d07a45fe9791a4e5e4bcfd20 P afa3f8adc472405ea4452e70467d2a67: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:11:08.624379 17755 consensus_queue.cc:260] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } }
I20260809 20:11:08.624540 17794 log.cc:1196] T b5eaa181d07a45fe9791a4e5e4bcfd20 P afa3f8adc472405ea4452e70467d2a67: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-2/wal/wals/b5eaa181d07a45fe9791a4e5e4bcfd20
I20260809 20:11:08.624923 17755 ts_tablet_manager.cc:1428] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260809 20:11:08.625093 17794 ts_tablet_manager.cc:1939] T b5eaa181d07a45fe9791a4e5e4bcfd20 P afa3f8adc472405ea4452e70467d2a67: Deleting consensus metadata
I20260809 20:11:08.627815 16888 catalog_manager.cc:4841] TS afa3f8adc472405ea4452e70467d2a67 (127.14.181.3:40659): tablet b5eaa181d07a45fe9791a4e5e4bcfd20 (table test-table [id=e6df37549b6b42d1b04728703e302d17]) successfully deleted
I20260809 20:11:08.628310 17757 tablet_bootstrap.cc:492] T 9c87b059645949a5aafbf1bc455b7580 P afa3f8adc472405ea4452e70467d2a67: No bootstrap required, opened a new log
I20260809 20:11:08.628458 17757 ts_tablet_manager.cc:1397] T 9c87b059645949a5aafbf1bc455b7580 P afa3f8adc472405ea4452e70467d2a67: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.005s
I20260809 20:11:08.628780 17761 tablet_bootstrap.cc:492] T 9c87b059645949a5aafbf1bc455b7580 P b01671cb66cd450888dd319256d9ac30: No bootstrap required, opened a new log
I20260809 20:11:08.628978 17761 ts_tablet_manager.cc:1397] T 9c87b059645949a5aafbf1bc455b7580 P b01671cb66cd450888dd319256d9ac30: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.005s
I20260809 20:11:08.629254 17757 raft_consensus.cc:348] T 9c87b059645949a5aafbf1bc455b7580 P afa3f8adc472405ea4452e70467d2a67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } }
I20260809 20:11:08.629474 17757 raft_consensus.cc:374] T 9c87b059645949a5aafbf1bc455b7580 P afa3f8adc472405ea4452e70467d2a67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:08.629563 17757 raft_consensus.cc:729] T 9c87b059645949a5aafbf1bc455b7580 P afa3f8adc472405ea4452e70467d2a67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afa3f8adc472405ea4452e70467d2a67, State: Initialized, Role: FOLLOWER
I20260809 20:11:08.629827 17757 consensus_queue.cc:260] T 9c87b059645949a5aafbf1bc455b7580 P afa3f8adc472405ea4452e70467d2a67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } }
I20260809 20:11:08.630412 17757 ts_tablet_manager.cc:1428] T 9c87b059645949a5aafbf1bc455b7580 P afa3f8adc472405ea4452e70467d2a67: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260809 20:11:08.630771 17761 raft_consensus.cc:348] T 9c87b059645949a5aafbf1bc455b7580 P b01671cb66cd450888dd319256d9ac30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } }
I20260809 20:11:08.631026 17761 raft_consensus.cc:374] T 9c87b059645949a5aafbf1bc455b7580 P b01671cb66cd450888dd319256d9ac30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:08.631187 17761 raft_consensus.cc:729] T 9c87b059645949a5aafbf1bc455b7580 P b01671cb66cd450888dd319256d9ac30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b01671cb66cd450888dd319256d9ac30, State: Initialized, Role: FOLLOWER
I20260809 20:11:08.631490 17761 consensus_queue.cc:260] T 9c87b059645949a5aafbf1bc455b7580 P b01671cb66cd450888dd319256d9ac30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } }
I20260809 20:11:08.632189 17761 ts_tablet_manager.cc:1428] T 9c87b059645949a5aafbf1bc455b7580 P b01671cb66cd450888dd319256d9ac30: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260809 20:11:08.632216 17792 ts_tablet_manager.cc:1918] T b5eaa181d07a45fe9791a4e5e4bcfd20 P a54c15d250c4486ebf60d244e0d85c78: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:11:08.632362 17792 log.cc:1196] T b5eaa181d07a45fe9791a4e5e4bcfd20 P a54c15d250c4486ebf60d244e0d85c78: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-1/wal/wals/b5eaa181d07a45fe9791a4e5e4bcfd20
I20260809 20:11:08.632879 17792 ts_tablet_manager.cc:1939] T b5eaa181d07a45fe9791a4e5e4bcfd20 P a54c15d250c4486ebf60d244e0d85c78: Deleting consensus metadata
I20260809 20:11:08.634447 16891 catalog_manager.cc:4841] TS a54c15d250c4486ebf60d244e0d85c78 (127.14.181.2:37599): tablet b5eaa181d07a45fe9791a4e5e4bcfd20 (table test-table [id=e6df37549b6b42d1b04728703e302d17]) successfully deleted
W20260809 20:11:08.642320 17251 tablet.cc:2369] T 9c87b059645949a5aafbf1bc455b7580 P b01671cb66cd450888dd319256d9ac30: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:11:08.749867 17764 raft_consensus.cc:482] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:11:08.750147 17764 raft_consensus.cc:504] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } }
I20260809 20:11:08.752149 17764 leader_election.cc:288] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b01671cb66cd450888dd319256d9ac30 (127.14.181.1:34635), afa3f8adc472405ea4452e70467d2a67 (127.14.181.3:40659)
I20260809 20:11:08.760378 17754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:08.753734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:48529 (local address 127.14.181.3:40659)
0809 20:11:08.754231 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:08.754237 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:08.754255 (+ 18us) server_negotiation.cc:407] Connection header received
0809 20:11:08.754322 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:08.754327 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:08.754427 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:08.754517 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:08.755263 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.756403 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.758425 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.759393 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.759544 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:08.759616 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:08.759970 (+ 354us) server_negotiation.cc:299] Negotiation successful
0809 20:11:08.760095 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371}
I20260809 20:11:08.760659 17802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:08.753188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:40659 (local address 127.14.181.2:48529)
0809 20:11:08.753888 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:08.753903 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:08.753999 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:08.754560 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:08.754565 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:08.754599 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:08.755083 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:08.755097 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.756558 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.756562 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:08.758259 (+ 1697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:08.758271 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.759598 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.759605 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:08.759799 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:08.759835 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 20:11:08.759932 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 20:11:08.760056 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"mutex_wait_us":29,"thread_start_us":917,"threads_started":1}
I20260809 20:11:08.761464 17747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:08.752542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:55045 (local address 127.14.181.1:34635)
0809 20:11:08.752722 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:08.752728 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:08.753664 (+ 936us) server_negotiation.cc:407] Connection header received
0809 20:11:08.753978 (+ 314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:08.753984 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:08.754084 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:08.754151 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:08.755032 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.756150 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.758873 (+ 2723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.759955 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.760106 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:08.760168 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:08.760881 (+ 713us) server_negotiation.cc:299] Negotiation successful
0809 20:11:08.761011 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 20:11:08.761400 17648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c87b059645949a5aafbf1bc455b7580" candidate_uuid: "a54c15d250c4486ebf60d244e0d85c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afa3f8adc472405ea4452e70467d2a67" is_pre_election: true
I20260809 20:11:08.761656 17648 raft_consensus.cc:2454] T 9c87b059645949a5aafbf1bc455b7580 P afa3f8adc472405ea4452e70467d2a67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54c15d250c4486ebf60d244e0d85c78 in term 0.
I20260809 20:11:08.762328 17801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:08.752681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:34635 (local address 127.14.181.2:55045)
0809 20:11:08.753551 (+ 870us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:08.753573 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:08.753782 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:08.754411 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:08.754415 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:08.754441 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:08.754858 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:08.754869 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.756280 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.756285 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:08.758700 (+ 2415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:08.758715 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.760329 (+ 1614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.760335 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:08.760687 (+ 352us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:08.760724 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 20:11:08.761681 (+ 957us) client_negotiation.cc:240] Negotiation successful
0809 20:11:08.761901 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":707,"mutex_wait_us":12,"thread_start_us":537,"threads_started":1}
I20260809 20:11:08.762392 17282 leader_election.cc:302] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54c15d250c4486ebf60d244e0d85c78, afa3f8adc472405ea4452e70467d2a67; no voters:
I20260809 20:11:08.762753 17764 raft_consensus.cc:2781] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:11:08.762838 17764 raft_consensus.cc:482] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:11:08.762897 17764 raft_consensus.cc:3037] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:08.763303 17173 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c87b059645949a5aafbf1bc455b7580" candidate_uuid: "a54c15d250c4486ebf60d244e0d85c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b01671cb66cd450888dd319256d9ac30" is_pre_election: true
I20260809 20:11:08.763756 17173 raft_consensus.cc:2454] T 9c87b059645949a5aafbf1bc455b7580 P b01671cb66cd450888dd319256d9ac30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a54c15d250c4486ebf60d244e0d85c78 in term 0.
I20260809 20:11:08.765507 17764 raft_consensus.cc:504] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } }
I20260809 20:11:08.766088 17764 leader_election.cc:288] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78 [CANDIDATE]: Term 1 election: Requested vote from peers b01671cb66cd450888dd319256d9ac30 (127.14.181.1:34635), afa3f8adc472405ea4452e70467d2a67 (127.14.181.3:40659)
I20260809 20:11:08.766424 17173 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c87b059645949a5aafbf1bc455b7580" candidate_uuid: "a54c15d250c4486ebf60d244e0d85c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b01671cb66cd450888dd319256d9ac30"
I20260809 20:11:08.766637 17173 raft_consensus.cc:3037] T 9c87b059645949a5aafbf1bc455b7580 P b01671cb66cd450888dd319256d9ac30 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:08.769156 17173 raft_consensus.cc:2454] T 9c87b059645949a5aafbf1bc455b7580 P b01671cb66cd450888dd319256d9ac30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54c15d250c4486ebf60d244e0d85c78 in term 1.
I20260809 20:11:08.769534 17281 leader_election.cc:302] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a54c15d250c4486ebf60d244e0d85c78, b01671cb66cd450888dd319256d9ac30; no voters:
I20260809 20:11:08.769521 17648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c87b059645949a5aafbf1bc455b7580" candidate_uuid: "a54c15d250c4486ebf60d244e0d85c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afa3f8adc472405ea4452e70467d2a67"
I20260809 20:11:08.769717 17648 raft_consensus.cc:3037] T 9c87b059645949a5aafbf1bc455b7580 P afa3f8adc472405ea4452e70467d2a67 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:08.769820 17764 raft_consensus.cc:2781] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:08.770277 17764 raft_consensus.cc:686] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78 [term 1 LEADER]: Becoming Leader. State: Replica: a54c15d250c4486ebf60d244e0d85c78, State: Running, Role: LEADER
I20260809 20:11:08.770684 17764 consensus_queue.cc:237] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } }
I20260809 20:11:08.771988 17648 raft_consensus.cc:2454] T 9c87b059645949a5aafbf1bc455b7580 P afa3f8adc472405ea4452e70467d2a67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54c15d250c4486ebf60d244e0d85c78 in term 1.
I20260809 20:11:08.774312 16909 catalog_manager.cc:5495] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78 reported cstate change: term changed from 0 to 1, leader changed from <none> to a54c15d250c4486ebf60d244e0d85c78 (127.14.181.2). New cstate: current_term: 1 leader_uuid: "a54c15d250c4486ebf60d244e0d85c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } health_report { overall_health: UNKNOWN } } }
W20260809 20:11:08.822125 17731 tablet.cc:2369] T 9c87b059645949a5aafbf1bc455b7580 P afa3f8adc472405ea4452e70467d2a67: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 20:11:08 dist-test-slave-6zbq krb5kdc[16841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306266, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:08.855705 17817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:08.836873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:33119 (local address 127.0.0.1:45822)
0809 20:11:08.837461 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:08.837476 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:08.837605 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:08.837882 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:08.837886 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:08.838652 (+ 766us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:08.838963 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:08.838974 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.839931 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.839936 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:08.841123 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:08.841141 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.842163 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.842168 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:08.842327 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:08.845649 (+ 3322us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:08.845667 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:08.847995 (+ 2328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:08.851606 (+ 3611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:08.851618 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:08.851626 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:08.852173 (+ 547us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:08.853649 (+ 1476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:08.853654 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:08.853657 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:08.853847 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:08.854536 (+ 689us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:08.854544 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:08.854738 (+ 194us) client_negotiation.cc:769] Sending connection context
0809 20:11:08.854954 (+ 216us) client_negotiation.cc:240] Negotiation successful
0809 20:11:08.855246 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":323,"threads_started":1}
I20260809 20:11:08.855743 17071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:08.836854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45822 (local address 127.14.181.62:33119)
0809 20:11:08.837038 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:08.837044 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:08.837554 (+ 510us) server_negotiation.cc:407] Connection header received
0809 20:11:08.837706 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:08.837712 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:08.837767 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:08.837844 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:08.839101 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.839808 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.841298 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:08.841979 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:08.842131 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:08.848209 (+ 6078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:08.848222 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:08.848227 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:08.848265 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:08.851473 (+ 3208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:08.852319 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:08.852324 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:08.852328 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:08.852489 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:08.853989 (+ 1500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:08.853994 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:08.853996 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:08.854391 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:08.854529 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:08.855078 (+ 549us) server_negotiation.cc:299] Negotiation successful
0809 20:11:08.855397 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":91,"server-negotiator.queue_time_us":55}
I20260809 20:11:08.861730 16909 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:45822:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 20:11:08.863114 16909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260809 20:11:08.866992 17488 tablet.cc:2369] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:11:08.870606 17135 tablet_service.cc:1467] Processing CreateTablet for tablet 01e1a4cb18424d4c802bf1b0e6fefb1b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=39b64cfe6e6149acb23cfd9f37c906d8]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 20:11:08.870779 17361 tablet_service.cc:1467] Processing CreateTablet for tablet 01e1a4cb18424d4c802bf1b0e6fefb1b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=39b64cfe6e6149acb23cfd9f37c906d8]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 20:11:08.871230 17135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01e1a4cb18424d4c802bf1b0e6fefb1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:08.871256 17361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01e1a4cb18424d4c802bf1b0e6fefb1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:08.878082 17600 tablet_service.cc:1467] Processing CreateTablet for tablet 01e1a4cb18424d4c802bf1b0e6fefb1b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=39b64cfe6e6149acb23cfd9f37c906d8]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 20:11:08.878620 17600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01e1a4cb18424d4c802bf1b0e6fefb1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:08.880612 17761 tablet_bootstrap.cc:492] T 01e1a4cb18424d4c802bf1b0e6fefb1b P b01671cb66cd450888dd319256d9ac30: Bootstrap starting.
I20260809 20:11:08.882429 17761 tablet_bootstrap.cc:654] T 01e1a4cb18424d4c802bf1b0e6fefb1b P b01671cb66cd450888dd319256d9ac30: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:08.884013 17755 tablet_bootstrap.cc:492] T 01e1a4cb18424d4c802bf1b0e6fefb1b P a54c15d250c4486ebf60d244e0d85c78: Bootstrap starting.
I20260809 20:11:08.885229 17757 tablet_bootstrap.cc:492] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67: Bootstrap starting.
I20260809 20:11:08.885629 17755 tablet_bootstrap.cc:654] T 01e1a4cb18424d4c802bf1b0e6fefb1b P a54c15d250c4486ebf60d244e0d85c78: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:08.887015 17757 tablet_bootstrap.cc:654] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:08.887247 17761 tablet_bootstrap.cc:492] T 01e1a4cb18424d4c802bf1b0e6fefb1b P b01671cb66cd450888dd319256d9ac30: No bootstrap required, opened a new log
I20260809 20:11:08.887493 17761 ts_tablet_manager.cc:1397] T 01e1a4cb18424d4c802bf1b0e6fefb1b P b01671cb66cd450888dd319256d9ac30: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260809 20:11:08.889288 17761 raft_consensus.cc:348] T 01e1a4cb18424d4c802bf1b0e6fefb1b P b01671cb66cd450888dd319256d9ac30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } }
I20260809 20:11:08.889642 17761 raft_consensus.cc:374] T 01e1a4cb18424d4c802bf1b0e6fefb1b P b01671cb66cd450888dd319256d9ac30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:08.889796 17761 raft_consensus.cc:729] T 01e1a4cb18424d4c802bf1b0e6fefb1b P b01671cb66cd450888dd319256d9ac30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b01671cb66cd450888dd319256d9ac30, State: Initialized, Role: FOLLOWER
I20260809 20:11:08.891040 17761 consensus_queue.cc:260] T 01e1a4cb18424d4c802bf1b0e6fefb1b P b01671cb66cd450888dd319256d9ac30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } }
I20260809 20:11:08.893165 17772 tablet_replica.cc:439] T 01e1a4cb18424d4c802bf1b0e6fefb1b P b01671cb66cd450888dd319256d9ac30: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } } }
I20260809 20:11:08.893481 17772 tablet_replica.cc:442] T 01e1a4cb18424d4c802bf1b0e6fefb1b P b01671cb66cd450888dd319256d9ac30: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 20:11:08.894536 17761 ts_tablet_manager.cc:1428] T 01e1a4cb18424d4c802bf1b0e6fefb1b P b01671cb66cd450888dd319256d9ac30: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260809 20:11:08.899407 17757 tablet_bootstrap.cc:492] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67: No bootstrap required, opened a new log
I20260809 20:11:08.899580 17757 ts_tablet_manager.cc:1397] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.004s
I20260809 20:11:08.900110 17755 tablet_bootstrap.cc:492] T 01e1a4cb18424d4c802bf1b0e6fefb1b P a54c15d250c4486ebf60d244e0d85c78: No bootstrap required, opened a new log
I20260809 20:11:08.900332 17755 ts_tablet_manager.cc:1397] T 01e1a4cb18424d4c802bf1b0e6fefb1b P a54c15d250c4486ebf60d244e0d85c78: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.004s
I20260809 20:11:08.900507 17757 raft_consensus.cc:348] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } }
I20260809 20:11:08.900876 17757 raft_consensus.cc:374] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:08.900975 17757 raft_consensus.cc:729] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afa3f8adc472405ea4452e70467d2a67, State: Initialized, Role: FOLLOWER
I20260809 20:11:08.901342 17757 consensus_queue.cc:260] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } }
I20260809 20:11:08.901371 17755 raft_consensus.cc:348] T 01e1a4cb18424d4c802bf1b0e6fefb1b P a54c15d250c4486ebf60d244e0d85c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } }
I20260809 20:11:08.901714 17755 raft_consensus.cc:374] T 01e1a4cb18424d4c802bf1b0e6fefb1b P a54c15d250c4486ebf60d244e0d85c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:08.901858 17755 raft_consensus.cc:729] T 01e1a4cb18424d4c802bf1b0e6fefb1b P a54c15d250c4486ebf60d244e0d85c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54c15d250c4486ebf60d244e0d85c78, State: Initialized, Role: FOLLOWER
I20260809 20:11:08.901796 17766 tablet_replica.cc:439] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } } }
I20260809 20:11:08.902113 17766 tablet_replica.cc:442] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 20:11:08.902369 17755 consensus_queue.cc:260] T 01e1a4cb18424d4c802bf1b0e6fefb1b P a54c15d250c4486ebf60d244e0d85c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } }
I20260809 20:11:08.903195 17764 tablet_replica.cc:439] T 01e1a4cb18424d4c802bf1b0e6fefb1b P a54c15d250c4486ebf60d244e0d85c78: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } } }
I20260809 20:11:08.903483 17764 tablet_replica.cc:442] T 01e1a4cb18424d4c802bf1b0e6fefb1b P a54c15d250c4486ebf60d244e0d85c78: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 20:11:08.904613 17755 ts_tablet_manager.cc:1428] T 01e1a4cb18424d4c802bf1b0e6fefb1b P a54c15d250c4486ebf60d244e0d85c78: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260809 20:11:08.906570 17757 ts_tablet_manager.cc:1428] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67: Time spent starting tablet: real 0.007s user 0.002s sys 0.001s
I20260809 20:11:09.145093 17766 raft_consensus.cc:482] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:11:09.145295 17766 raft_consensus.cc:504] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } }
I20260809 20:11:09.146777 17766 leader_election.cc:288] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b01671cb66cd450888dd319256d9ac30 (127.14.181.1:34635), a54c15d250c4486ebf60d244e0d85c78 (127.14.181.2:37599)
I20260809 20:11:09.152946 17747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:09.147126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:43727 (local address 127.14.181.1:34635)
0809 20:11:09.147345 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:09.147352 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:09.148077 (+ 725us) server_negotiation.cc:407] Connection header received
0809 20:11:09.148277 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:09.148281 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:09.148343 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:09.148417 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:09.148912 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.149591 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.151329 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.152072 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.152229 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:09.152303 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:09.152558 (+ 255us) server_negotiation.cc:299] Negotiation successful
0809 20:11:09.152695 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 20:11:09.153020 17824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:09.146993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:34635 (local address 127.14.181.3:43727)
0809 20:11:09.147973 (+ 980us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:09.147989 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:09.148130 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:09.148452 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:09.148458 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:09.148485 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:09.148754 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:09.148764 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.149738 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.149742 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:09.151169 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:09.151185 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.152234 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.152241 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:09.152416 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:09.152442 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 20:11:09.152530 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 20:11:09.152669 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":871,"mutex_wait_us":1,"thread_start_us":779,"threads_started":1}
I20260809 20:11:09.153258 17826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:09.147170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:60913 (local address 127.14.181.2:37599)
0809 20:11:09.147795 (+ 625us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:09.147802 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:09.148230 (+ 428us) server_negotiation.cc:407] Connection header received
0809 20:11:09.148396 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:09.148400 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:09.148460 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:09.148541 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:09.149069 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.149787 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.151597 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.152344 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.152490 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:09.152559 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:09.152849 (+ 290us) server_negotiation.cc:299] Negotiation successful
0809 20:11:09.152979 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":493,"thread_start_us":380,"threads_started":1}
I20260809 20:11:09.153514 17825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:09.147049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:37599 (local address 127.14.181.3:60913)
0809 20:11:09.148131 (+ 1082us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:09.148147 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:09.148273 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:09.148579 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:09.148583 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:09.148607 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:09.148923 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:09.148933 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.149922 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.149928 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:09.151450 (+ 1522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:09.151464 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.152543 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.152549 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:09.152697 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:09.152720 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 20:11:09.152798 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 20:11:09.152917 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":964,"thread_start_us":877,"threads_started":1}
I20260809 20:11:09.153594 17173 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01e1a4cb18424d4c802bf1b0e6fefb1b" candidate_uuid: "afa3f8adc472405ea4452e70467d2a67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b01671cb66cd450888dd319256d9ac30" is_pre_election: true
I20260809 20:11:09.153836 17173 raft_consensus.cc:2454] T 01e1a4cb18424d4c802bf1b0e6fefb1b P b01671cb66cd450888dd319256d9ac30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afa3f8adc472405ea4452e70467d2a67 in term 0.
I20260809 20:11:09.154137 17408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01e1a4cb18424d4c802bf1b0e6fefb1b" candidate_uuid: "afa3f8adc472405ea4452e70467d2a67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54c15d250c4486ebf60d244e0d85c78" is_pre_election: true
I20260809 20:11:09.154253 17518 leader_election.cc:302] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afa3f8adc472405ea4452e70467d2a67, b01671cb66cd450888dd319256d9ac30; no voters:
I20260809 20:11:09.154420 17408 raft_consensus.cc:2454] T 01e1a4cb18424d4c802bf1b0e6fefb1b P a54c15d250c4486ebf60d244e0d85c78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afa3f8adc472405ea4452e70467d2a67 in term 0.
I20260809 20:11:09.154637 17766 raft_consensus.cc:2781] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:11:09.154772 17766 raft_consensus.cc:482] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:11:09.154871 17766 raft_consensus.cc:3037] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:09.157096 17766 raft_consensus.cc:504] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } }
I20260809 20:11:09.157594 17766 leader_election.cc:288] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67 [CANDIDATE]: Term 1 election: Requested vote from peers b01671cb66cd450888dd319256d9ac30 (127.14.181.1:34635), a54c15d250c4486ebf60d244e0d85c78 (127.14.181.2:37599)
I20260809 20:11:09.158010 17173 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01e1a4cb18424d4c802bf1b0e6fefb1b" candidate_uuid: "afa3f8adc472405ea4452e70467d2a67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b01671cb66cd450888dd319256d9ac30"
I20260809 20:11:09.158085 17408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01e1a4cb18424d4c802bf1b0e6fefb1b" candidate_uuid: "afa3f8adc472405ea4452e70467d2a67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54c15d250c4486ebf60d244e0d85c78"
I20260809 20:11:09.158183 17173 raft_consensus.cc:3037] T 01e1a4cb18424d4c802bf1b0e6fefb1b P b01671cb66cd450888dd319256d9ac30 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:09.158270 17408 raft_consensus.cc:3037] T 01e1a4cb18424d4c802bf1b0e6fefb1b P a54c15d250c4486ebf60d244e0d85c78 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:09.160054 17173 raft_consensus.cc:2454] T 01e1a4cb18424d4c802bf1b0e6fefb1b P b01671cb66cd450888dd319256d9ac30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afa3f8adc472405ea4452e70467d2a67 in term 1.
I20260809 20:11:09.160418 17408 raft_consensus.cc:2454] T 01e1a4cb18424d4c802bf1b0e6fefb1b P a54c15d250c4486ebf60d244e0d85c78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afa3f8adc472405ea4452e70467d2a67 in term 1.
I20260809 20:11:09.160418 17518 leader_election.cc:302] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afa3f8adc472405ea4452e70467d2a67, b01671cb66cd450888dd319256d9ac30; no voters:
I20260809 20:11:09.160715 17766 raft_consensus.cc:2781] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:09.161072 17766 raft_consensus.cc:686] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67 [term 1 LEADER]: Becoming Leader. State: Replica: afa3f8adc472405ea4452e70467d2a67, State: Running, Role: LEADER
I20260809 20:11:09.161422 17766 consensus_queue.cc:237] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } }
I20260809 20:11:09.163270 17827 tablet_replica.cc:439] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67: TxnStatusTablet state changed. Reason: New leader afa3f8adc472405ea4452e70467d2a67. Latest consensus state: current_term: 1 leader_uuid: "afa3f8adc472405ea4452e70467d2a67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } } }
I20260809 20:11:09.163659 17827 tablet_replica.cc:442] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67: This TxnStatusTablet replica's current role is: LEADER
I20260809 20:11:09.164322 17829 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 20:11:09.164568 17829 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 20:11:09.164896 16907 catalog_manager.cc:5495] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67 reported cstate change: term changed from 0 to 1, leader changed from <none> to afa3f8adc472405ea4452e70467d2a67 (127.14.181.3). New cstate: current_term: 1 leader_uuid: "afa3f8adc472405ea4452e70467d2a67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } health_report { overall_health: HEALTHY } } }
I20260809 20:11:09.186789 17817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:09.180407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:40659 (local address 127.0.0.1:57130)
0809 20:11:09.180653 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:09.180673 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:09.180820 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:09.181276 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:09.181281 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:09.181294 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 20:11:09.181507 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:09.181519 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.182579 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.182585 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:09.184189 (+ 1604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:09.184207 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.184990 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.184996 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:09.185157 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:09.185215 (+ 58us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 20:11:09.186209 (+ 994us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 20:11:09.186241 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 20:11:09.186316 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 20:11:09.186481 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 20:11:09.186674 17764 consensus_queue.cc:1035] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:11:09.186854 17754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:09.180508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57130 (local address 127.14.181.3:40659)
0809 20:11:09.180663 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:09.180668 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:09.180767 (+ 99us) server_negotiation.cc:407] Connection header received
0809 20:11:09.180991 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:09.180994 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:09.181109 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:09.181219 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:11:09.181631 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.182439 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.184327 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.184851 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.184967 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:09.185425 (+ 458us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:11:09.186084 (+ 659us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:11:09.186224 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:09.186422 (+ 198us) server_negotiation.cc:299] Negotiation successful
0809 20:11:09.186497 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 20:11:09.192004 17408 raft_consensus.cc:1261] T 01e1a4cb18424d4c802bf1b0e6fefb1b P a54c15d250c4486ebf60d244e0d85c78 [term 1 FOLLOWER]: Refusing update from remote peer afa3f8adc472405ea4452e70467d2a67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:11:09.192298 17173 raft_consensus.cc:1261] T 01e1a4cb18424d4c802bf1b0e6fefb1b P b01671cb66cd450888dd319256d9ac30 [term 1 FOLLOWER]: Refusing update from remote peer afa3f8adc472405ea4452e70467d2a67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:11:09.192896 17766 consensus_queue.cc:1035] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:11:09.193503 17766 consensus_queue.cc:1035] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:11:09.206089 17772 tablet_replica.cc:439] T 01e1a4cb18424d4c802bf1b0e6fefb1b P b01671cb66cd450888dd319256d9ac30: TxnStatusTablet state changed. Reason: New leader afa3f8adc472405ea4452e70467d2a67. Latest consensus state: current_term: 1 leader_uuid: "afa3f8adc472405ea4452e70467d2a67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } } }
I20260809 20:11:09.206364 17772 tablet_replica.cc:442] T 01e1a4cb18424d4c802bf1b0e6fefb1b P b01671cb66cd450888dd319256d9ac30: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 20:11:09.214962 17772 tablet_replica.cc:439] T 01e1a4cb18424d4c802bf1b0e6fefb1b P b01671cb66cd450888dd319256d9ac30: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "afa3f8adc472405ea4452e70467d2a67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } } }
I20260809 20:11:09.215188 17772 tablet_replica.cc:442] T 01e1a4cb18424d4c802bf1b0e6fefb1b P b01671cb66cd450888dd319256d9ac30: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 20:11:09.218739 17803 consensus_queue.cc:1035] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:11:09.219341 17766 tablet_replica.cc:439] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "afa3f8adc472405ea4452e70467d2a67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } } }
I20260809 20:11:09.219693 17766 tablet_replica.cc:442] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67: This TxnStatusTablet replica's current role is: LEADER
I20260809 20:11:09.223210 17764 tablet_replica.cc:439] T 01e1a4cb18424d4c802bf1b0e6fefb1b P a54c15d250c4486ebf60d244e0d85c78: TxnStatusTablet state changed. Reason: New leader afa3f8adc472405ea4452e70467d2a67. Latest consensus state: current_term: 1 leader_uuid: "afa3f8adc472405ea4452e70467d2a67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } } }
I20260809 20:11:09.223475 17764 tablet_replica.cc:442] T 01e1a4cb18424d4c802bf1b0e6fefb1b P a54c15d250c4486ebf60d244e0d85c78: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 20:11:09.227895 17827 tablet_replica.cc:439] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "afa3f8adc472405ea4452e70467d2a67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } } }
I20260809 20:11:09.228137 17827 tablet_replica.cc:442] T 01e1a4cb18424d4c802bf1b0e6fefb1b P afa3f8adc472405ea4452e70467d2a67: This TxnStatusTablet replica's current role is: LEADER
I20260809 20:11:09.229784 17838 mvcc.cc:205] Tried to move back new op lower bound from 7316710478603501568 to 7316710478488244224. Current Snapshot: MvccSnapshot[applied={T|T < 7316710478603501568}]
I20260809 20:11:09.236829 17826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:09.230191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33198 (local address 127.14.181.2:37599)
0809 20:11:09.230412 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:09.230419 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:09.230925 (+ 506us) server_negotiation.cc:407] Connection header received
0809 20:11:09.231186 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:09.231192 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:09.231283 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:09.231422 (+ 139us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:11:09.231842 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.232733 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.234093 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.234712 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.234831 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:09.235433 (+ 602us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:11:09.236104 (+ 671us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:11:09.236225 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:09.236462 (+ 237us) server_negotiation.cc:299] Negotiation successful
0809 20:11:09.236545 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 20:11:09.240587 17803 tablet_replica.cc:439] T 01e1a4cb18424d4c802bf1b0e6fefb1b P a54c15d250c4486ebf60d244e0d85c78: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "afa3f8adc472405ea4452e70467d2a67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b01671cb66cd450888dd319256d9ac30" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34635 } } peers { permanent_uuid: "a54c15d250c4486ebf60d244e0d85c78" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37599 } } peers { permanent_uuid: "afa3f8adc472405ea4452e70467d2a67" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40659 } } }
I20260809 20:11:09.240890 17803 tablet_replica.cc:442] T 01e1a4cb18424d4c802bf1b0e6fefb1b P a54c15d250c4486ebf60d244e0d85c78: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 20:11:09.255077 17867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:09.249116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:40659 (local address 127.14.181.2:45597)
0809 20:11:09.249749 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:09.249764 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:09.249870 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:09.250159 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:09.250162 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:09.250170 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 20:11:09.250490 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:09.250499 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.251893 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.251896 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:09.252953 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:09.252965 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.254012 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.254016 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:09.254127 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:09.254175 (+ 48us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 20:11:09.254594 (+ 419us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 20:11:09.254606 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 20:11:09.254687 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 20:11:09.254807 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":330,"threads_started":1}
I20260809 20:11:09.255089 17754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:09.249126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:45597 (local address 127.14.181.3:40659)
0809 20:11:09.249292 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:09.249298 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:09.249844 (+ 546us) server_negotiation.cc:407] Connection header received
0809 20:11:09.249976 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:09.249981 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:09.250057 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:09.250151 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:11:09.250620 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.251770 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.253082 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.253847 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.253990 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:09.254371 (+ 381us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:11:09.254493 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:11:09.254585 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:09.254727 (+ 142us) server_negotiation.cc:299] Negotiation successful
0809 20:11:09.254802 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 20:11:09.304370 17826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:09.289549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:45309 (local address 127.14.181.2:37599)
0809 20:11:09.289722 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:09.289729 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:09.298969 (+ 9240us) server_negotiation.cc:407] Connection header received
0809 20:11:09.299174 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:09.299179 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:09.299267 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:09.299348 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:11:09.300084 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.300879 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.302425 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.302974 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.303094 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:09.303612 (+ 518us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:11:09.303742 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:11:09.303834 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:09.303989 (+ 155us) server_negotiation.cc:299] Negotiation successful
0809 20:11:09.304072 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 20:11:09.304803 17873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:09.289449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:37599 (local address 127.14.181.3:45309)
0809 20:11:09.298871 (+ 9422us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:09.298891 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:09.299032 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:09.299379 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:09.299385 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:09.299398 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 20:11:09.299846 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:09.299902 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.301019 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.301025 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:09.302274 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:09.302286 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.303226 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.303231 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:09.303356 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:09.303431 (+ 75us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 20:11:09.303849 (+ 418us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 20:11:09.303867 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 20:11:09.303961 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 20:11:09.304389 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9211,"thread_start_us":9084,"threads_started":1}
I20260809 20:11:09.355866 16905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45816:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:11:09.356139 16905 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45816:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:11:09.359731 16905 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2dcaa14b9e6b4454853956902ebed12b: Sending DeleteTablet for 3 replicas of tablet 9c87b059645949a5aafbf1bc455b7580
I20260809 20:11:09.360538 17361 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c87b059645949a5aafbf1bc455b7580 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:09 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:33186
I20260809 20:11:09.360651 17135 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c87b059645949a5aafbf1bc455b7580 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:09 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:51440
I20260809 20:11:09.361061 17600 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c87b059645949a5aafbf1bc455b7580 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:09 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:57118
I20260809 20:11:09.380245 17878 tablet_replica.cc:330] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78: stopping tablet replica
I20260809 20:11:09.380461 17878 raft_consensus.cc:2229] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78 [term 1 LEADER]: Raft consensus shutting down.
I20260809 20:11:09.381054 17878 raft_consensus.cc:2258] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:09.382274 17878 ts_tablet_manager.cc:1905] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:09.382936 17880 tablet_replica.cc:330] T 9c87b059645949a5aafbf1bc455b7580 P b01671cb66cd450888dd319256d9ac30: stopping tablet replica
I20260809 20:11:09.383144 17880 raft_consensus.cc:2229] T 9c87b059645949a5aafbf1bc455b7580 P b01671cb66cd450888dd319256d9ac30 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:11:09.383404 17880 raft_consensus.cc:2258] T 9c87b059645949a5aafbf1bc455b7580 P b01671cb66cd450888dd319256d9ac30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:09.384500 17880 ts_tablet_manager.cc:1905] T 9c87b059645949a5aafbf1bc455b7580 P b01671cb66cd450888dd319256d9ac30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:09.389982 17881 tablet_replica.cc:330] T 9c87b059645949a5aafbf1bc455b7580 P afa3f8adc472405ea4452e70467d2a67: stopping tablet replica
I20260809 20:11:09.390197 17881 raft_consensus.cc:2229] T 9c87b059645949a5aafbf1bc455b7580 P afa3f8adc472405ea4452e70467d2a67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:11:09.390502 17881 raft_consensus.cc:2258] T 9c87b059645949a5aafbf1bc455b7580 P afa3f8adc472405ea4452e70467d2a67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:09.391527 17878 ts_tablet_manager.cc:1918] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 20:11:09.391642 17878 log.cc:1196] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-1/wal/wals/9c87b059645949a5aafbf1bc455b7580
I20260809 20:11:09.391661 17881 ts_tablet_manager.cc:1905] T 9c87b059645949a5aafbf1bc455b7580 P afa3f8adc472405ea4452e70467d2a67: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:09.392055 17878 ts_tablet_manager.cc:1939] T 9c87b059645949a5aafbf1bc455b7580 P a54c15d250c4486ebf60d244e0d85c78: Deleting consensus metadata
I20260809 20:11:09.393064 16891 catalog_manager.cc:4841] TS a54c15d250c4486ebf60d244e0d85c78 (127.14.181.2:37599): tablet 9c87b059645949a5aafbf1bc455b7580 (table test-table [id=305c90edb25945b08456c94c8abf6d77]) successfully deleted
I20260809 20:11:09.398970 17881 ts_tablet_manager.cc:1918] T 9c87b059645949a5aafbf1bc455b7580 P afa3f8adc472405ea4452e70467d2a67: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 20:11:09.399132 17881 log.cc:1196] T 9c87b059645949a5aafbf1bc455b7580 P afa3f8adc472405ea4452e70467d2a67: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-2/wal/wals/9c87b059645949a5aafbf1bc455b7580
I20260809 20:11:09.399616 17881 ts_tablet_manager.cc:1939] T 9c87b059645949a5aafbf1bc455b7580 P afa3f8adc472405ea4452e70467d2a67: Deleting consensus metadata
I20260809 20:11:09.400758 16888 catalog_manager.cc:4841] TS afa3f8adc472405ea4452e70467d2a67 (127.14.181.3:40659): tablet 9c87b059645949a5aafbf1bc455b7580 (table test-table [id=305c90edb25945b08456c94c8abf6d77]) successfully deleted
Aug 09 20:11:09 dist-test-slave-6zbq krb5kdc[16841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306268, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.181.1@KRBTEST.COM
I20260809 20:11:09.405613 17880 ts_tablet_manager.cc:1918] T 9c87b059645949a5aafbf1bc455b7580 P b01671cb66cd450888dd319256d9ac30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 20:11:09.405747 17880 log.cc:1196] T 9c87b059645949a5aafbf1bc455b7580 P b01671cb66cd450888dd319256d9ac30: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786306256699363-15060-0/minicluster-data/ts-0/wal/wals/9c87b059645949a5aafbf1bc455b7580
I20260809 20:11:09.406160 17880 ts_tablet_manager.cc:1939] T 9c87b059645949a5aafbf1bc455b7580 P b01671cb66cd450888dd319256d9ac30: Deleting consensus metadata
I20260809 20:11:09.407193 16887 catalog_manager.cc:4841] TS b01671cb66cd450888dd319256d9ac30 (127.14.181.1:34635): tablet 9c87b059645949a5aafbf1bc455b7580 (table test-table [id=305c90edb25945b08456c94c8abf6d77]) successfully deleted
I20260809 20:11:09.413700 17747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:09.387747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51458 (local address 127.14.181.1:34635)
0809 20:11:09.387927 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:09.387934 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:09.393903 (+ 5969us) server_negotiation.cc:407] Connection header received
0809 20:11:09.394540 (+ 637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:09.394545 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:09.394620 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:09.394688 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:09.396744 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.397864 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.399730 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.400380 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.400481 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:09.405961 (+ 5480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:09.405975 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:09.405994 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:09.406044 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:09.409975 (+ 3931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:09.410879 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:09.410890 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:09.410894 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:09.411061 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:09.411540 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:09.411546 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:09.411549 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:09.411997 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:09.412357 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:09.412959 (+ 602us) server_negotiation.cc:299] Negotiation successful
0809 20:11:09.413209 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260809 20:11:09.414772 17243 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51458
I20260809 20:11:09.442641 17890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:09.425372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45824 (local address 127.14.181.62:33119)
0809 20:11:09.426150 (+ 778us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:09.426157 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:09.426176 (+ 19us) server_negotiation.cc:407] Connection header received
0809 20:11:09.426236 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:09.426241 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:09.426380 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:09.428188 (+ 1808us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:09.428352 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.429535 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.431442 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.432059 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.435168 (+ 3109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:09.435421 (+ 253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:09.435427 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:09.435432 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:09.435463 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:09.438955 (+ 3492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:09.439763 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:09.439769 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:09.439772 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:09.439915 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:09.440351 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:09.440356 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:09.440360 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:09.440710 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:09.441857 (+ 1147us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:09.442003 (+ 146us) server_negotiation.cc:299] Negotiation successful
0809 20:11:09.442236 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":647,"thread_start_us":490,"threads_started":1}
W20260809 20:11:09.443238 16905 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45824
I20260809 20:11:09.445456 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 17037
I20260809 20:11:09.462076 17747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:09.446921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51460 (local address 127.14.181.1:34635)
0809 20:11:09.447213 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:09.447218 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:09.447236 (+ 18us) server_negotiation.cc:407] Connection header received
0809 20:11:09.447383 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:09.447389 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:09.447473 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:09.447539 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:09.449089 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.450130 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.452007 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.452563 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.452686 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:09.455406 (+ 2720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:09.455413 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:09.455418 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:09.455479 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:09.458923 (+ 3444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:09.459694 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:09.459699 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:09.459703 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:09.459859 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:09.460344 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:09.460349 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:09.460353 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:09.460678 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:09.460913 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:09.461505 (+ 592us) server_negotiation.cc:299] Negotiation successful
0809 20:11:09.461730 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170}
W20260809 20:11:09.463408 17243 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51460
W20260809 20:11:09.463973 15060 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 17037: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 20:11:09.464182 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 17037
I20260809 20:11:09.498759 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 17257
Aug 09 20:11:09 dist-test-slave-6zbq krb5kdc[16841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306268, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.181.2@KRBTEST.COM
I20260809 20:11:09.513347 17826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:09.499423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33202 (local address 127.14.181.2:37599)
0809 20:11:09.499613 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:09.499619 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:09.499738 (+ 119us) server_negotiation.cc:407] Connection header received
0809 20:11:09.499919 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:09.499923 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:09.499995 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:09.500078 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:09.501359 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.502212 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.503453 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.503885 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.503991 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:09.507702 (+ 3711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:09.507713 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:09.507726 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:09.507764 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:09.510518 (+ 2754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:09.511217 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:09.511231 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:09.511233 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:09.511408 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:09.511823 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:09.511827 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:09.511829 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:09.512235 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:09.512509 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:09.512783 (+ 274us) server_negotiation.cc:299] Negotiation successful
0809 20:11:09.513005 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260809 20:11:09.513962 17481 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33202
W20260809 20:11:09.514581 15060 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 17257: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 20:11:09.514734 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 17257
I20260809 20:11:09.541045 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 17492
Aug 09 20:11:09 dist-test-slave-6zbq krb5kdc[16841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306268, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.181.3@KRBTEST.COM
I20260809 20:11:09.555919 17754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:09.541713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57134 (local address 127.14.181.3:40659)
0809 20:11:09.541881 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:09.541887 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:09.541974 (+ 87us) server_negotiation.cc:407] Connection header received
0809 20:11:09.542136 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:09.542142 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:09.542219 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:09.542322 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:09.543525 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.544285 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.545493 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:09.545953 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:09.546057 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:09.550155 (+ 4098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:09.550167 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:09.550179 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:09.550215 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:09.553165 (+ 2950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:09.553765 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:09.553772 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:09.553777 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:09.553926 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:09.554264 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:09.554268 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:09.554270 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:09.554778 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:09.555122 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:09.555343 (+ 221us) server_negotiation.cc:299] Negotiation successful
0809 20:11:09.555546 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260809 20:11:09.556788 17718 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57134
W20260809 20:11:09.557399 15060 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 17492: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 20:11:09.557540 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 17492
I20260809 20:11:09.582149 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 16858
I20260809 20:11:09.583227 16981 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:09.694927 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 16858
2026-08-09T20:11:09Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (4639 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:11:09 dist-test-slave-6zbq krb5kdc[17895](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:11:09 dist-test-slave-6zbq krb5kdc[17895](info): set up 2 sockets
Aug 09 20:11:09 dist-test-slave-6zbq krb5kdc[17895](info): commencing operation
krb5kdc: starting...
W20260809 20:11:10.983958 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.243s user 0.005s sys 0.013s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260809 20:11:11.171578 15060 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.187s user 0.000s sys 0.008s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260809 20:11:11.308544 15060 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.137s user 0.001s sys 0.005s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260809 20:11:11.542939 15060 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.234s user 0.001s sys 0.005s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/test-user.keytab.
W20260809 20:11:11.956334 15060 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.413s user 0.001s sys 0.005s
Aug 09 20:11:11 dist-test-slave-6zbq krb5kdc[17895](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306271, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:11:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:11:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:11:12.032030 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:36821
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:37375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:36821
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:12.345947 17923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:12.346237 17923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:12.346395 17923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:12.353288 17923 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:11:12.353390 17923 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 20:11:12.353461 17923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:12.353549 17923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:12.353611 17923 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:11:12.353696 17923 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:11:12.363078 17923 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:37375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:36821
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:36821
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:12.364254 17923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:12.365499 17923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:12.376210 17934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:12.376235 17937 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:12.376457 17931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:12.376922 17923 server_base.cc:1034] running on GCE node
I20260809 20:11:12.377635 17923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:12.378924 17923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:12.380138 17923 hybrid_clock.cc:648] HybridClock initialized: now 1786306272380069 us; error 41 us; skew 500 ppm
I20260809 20:11:12.380432 17923 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:12 dist-test-slave-6zbq krb5kdc[17895](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306272, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:12.383339 17923 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:11:12.384605 17923 webserver.cc:460] Webserver started at http://127.14.181.62:41473/ using document root <none> and password file <none>
I20260809 20:11:12.385232 17923 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:12.385337 17923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:12.385627 17923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:12.388403 17923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "7b67434792d9426eb98364d99a9ae2b9"
format_stamp: "Formatted at 2026-08-09 20:11:12 on dist-test-slave-6zbq"
server_key: "a9832466c2e278945779da3a0cd173a0"
server_key_iv: "20b6519a3251c9500b9f095d78520076"
server_key_version: "encryptionkey@0"
I20260809 20:11:12.389138 17923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "7b67434792d9426eb98364d99a9ae2b9"
format_stamp: "Formatted at 2026-08-09 20:11:12 on dist-test-slave-6zbq"
server_key: "a9832466c2e278945779da3a0cd173a0"
server_key_iv: "20b6519a3251c9500b9f095d78520076"
server_key_version: "encryptionkey@0"
I20260809 20:11:12.394140 17923 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260809 20:11:12.397246 17951 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:12.398423 17923 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260809 20:11:12.398571 17923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "7b67434792d9426eb98364d99a9ae2b9"
format_stamp: "Formatted at 2026-08-09 20:11:12 on dist-test-slave-6zbq"
server_key: "a9832466c2e278945779da3a0cd173a0"
server_key_iv: "20b6519a3251c9500b9f095d78520076"
server_key_version: "encryptionkey@0"
I20260809 20:11:12.398770 17923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:12.420763 17923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:12.424188 17923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:12.424403 17923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:12.443475 17923 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:36821
I20260809 20:11:12.443497 18055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:36821 every 8 connection(s)
I20260809 20:11:12.444609 17923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:11:12.446058 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 17923
I20260809 20:11:12.446261 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:11:12.447118 15060 external_mini_cluster.cc:1428] Setting key 83a90e4ce8c852be7d53f01026fb598a
I20260809 20:11:12.448844 18058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 20:11:12 dist-test-slave-6zbq krb5kdc[17895](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306271, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:12.461669 18058 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b67434792d9426eb98364d99a9ae2b9: Bootstrap starting.
I20260809 20:11:12.464655 18058 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b67434792d9426eb98364d99a9ae2b9: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:12.465822 18058 log.cc:824] T 00000000000000000000000000000000 P 7b67434792d9426eb98364d99a9ae2b9: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:12.468616 18061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:12.449011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56420 (local address 127.14.181.62:36821)
0809 20:11:12.449726 (+ 715us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:12.449737 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:12.449775 (+ 38us) server_negotiation.cc:407] Connection header received
0809 20:11:12.451323 (+ 1548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:12.451343 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:12.451694 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:12.451991 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:12.453657 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:12.454973 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:12.456650 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:12.457256 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:12.457377 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:12.461892 (+ 4515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:12.461899 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:12.461912 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:12.461945 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:12.464677 (+ 2732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:12.465418 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:12.465424 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:12.465430 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:12.465581 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:12.465988 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:12.465993 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:12.465995 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:12.466644 (+ 649us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:12.466942 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:12.467252 (+ 310us) server_negotiation.cc:299] Negotiation successful
0809 20:11:12.467557 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":527,"thread_start_us":327,"threads_started":1}
I20260809 20:11:12.468830 18058 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b67434792d9426eb98364d99a9ae2b9: No bootstrap required, opened a new log
I20260809 20:11:12.476496 18058 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b67434792d9426eb98364d99a9ae2b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b67434792d9426eb98364d99a9ae2b9" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 36821 } }
I20260809 20:11:12.476791 18058 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7b67434792d9426eb98364d99a9ae2b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:12.476883 18058 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b67434792d9426eb98364d99a9ae2b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b67434792d9426eb98364d99a9ae2b9, State: Initialized, Role: FOLLOWER
I20260809 20:11:12.477401 18058 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b67434792d9426eb98364d99a9ae2b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b67434792d9426eb98364d99a9ae2b9" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 36821 } }
I20260809 20:11:12.477599 18058 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7b67434792d9426eb98364d99a9ae2b9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:11:12.477727 18058 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b67434792d9426eb98364d99a9ae2b9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:11:12.477895 18058 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b67434792d9426eb98364d99a9ae2b9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:12.479938 18058 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b67434792d9426eb98364d99a9ae2b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b67434792d9426eb98364d99a9ae2b9" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 36821 } }
I20260809 20:11:12.480372 18058 leader_election.cc:302] T 00000000000000000000000000000000 P 7b67434792d9426eb98364d99a9ae2b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7b67434792d9426eb98364d99a9ae2b9; no voters:
I20260809 20:11:12.480849 18058 leader_election.cc:288] T 00000000000000000000000000000000 P 7b67434792d9426eb98364d99a9ae2b9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:11:12.480943 18065 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b67434792d9426eb98364d99a9ae2b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:12.482004 18065 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b67434792d9426eb98364d99a9ae2b9 [term 1 LEADER]: Becoming Leader. State: Replica: 7b67434792d9426eb98364d99a9ae2b9, State: Running, Role: LEADER
I20260809 20:11:12.482511 18065 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b67434792d9426eb98364d99a9ae2b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b67434792d9426eb98364d99a9ae2b9" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 36821 } }
I20260809 20:11:12.482764 18058 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b67434792d9426eb98364d99a9ae2b9 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:11:12.485018 18067 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b67434792d9426eb98364d99a9ae2b9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b67434792d9426eb98364d99a9ae2b9. Latest consensus state: current_term: 1 leader_uuid: "7b67434792d9426eb98364d99a9ae2b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b67434792d9426eb98364d99a9ae2b9" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 36821 } } }
I20260809 20:11:12.485414 18067 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b67434792d9426eb98364d99a9ae2b9 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:12.485518 18066 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b67434792d9426eb98364d99a9ae2b9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7b67434792d9426eb98364d99a9ae2b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b67434792d9426eb98364d99a9ae2b9" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 36821 } } }
I20260809 20:11:12.485808 18066 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b67434792d9426eb98364d99a9ae2b9 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:12.487754 18075 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:11:12.492203 18075 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:11:12.500376 18075 catalog_manager.cc:1347] Generated new cluster ID: 4ceef1ec8a6d404da7551540844ba3c3
I20260809 20:11:12.500460 18075 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:11:12.517704 18075 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:11:12.519076 18075 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:11:12.525620 18075 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7b67434792d9426eb98364d99a9ae2b9: Generated new TSK 0
I20260809 20:11:12.526253 18075 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.181.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
I20260809 20:11:12.575382 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:0
--local_ip_for_outbound_sockets=127.14.181.1
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:36821
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:37375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:12.885488 18098 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:12.885746 18098 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:12.885890 18098 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:12.892985 18098 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:12.893090 18098 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:12.893209 18098 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 20:11:12.893276 18098 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 20:11:12.893383 18098 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:11:12.902801 18098 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:37375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.181.62:36821
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:12.903919 18098 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:12.905126 18098 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:12.917434 18113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:12.917469 18111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:12.917668 18110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:12.918334 18098 server_base.cc:1034] running on GCE node
I20260809 20:11:12.918905 18098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:12.919696 18098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:12.920882 18098 hybrid_clock.cc:648] HybridClock initialized: now 1786306272920844 us; error 30 us; skew 500 ppm
I20260809 20:11:12.921165 18098 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:12 dist-test-slave-6zbq krb5kdc[17895](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306272, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:12.927026 18098 init.cc:377] Logged in from keytab as kudu/127.14.181.1@KRBTEST.COM (short username kudu)
I20260809 20:11:12.928395 18098 webserver.cc:460] Webserver started at http://127.14.181.1:45933/ using document root <none> and password file <none>
I20260809 20:11:12.928982 18098 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:12.929080 18098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:12.929325 18098 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:12.931981 18098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-0/data/instance:
uuid: "8f9eecd9faa64e16ba4383e5ad0def66"
format_stamp: "Formatted at 2026-08-09 20:11:12 on dist-test-slave-6zbq"
server_key: "063586add4254d116209bcbe7f9e59c6"
server_key_iv: "03b90670f1b842dc1c5c176fa2c8a32f"
server_key_version: "encryptionkey@0"
I20260809 20:11:12.932822 18098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance:
uuid: "8f9eecd9faa64e16ba4383e5ad0def66"
format_stamp: "Formatted at 2026-08-09 20:11:12 on dist-test-slave-6zbq"
server_key: "063586add4254d116209bcbe7f9e59c6"
server_key_iv: "03b90670f1b842dc1c5c176fa2c8a32f"
server_key_version: "encryptionkey@0"
I20260809 20:11:12.937597 18098 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 20:11:12.940778 18126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:12.941964 18098 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 20:11:12.942104 18098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "8f9eecd9faa64e16ba4383e5ad0def66"
format_stamp: "Formatted at 2026-08-09 20:11:12 on dist-test-slave-6zbq"
server_key: "063586add4254d116209bcbe7f9e59c6"
server_key_iv: "03b90670f1b842dc1c5c176fa2c8a32f"
server_key_version: "encryptionkey@0"
I20260809 20:11:12.942270 18098 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:12.961508 18098 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:12.964986 18098 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:12.965229 18098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:12.967762 18098 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:12.967880 18098 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:12.967999 18098 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:12.968081 18098 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 20:11:12 dist-test-slave-6zbq krb5kdc[17895](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306272, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:12.990549 18061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:12.968156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:59833 (local address 127.14.181.62:36821)
0809 20:11:12.968328 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:12.968335 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:12.969684 (+ 1349us) server_negotiation.cc:407] Connection header received
0809 20:11:12.971632 (+ 1948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:12.971638 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:12.971719 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:12.971806 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:12.973724 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:12.974623 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:12.977432 (+ 2809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:12.977970 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:12.978084 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:12.982554 (+ 4470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:12.982561 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:12.982566 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:12.982618 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:12.985677 (+ 3059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:12.986314 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:12.986320 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:12.986324 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:12.986484 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:12.987042 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:12.987047 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:12.987051 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:12.987438 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:12.987584 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:12.989961 (+ 2377us) server_negotiation.cc:299] Negotiation successful
0809 20:11:12.990204 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 20:11:12.990513 18148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:12.968794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:36821 (local address 127.14.181.1:59833)
0809 20:11:12.969535 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:12.969576 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:12.971369 (+ 1793us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:12.972063 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:12.972074 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:12.972744 (+ 670us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:12.973555 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:12.973577 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:12.974808 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:12.974815 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:12.977289 (+ 2474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:12.977305 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:12.978231 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:12.978241 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:12.978484 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:12.979241 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:12.979284 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:12.982254 (+ 2970us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:12.985805 (+ 3551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:12.985814 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:12.985827 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:12.986205 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:12.986591 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:12.986600 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:12.986603 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:12.986895 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:12.987660 (+ 765us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:12.987668 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:12.988080 (+ 412us) client_negotiation.cc:769] Sending connection context
0809 20:11:12.988450 (+ 370us) client_negotiation.cc:240] Negotiation successful
0809 20:11:12.988990 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":333,"threads_started":1}
I20260809 20:11:13.008960 18061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:12.996106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:40275 (local address 127.14.181.62:36821)
0809 20:11:12.996552 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:12.996557 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:12.996899 (+ 342us) server_negotiation.cc:407] Connection header received
0809 20:11:12.997040 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:12.997046 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:12.997127 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:12.997203 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:12.998093 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:12.998922 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:13.000814 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:13.001326 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:13.001462 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:13.003464 (+ 2002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:13.003470 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:13.003475 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:13.003512 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:13.006305 (+ 2793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:13.007150 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:13.007155 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:13.007158 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:13.007305 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:13.007684 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:13.007689 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:13.007693 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:13.007942 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:13.008087 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:13.008453 (+ 366us) server_negotiation.cc:299] Negotiation successful
0809 20:11:13.008640 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320}
I20260809 20:11:13.009079 18271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:12.996252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:36821 (local address 127.14.181.1:40275)
0809 20:11:12.996801 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:12.996819 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:12.996939 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:12.997240 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:12.997244 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:12.997698 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:12.997967 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:12.997977 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:12.999040 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:12.999045 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:13.000669 (+ 1624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:13.000688 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:13.001717 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:13.001722 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:13.001913 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:13.002529 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:13.002545 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:13.003294 (+ 749us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:13.006490 (+ 3196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:13.006499 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:13.006502 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:13.007000 (+ 498us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:13.007438 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:13.007443 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:13.007447 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:13.007567 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:13.008056 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:13.008060 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:13.008229 (+ 169us) client_negotiation.cc:769] Sending connection context
0809 20:11:13.008348 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 20:11:13.008640 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":312,"threads_started":1}
I20260809 20:11:13.013001 18098 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:44585
I20260809 20:11:13.013046 18326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:44585 every 8 connection(s)
I20260809 20:11:13.014065 18098 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:11:13.015861 18327 heartbeater.cc:347] Connected to a master server at 127.14.181.62:36821
I20260809 20:11:13.016054 18327 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:13.016618 18327 heartbeater.cc:511] Master 127.14.181.62:36821 requested a full tablet report, sending...
I20260809 20:11:13.018329 17982 ts_manager.cc:194] Registered new tserver with Master: 8f9eecd9faa64e16ba4383e5ad0def66 (127.14.181.1:44585)
I20260809 20:11:13.019685 17982 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.1@KRBTEST.COM'} at 127.14.181.1:59833
I20260809 20:11:13.022182 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 18098
I20260809 20:11:13.022374 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance
I20260809 20:11:13.022953 15060 external_mini_cluster.cc:1428] Setting key 2c1fac87fe0f673b4823969455b473ec
WARNING: no policy specified for kudu/127.14.181.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
I20260809 20:11:13.059523 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:0
--local_ip_for_outbound_sockets=127.14.181.2
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:36821
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:37375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:13.368027 18331 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:13.368306 18331 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:13.368439 18331 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:13.375334 18331 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:13.375438 18331 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:13.375560 18331 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 20:11:13.375627 18331 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 20:11:13.375738 18331 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:11:13.385038 18331 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:37375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.181.62:36821
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:13.386158 18331 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:13.387374 18331 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:13.399262 18337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:13.399302 18341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:13.399272 18336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:13.399998 18331 server_base.cc:1034] running on GCE node
I20260809 20:11:13.400494 18331 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:13.401281 18331 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:13.402419 18331 hybrid_clock.cc:648] HybridClock initialized: now 1786306273402371 us; error 37 us; skew 500 ppm
I20260809 20:11:13.402673 18331 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:13 dist-test-slave-6zbq krb5kdc[17895](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306273, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:13.405547 18331 init.cc:377] Logged in from keytab as kudu/127.14.181.2@KRBTEST.COM (short username kudu)
I20260809 20:11:13.406816 18331 webserver.cc:460] Webserver started at http://127.14.181.2:41931/ using document root <none> and password file <none>
I20260809 20:11:13.407403 18331 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:13.407507 18331 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:13.407781 18331 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:13.410508 18331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-1/data/instance:
uuid: "70528b1b04a34d20927fbc1694432d7e"
format_stamp: "Formatted at 2026-08-09 20:11:13 on dist-test-slave-6zbq"
server_key: "36f443a9d9494ac347502d5a63cb6e52"
server_key_iv: "608fd358dc8252caee3a8da67631b45e"
server_key_version: "encryptionkey@0"
I20260809 20:11:13.411209 18331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance:
uuid: "70528b1b04a34d20927fbc1694432d7e"
format_stamp: "Formatted at 2026-08-09 20:11:13 on dist-test-slave-6zbq"
server_key: "36f443a9d9494ac347502d5a63cb6e52"
server_key_iv: "608fd358dc8252caee3a8da67631b45e"
server_key_version: "encryptionkey@0"
I20260809 20:11:13.415997 18331 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 20:11:13.419098 18351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:13.420250 18331 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:11:13.420387 18331 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "70528b1b04a34d20927fbc1694432d7e"
format_stamp: "Formatted at 2026-08-09 20:11:13 on dist-test-slave-6zbq"
server_key: "36f443a9d9494ac347502d5a63cb6e52"
server_key_iv: "608fd358dc8252caee3a8da67631b45e"
server_key_version: "encryptionkey@0"
I20260809 20:11:13.420557 18331 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:13.483831 18331 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:13.488270 18331 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:13.488534 18331 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:13.491214 18331 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:13.491324 18331 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:13.491429 18331 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:13.491518 18331 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 20:11:13 dist-test-slave-6zbq krb5kdc[17895](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306273, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:13.513391 18061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:13.491527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:53573 (local address 127.14.181.62:36821)
0809 20:11:13.491714 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:13.491720 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:13.493048 (+ 1328us) server_negotiation.cc:407] Connection header received
0809 20:11:13.495233 (+ 2185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:13.495240 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:13.495329 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:13.495458 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:13.497546 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:13.498712 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:13.500956 (+ 2244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:13.501613 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:13.501772 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:13.506769 (+ 4997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:13.506776 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:13.506781 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:13.506821 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:13.509666 (+ 2845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:13.510718 (+ 1052us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:13.510724 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:13.510728 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:13.510882 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:13.511458 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:13.511464 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:13.511468 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:13.511738 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:13.511849 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:13.512866 (+ 1017us) server_negotiation.cc:299] Negotiation successful
0809 20:11:13.513115 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 20:11:13.515273 18368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:13.492047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:36821 (local address 127.14.181.2:53573)
0809 20:11:13.492890 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:13.492936 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:13.494916 (+ 1980us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:13.495745 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:13.495755 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:13.496472 (+ 717us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:13.497327 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:13.497354 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:13.498899 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:13.498904 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:13.500822 (+ 1918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:13.500835 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:13.502070 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:13.502078 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:13.502373 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:13.503173 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:13.503206 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:13.506523 (+ 3317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:13.509817 (+ 3294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:13.509826 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:13.509846 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:13.510581 (+ 735us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:13.511008 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:13.511013 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:13.511017 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:13.511316 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:13.511860 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:13.511868 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:13.512361 (+ 493us) client_negotiation.cc:769] Sending connection context
0809 20:11:13.512746 (+ 385us) client_negotiation.cc:240] Negotiation successful
0809 20:11:13.513644 (+ 898us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":361,"threads_started":1}
I20260809 20:11:13.530380 18331 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:35553
I20260809 20:11:13.530485 18549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:35553 every 8 connection(s)
I20260809 20:11:13.531580 18331 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:11:13.533470 18550 heartbeater.cc:347] Connected to a master server at 127.14.181.62:36821
I20260809 20:11:13.533685 18550 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:13.534454 18550 heartbeater.cc:511] Master 127.14.181.62:36821 requested a full tablet report, sending...
I20260809 20:11:13.534773 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 18331
I20260809 20:11:13.534950 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance
I20260809 20:11:13.535446 15060 external_mini_cluster.cc:1428] Setting key 1cde6983f36360e96d7a077049e14478
I20260809 20:11:13.535959 17982 ts_manager.cc:194] Registered new tserver with Master: 70528b1b04a34d20927fbc1694432d7e (127.14.181.2:35553)
I20260809 20:11:13.536494 18504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:13.522189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:36821 (local address 127.14.181.2:41541)
0809 20:11:13.522820 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:13.522842 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:13.523037 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:13.523353 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:13.523358 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:13.524009 (+ 651us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:13.524528 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:13.524545 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:13.526048 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:13.526054 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:13.527748 (+ 1694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:13.527765 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:13.528729 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:13.528733 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:13.528841 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:13.529420 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:13.529441 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:13.530556 (+ 1115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:13.533951 (+ 3395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:13.533954 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:13.533957 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:13.534365 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:13.534730 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:13.534736 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:13.534740 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:13.534857 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:13.535499 (+ 642us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:13.535503 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:13.535673 (+ 170us) client_negotiation.cc:769] Sending connection context
0809 20:11:13.535809 (+ 136us) client_negotiation.cc:240] Negotiation successful
0809 20:11:13.536082 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":331,"threads_started":1}
I20260809 20:11:13.537358 18061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:13.522061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:41541 (local address 127.14.181.62:36821)
0809 20:11:13.522224 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:13.522228 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:13.522939 (+ 711us) server_negotiation.cc:407] Connection header received
0809 20:11:13.523157 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:13.523163 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:13.523230 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:13.523304 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:13.524727 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:13.525849 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:13.527903 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:13.528543 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:13.528673 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:13.530756 (+ 2083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:13.530761 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:13.530764 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:13.530793 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:13.533840 (+ 3047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:13.534474 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:13.534479 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:13.534483 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:13.534621 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:13.534963 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:13.534969 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:13.534972 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:13.535316 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:13.535451 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:13.536789 (+ 1338us) server_negotiation.cc:299] Negotiation successful
0809 20:11:13.537000 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 20:11:13.537377 17982 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.2@KRBTEST.COM'} at 127.14.181.2:53573
WARNING: no policy specified for kudu/127.14.181.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
I20260809 20:11:13.575186 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:0
--local_ip_for_outbound_sockets=127.14.181.3
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:36821
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:37375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:13.880069 18556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:13.880306 18556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:13.880437 18556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:13.887435 18556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:13.887522 18556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:13.887640 18556 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 20:11:13.887707 18556 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 20:11:13.887804 18556 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:11:13.897006 18556 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:37375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.181.62:36821
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:13.898072 18556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:13.899297 18556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:13.911299 18563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:13.911363 18565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:13.911398 18568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:13.912285 18556 server_base.cc:1034] running on GCE node
I20260809 20:11:13.912873 18556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:13.913888 18556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:13.915076 18556 hybrid_clock.cc:648] HybridClock initialized: now 1786306273915026 us; error 43 us; skew 500 ppm
I20260809 20:11:13.915355 18556 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:13 dist-test-slave-6zbq krb5kdc[17895](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306273, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:13.918327 18556 init.cc:377] Logged in from keytab as kudu/127.14.181.3@KRBTEST.COM (short username kudu)
I20260809 20:11:13.919621 18556 webserver.cc:460] Webserver started at http://127.14.181.3:38857/ using document root <none> and password file <none>
I20260809 20:11:13.920203 18556 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:13.920320 18556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:13.920683 18556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:13.923448 18556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-2/data/instance:
uuid: "208fee4901d946e09dea603be4ebd29b"
format_stamp: "Formatted at 2026-08-09 20:11:13 on dist-test-slave-6zbq"
server_key: "d20f4f7ee56d2636a2a52f7c83e30b2c"
server_key_iv: "a092ba11255d5cd1cda4a302eabcb471"
server_key_version: "encryptionkey@0"
I20260809 20:11:13.924191 18556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance:
uuid: "208fee4901d946e09dea603be4ebd29b"
format_stamp: "Formatted at 2026-08-09 20:11:13 on dist-test-slave-6zbq"
server_key: "d20f4f7ee56d2636a2a52f7c83e30b2c"
server_key_iv: "a092ba11255d5cd1cda4a302eabcb471"
server_key_version: "encryptionkey@0"
I20260809 20:11:13.928928 18556 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 20:11:13.932070 18582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:13.933224 18556 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 20:11:13.933367 18556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "208fee4901d946e09dea603be4ebd29b"
format_stamp: "Formatted at 2026-08-09 20:11:13 on dist-test-slave-6zbq"
server_key: "d20f4f7ee56d2636a2a52f7c83e30b2c"
server_key_iv: "a092ba11255d5cd1cda4a302eabcb471"
server_key_version: "encryptionkey@0"
I20260809 20:11:13.933529 18556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:13.946326 18556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:13.949788 18556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:13.950022 18556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:13.952370 18556 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:13.952484 18556 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:13.952589 18556 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:13.952688 18556 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 20:11:13 dist-test-slave-6zbq krb5kdc[17895](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306273, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:13.973348 18061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:13.952951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:38477 (local address 127.14.181.62:36821)
0809 20:11:13.953132 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:13.953138 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:13.954413 (+ 1275us) server_negotiation.cc:407] Connection header received
0809 20:11:13.956289 (+ 1876us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:13.956296 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:13.956376 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:13.956460 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:13.958453 (+ 1993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:13.959621 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:13.961989 (+ 2368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:13.962672 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:13.962811 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:13.967119 (+ 4308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:13.967124 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:13.967127 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:13.967160 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:13.970100 (+ 2940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:13.971016 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:13.971022 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:13.971026 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:13.971211 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:13.971600 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:13.971605 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:13.971608 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:13.971964 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:13.972131 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:13.972712 (+ 581us) server_negotiation.cc:299] Negotiation successful
0809 20:11:13.972969 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 20:11:13.973905 18595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:13.953507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:36821 (local address 127.14.181.3:38477)
0809 20:11:13.954264 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:13.954301 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:13.956028 (+ 1727us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:13.956713 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:13.956724 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:13.957480 (+ 756us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:13.958244 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:13.958267 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:13.959780 (+ 1513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:13.959785 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:13.961791 (+ 2006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:13.961807 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:13.962941 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:13.962949 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:13.963169 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:13.963905 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:13.963937 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:13.966906 (+ 2969us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:13.970268 (+ 3362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:13.970277 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:13.970291 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:13.970863 (+ 572us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:13.971321 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:13.971324 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:13.971326 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:13.971506 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:13.972094 (+ 588us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:13.972099 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:13.972375 (+ 276us) client_negotiation.cc:769] Sending connection context
0809 20:11:13.972569 (+ 194us) client_negotiation.cc:240] Negotiation successful
0809 20:11:13.972890 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":330,"threads_started":1}
I20260809 20:11:13.994690 18556 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:38187
I20260809 20:11:13.994725 18784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:38187 every 8 connection(s)
I20260809 20:11:13.995467 18719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:13.980962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:36821 (local address 127.14.181.3:36965)
0809 20:11:13.981587 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:13.981612 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:13.981746 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:13.982012 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:13.982018 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:13.982674 (+ 656us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:13.983184 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:13.983201 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:13.984525 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:13.984531 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:13.986393 (+ 1862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:13.986414 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:13.987175 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:13.987183 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:13.987345 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:13.988013 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:13.988038 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:13.989144 (+ 1106us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:13.992806 (+ 3662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:13.992810 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:13.992812 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:13.993246 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:13.993637 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:13.993642 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:13.993646 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:13.993778 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:13.994505 (+ 727us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:13.994509 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:13.994672 (+ 163us) client_negotiation.cc:769] Sending connection context
0809 20:11:13.994849 (+ 177us) client_negotiation.cc:240] Negotiation successful
0809 20:11:13.995150 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":329,"threads_started":1}
I20260809 20:11:13.995950 18556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:11:13.996384 18061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:13.980972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:36965 (local address 127.14.181.62:36821)
0809 20:11:13.981166 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:13.981173 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:13.981694 (+ 521us) server_negotiation.cc:407] Connection header received
0809 20:11:13.981850 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:13.981854 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:13.981908 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:13.981971 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:13.983444 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:13.984389 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:13.986548 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:13.986980 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:13.987072 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:13.989385 (+ 2313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:13.989392 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:13.989397 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:13.989433 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:13.992625 (+ 3192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:13.993373 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:13.993378 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:13.993382 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:13.993531 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:13.993920 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:13.993925 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:13.993928 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:13.994277 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:13.994445 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:13.995954 (+ 1509us) server_negotiation.cc:299] Negotiation successful
0809 20:11:13.996145 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 20:11:13.998371 18788 heartbeater.cc:347] Connected to a master server at 127.14.181.62:36821
I20260809 20:11:13.998627 18788 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:13.999253 18788 heartbeater.cc:511] Master 127.14.181.62:36821 requested a full tablet report, sending...
I20260809 20:11:13.999689 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 18556
I20260809 20:11:13.999863 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance
I20260809 20:11:14.000427 15060 external_mini_cluster.cc:1428] Setting key f8256554cf470c1c888f0556a9c92106
I20260809 20:11:14.000650 17982 ts_manager.cc:194] Registered new tserver with Master: 208fee4901d946e09dea603be4ebd29b (127.14.181.3:38187)
I20260809 20:11:14.001463 17982 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.3@KRBTEST.COM'} at 127.14.181.3:38477
I20260809 20:11:14.003226 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 20:11:14.021963 18327 heartbeater.cc:503] Master 127.14.181.62:36821 was elected leader, sending a full tablet report...
Aug 09 20:11:14 dist-test-slave-6zbq krb5kdc[17895](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306274, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 20:11:14 dist-test-slave-6zbq krb5kdc[17895](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306274, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:14.051328 18061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:14.038724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56434 (local address 127.14.181.62:36821)
0809 20:11:14.038944 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:14.038950 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:14.039202 (+ 252us) server_negotiation.cc:407] Connection header received
0809 20:11:14.039309 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:14.039313 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:14.039381 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:14.039458 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:14.040797 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.041522 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.042741 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.043151 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.043249 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:14.046717 (+ 3468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:14.046722 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:14.046725 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:14.046754 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:14.048956 (+ 2202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:14.049524 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:14.049528 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:14.049530 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:14.049648 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:14.050002 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:14.050005 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:14.050007 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:14.050270 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:14.050499 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:14.050808 (+ 309us) server_negotiation.cc:299] Negotiation successful
0809 20:11:14.051021 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 20:11:14.054839 17982 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56434:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 20:11:14.061422 17982 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 20:11:14.100484 18811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:14.072516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:44585 (local address 127.0.0.1:55494)
0809 20:11:14.081713 (+ 9197us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:14.081748 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:14.081927 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:14.093535 (+ 11608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:14.093544 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:14.093588 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:14.094586 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:14.094600 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.096318 (+ 1718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.096324 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:14.098187 (+ 1863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:14.098199 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.099474 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.099481 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:14.099747 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:14.099792 (+ 45us) client_negotiation.cc:769] Sending connection context
0809 20:11:14.099904 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 20:11:14.100083 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8980,"mutex_wait_us":46,"thread_start_us":21408,"threads_started":1}
I20260809 20:11:14.102263 18806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:14.073032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:38187 (local address 127.0.0.1:53604)
0809 20:11:14.094596 (+ 21564us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:14.094612 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:14.094806 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:14.095553 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:14.095556 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:14.095579 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:14.095976 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:14.095988 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.097455 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.097464 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:14.099790 (+ 2326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:14.099806 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.101523 (+ 1717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.101530 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:14.101731 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:14.101762 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 20:11:14.101847 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 20:11:14.101958 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21440,"mutex_wait_us":61,"thread_start_us":8338,"threads_started":1}
I20260809 20:11:14.102277 18807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:14.072708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55494 (local address 127.14.181.1:44585)
0809 20:11:14.092845 (+ 20137us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:14.092854 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:14.092886 (+ 32us) server_negotiation.cc:407] Connection header received
0809 20:11:14.092987 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:14.092996 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:14.093277 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:14.094121 (+ 844us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:14.094777 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.096194 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.098333 (+ 2139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.099263 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.099388 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:14.099598 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:14.101773 (+ 2175us) server_negotiation.cc:299] Negotiation successful
0809 20:11:14.101959 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19645,"thread_start_us":19517,"threads_started":1}
I20260809 20:11:14.102399 18815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:14.073579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50068 (local address 127.14.181.2:35553)
0809 20:11:14.093389 (+ 19810us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:14.093398 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:14.094095 (+ 697us) server_negotiation.cc:407] Connection header received
0809 20:11:14.094630 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:14.094638 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:14.094851 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:14.095015 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:14.095886 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.097206 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.099975 (+ 2769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.100922 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.101023 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:14.101216 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:14.101894 (+ 678us) server_negotiation.cc:299] Negotiation successful
0809 20:11:14.102132 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19660,"thread_start_us":19535,"threads_started":1}
I20260809 20:11:14.102684 18810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:14.072698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:35553 (local address 127.0.0.1:50068)
0809 20:11:14.093986 (+ 21288us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:14.094007 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:14.094389 (+ 382us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:14.095242 (+ 853us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:14.095246 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:14.095271 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:14.095695 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:14.095713 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.097349 (+ 1636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.097354 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:14.099825 (+ 2471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:14.099835 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.101163 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.101171 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:14.101329 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:14.101360 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 20:11:14.101436 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 20:11:14.101565 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21110,"mutex_wait_us":90,"thread_start_us":20862,"threads_started":1}
I20260809 20:11:14.103809 18817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:14.074008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53604 (local address 127.14.181.3:38187)
0809 20:11:14.092997 (+ 18989us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:14.093004 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:14.094704 (+ 1700us) server_negotiation.cc:407] Connection header received
0809 20:11:14.095002 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:14.095010 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:14.095194 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:14.095313 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:14.096189 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.097278 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.099957 (+ 2679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.101330 (+ 1373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.101456 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:14.101673 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:14.103336 (+ 1663us) server_negotiation.cc:299] Negotiation successful
0809 20:11:14.103490 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18835,"thread_start_us":18649,"threads_started":1}
I20260809 20:11:14.105645 18437 tablet_service.cc:1467] Processing CreateTablet for tablet d4a8859b65484ac587df17e610090fc3 (DEFAULT_TABLE table=test-table [id=f059e22c97974b29ae6146b9bdbde721]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:14.105747 18220 tablet_service.cc:1467] Processing CreateTablet for tablet d4a8859b65484ac587df17e610090fc3 (DEFAULT_TABLE table=test-table [id=f059e22c97974b29ae6146b9bdbde721]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:14.106932 18437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4a8859b65484ac587df17e610090fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:14.107084 18220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4a8859b65484ac587df17e610090fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:14.107182 18666 tablet_service.cc:1467] Processing CreateTablet for tablet d4a8859b65484ac587df17e610090fc3 (DEFAULT_TABLE table=test-table [id=f059e22c97974b29ae6146b9bdbde721]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:14.108429 18666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4a8859b65484ac587df17e610090fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:14.118731 18819 tablet_bootstrap.cc:492] T d4a8859b65484ac587df17e610090fc3 P 208fee4901d946e09dea603be4ebd29b: Bootstrap starting.
I20260809 20:11:14.119618 18821 tablet_bootstrap.cc:492] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e: Bootstrap starting.
I20260809 20:11:14.122434 18822 tablet_bootstrap.cc:492] T d4a8859b65484ac587df17e610090fc3 P 8f9eecd9faa64e16ba4383e5ad0def66: Bootstrap starting.
I20260809 20:11:14.122848 18819 tablet_bootstrap.cc:654] T d4a8859b65484ac587df17e610090fc3 P 208fee4901d946e09dea603be4ebd29b: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:14.122848 18821 tablet_bootstrap.cc:654] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:14.124050 18821 log.cc:824] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:14.124044 18819 log.cc:824] T d4a8859b65484ac587df17e610090fc3 P 208fee4901d946e09dea603be4ebd29b: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:14.125331 18822 tablet_bootstrap.cc:654] T d4a8859b65484ac587df17e610090fc3 P 8f9eecd9faa64e16ba4383e5ad0def66: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:14.126263 18822 log.cc:824] T d4a8859b65484ac587df17e610090fc3 P 8f9eecd9faa64e16ba4383e5ad0def66: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:14.126777 18819 tablet_bootstrap.cc:492] T d4a8859b65484ac587df17e610090fc3 P 208fee4901d946e09dea603be4ebd29b: No bootstrap required, opened a new log
I20260809 20:11:14.127036 18819 ts_tablet_manager.cc:1397] T d4a8859b65484ac587df17e610090fc3 P 208fee4901d946e09dea603be4ebd29b: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260809 20:11:14.128075 18821 tablet_bootstrap.cc:492] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e: No bootstrap required, opened a new log
I20260809 20:11:14.128334 18821 ts_tablet_manager.cc:1397] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260809 20:11:14.128453 18822 tablet_bootstrap.cc:492] T d4a8859b65484ac587df17e610090fc3 P 8f9eecd9faa64e16ba4383e5ad0def66: No bootstrap required, opened a new log
I20260809 20:11:14.128662 18822 ts_tablet_manager.cc:1397] T d4a8859b65484ac587df17e610090fc3 P 8f9eecd9faa64e16ba4383e5ad0def66: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 20:11:14.135396 18822 raft_consensus.cc:348] T d4a8859b65484ac587df17e610090fc3 P 8f9eecd9faa64e16ba4383e5ad0def66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:14.135726 18822 raft_consensus.cc:374] T d4a8859b65484ac587df17e610090fc3 P 8f9eecd9faa64e16ba4383e5ad0def66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:14.135823 18822 raft_consensus.cc:729] T d4a8859b65484ac587df17e610090fc3 P 8f9eecd9faa64e16ba4383e5ad0def66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9eecd9faa64e16ba4383e5ad0def66, State: Initialized, Role: FOLLOWER
I20260809 20:11:14.136494 18822 consensus_queue.cc:260] T d4a8859b65484ac587df17e610090fc3 P 8f9eecd9faa64e16ba4383e5ad0def66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:14.137058 18819 raft_consensus.cc:348] T d4a8859b65484ac587df17e610090fc3 P 208fee4901d946e09dea603be4ebd29b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:14.137432 18819 raft_consensus.cc:374] T d4a8859b65484ac587df17e610090fc3 P 208fee4901d946e09dea603be4ebd29b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:14.137516 18819 raft_consensus.cc:729] T d4a8859b65484ac587df17e610090fc3 P 208fee4901d946e09dea603be4ebd29b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 208fee4901d946e09dea603be4ebd29b, State: Initialized, Role: FOLLOWER
I20260809 20:11:14.138163 18822 ts_tablet_manager.cc:1428] T d4a8859b65484ac587df17e610090fc3 P 8f9eecd9faa64e16ba4383e5ad0def66: Time spent starting tablet: real 0.009s user 0.010s sys 0.000s
I20260809 20:11:14.138033 18819 consensus_queue.cc:260] T d4a8859b65484ac587df17e610090fc3 P 208fee4901d946e09dea603be4ebd29b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:14.139109 18788 heartbeater.cc:503] Master 127.14.181.62:36821 was elected leader, sending a full tablet report...
I20260809 20:11:14.139663 18819 ts_tablet_manager.cc:1428] T d4a8859b65484ac587df17e610090fc3 P 208fee4901d946e09dea603be4ebd29b: Time spent starting tablet: real 0.013s user 0.009s sys 0.003s
I20260809 20:11:14.138623 18821 raft_consensus.cc:348] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:14.140240 18821 raft_consensus.cc:374] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:14.140347 18821 raft_consensus.cc:729] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70528b1b04a34d20927fbc1694432d7e, State: Initialized, Role: FOLLOWER
I20260809 20:11:14.140866 18821 consensus_queue.cc:260] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:14.142133 18550 heartbeater.cc:503] Master 127.14.181.62:36821 was elected leader, sending a full tablet report...
I20260809 20:11:14.143810 18821 ts_tablet_manager.cc:1428] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
I20260809 20:11:14.146968 18829 raft_consensus.cc:482] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:11:14.147150 18829 raft_consensus.cc:504] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:14.148408 18829 leader_election.cc:288] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9eecd9faa64e16ba4383e5ad0def66 (127.14.181.1:44585), 208fee4901d946e09dea603be4ebd29b (127.14.181.3:38187)
I20260809 20:11:14.155764 18807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:14.149173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:54095 (local address 127.14.181.1:44585)
0809 20:11:14.149353 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:14.149358 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:14.149497 (+ 139us) server_negotiation.cc:407] Connection header received
0809 20:11:14.149702 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:14.149706 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:14.149788 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:14.149871 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:14.150435 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.151389 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.153787 (+ 2398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.154919 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.155070 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:14.155139 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:14.155450 (+ 311us) server_negotiation.cc:299] Negotiation successful
0809 20:11:14.155538 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 20:11:14.155920 18817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:14.148728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:36165 (local address 127.14.181.3:38187)
0809 20:11:14.148895 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:14.148901 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:14.149944 (+ 1043us) server_negotiation.cc:407] Connection header received
0809 20:11:14.150084 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:14.150088 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:14.150144 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:14.150206 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:14.150763 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.151685 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.153962 (+ 2277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.155104 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.155249 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:14.155295 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:14.155592 (+ 297us) server_negotiation.cc:299] Negotiation successful
0809 20:11:14.155707 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 20:11:14.156142 18830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:14.148725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:44585 (local address 127.14.181.2:54095)
0809 20:11:14.149388 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:14.149411 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:14.149562 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:14.149909 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:14.149914 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:14.149939 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:14.150293 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:14.150303 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.151505 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.151508 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:14.153635 (+ 2127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:14.153650 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.155105 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.155110 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:14.155285 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:14.155323 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 20:11:14.155408 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 20:11:14.155527 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"mutex_wait_us":3,"spinlock_wait_cycles":15744,"thread_start_us":524,"threads_started":1}
I20260809 20:11:14.156163 18831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:14.148806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:38187 (local address 127.14.181.2:36165)
0809 20:11:14.149847 (+ 1041us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:14.149863 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:14.149967 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:14.150255 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:14.150260 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:14.150287 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:14.150632 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:14.150640 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.151802 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.151808 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:14.153835 (+ 2027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:14.153845 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.155308 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.155314 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:14.155456 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:14.155485 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 20:11:14.155561 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 20:11:14.155669 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":950,"mutex_wait_us":39,"thread_start_us":759,"threads_started":1}
I20260809 20:11:14.156934 18702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4a8859b65484ac587df17e610090fc3" candidate_uuid: "70528b1b04a34d20927fbc1694432d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "208fee4901d946e09dea603be4ebd29b" is_pre_election: true
I20260809 20:11:14.157017 18246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4a8859b65484ac587df17e610090fc3" candidate_uuid: "70528b1b04a34d20927fbc1694432d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" is_pre_election: true
I20260809 20:11:14.157346 18702 raft_consensus.cc:2454] T d4a8859b65484ac587df17e610090fc3 P 208fee4901d946e09dea603be4ebd29b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70528b1b04a34d20927fbc1694432d7e in term 0.
I20260809 20:11:14.157389 18246 raft_consensus.cc:2454] T d4a8859b65484ac587df17e610090fc3 P 8f9eecd9faa64e16ba4383e5ad0def66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70528b1b04a34d20927fbc1694432d7e in term 0.
I20260809 20:11:14.157914 18357 leader_election.cc:302] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 208fee4901d946e09dea603be4ebd29b, 70528b1b04a34d20927fbc1694432d7e, 8f9eecd9faa64e16ba4383e5ad0def66; no voters:
I20260809 20:11:14.158284 18829 raft_consensus.cc:2781] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:11:14.158432 18829 raft_consensus.cc:482] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:11:14.158530 18829 raft_consensus.cc:3037] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:14.160533 18829 raft_consensus.cc:504] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:14.161072 18829 leader_election.cc:288] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e [CANDIDATE]: Term 1 election: Requested vote from peers 8f9eecd9faa64e16ba4383e5ad0def66 (127.14.181.1:44585), 208fee4901d946e09dea603be4ebd29b (127.14.181.3:38187)
I20260809 20:11:14.161438 18246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4a8859b65484ac587df17e610090fc3" candidate_uuid: "70528b1b04a34d20927fbc1694432d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9eecd9faa64e16ba4383e5ad0def66"
I20260809 20:11:14.161536 18702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4a8859b65484ac587df17e610090fc3" candidate_uuid: "70528b1b04a34d20927fbc1694432d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "208fee4901d946e09dea603be4ebd29b"
I20260809 20:11:14.161630 18246 raft_consensus.cc:3037] T d4a8859b65484ac587df17e610090fc3 P 8f9eecd9faa64e16ba4383e5ad0def66 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:14.161717 18702 raft_consensus.cc:3037] T d4a8859b65484ac587df17e610090fc3 P 208fee4901d946e09dea603be4ebd29b [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:14.164687 18702 raft_consensus.cc:2454] T d4a8859b65484ac587df17e610090fc3 P 208fee4901d946e09dea603be4ebd29b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70528b1b04a34d20927fbc1694432d7e in term 1.
I20260809 20:11:14.164697 18246 raft_consensus.cc:2454] T d4a8859b65484ac587df17e610090fc3 P 8f9eecd9faa64e16ba4383e5ad0def66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70528b1b04a34d20927fbc1694432d7e in term 1.
I20260809 20:11:14.165052 18357 leader_election.cc:302] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 208fee4901d946e09dea603be4ebd29b, 70528b1b04a34d20927fbc1694432d7e; no voters:
I20260809 20:11:14.165303 18829 raft_consensus.cc:2781] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:14.165692 18829 raft_consensus.cc:686] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e [term 1 LEADER]: Becoming Leader. State: Replica: 70528b1b04a34d20927fbc1694432d7e, State: Running, Role: LEADER
I20260809 20:11:14.166085 18829 consensus_queue.cc:237] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:14.169965 17981 catalog_manager.cc:5495] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e reported cstate change: term changed from 0 to 1, leader changed from <none> to 70528b1b04a34d20927fbc1694432d7e (127.14.181.2). New cstate: current_term: 1 leader_uuid: "70528b1b04a34d20927fbc1694432d7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } health_report { overall_health: UNKNOWN } } }
Aug 09 20:11:14 dist-test-slave-6zbq krb5kdc[17895](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306272, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:14.240324 18847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:14.228419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:36821 (local address 127.0.0.1:56440)
0809 20:11:14.228945 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:14.228960 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:14.229069 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:14.229328 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:14.229332 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:14.229945 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:14.230186 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:14.230194 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.231118 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.231122 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:14.232083 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:14.232094 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.232771 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.232776 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:14.232894 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:14.233421 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:14.233437 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:14.235434 (+ 1997us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:14.238103 (+ 2669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:14.238115 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:14.238122 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:14.238553 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:14.238904 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:14.238907 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:14.238909 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:14.239046 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:14.239504 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:14.239512 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:14.239652 (+ 140us) client_negotiation.cc:769] Sending connection context
0809 20:11:14.239781 (+ 129us) client_negotiation.cc:240] Negotiation successful
0809 20:11:14.239958 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":294,"threads_started":1}
I20260809 20:11:14.240377 18061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:14.228341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56440 (local address 127.14.181.62:36821)
0809 20:11:14.228523 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:14.228529 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:14.229032 (+ 503us) server_negotiation.cc:407] Connection header received
0809 20:11:14.229156 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:14.229160 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:14.229227 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:14.229302 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:14.230299 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.231020 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.232200 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.232632 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.232718 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:14.235597 (+ 2879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:14.235603 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:14.235607 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:14.235636 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:14.237985 (+ 2349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:14.238668 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:14.238673 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:14.238675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:14.238808 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:14.239139 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:14.239142 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:14.239144 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:14.239390 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:14.239496 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:14.239871 (+ 375us) server_negotiation.cc:299] Negotiation successful
0809 20:11:14.240076 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":58}
I20260809 20:11:14.244621 17981 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:56440:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 20:11:14.245522 17981 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260809 20:11:14.247844 18789 tablet.cc:2369] T d4a8859b65484ac587df17e610090fc3 P 208fee4901d946e09dea603be4ebd29b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:11:14.251421 18220 tablet_service.cc:1467] Processing CreateTablet for tablet 78fae722c3d54220bc93d5ca84e0d537 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c5c0238e898d4710b403e843db50efa3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 20:11:14.251539 18437 tablet_service.cc:1467] Processing CreateTablet for tablet 78fae722c3d54220bc93d5ca84e0d537 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c5c0238e898d4710b403e843db50efa3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 20:11:14.251685 18666 tablet_service.cc:1467] Processing CreateTablet for tablet 78fae722c3d54220bc93d5ca84e0d537 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c5c0238e898d4710b403e843db50efa3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 20:11:14.252200 18220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78fae722c3d54220bc93d5ca84e0d537. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:14.252415 18437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78fae722c3d54220bc93d5ca84e0d537. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:14.252415 18666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78fae722c3d54220bc93d5ca84e0d537. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:14.256968 18822 tablet_bootstrap.cc:492] T 78fae722c3d54220bc93d5ca84e0d537 P 8f9eecd9faa64e16ba4383e5ad0def66: Bootstrap starting.
I20260809 20:11:14.258409 18822 tablet_bootstrap.cc:654] T 78fae722c3d54220bc93d5ca84e0d537 P 8f9eecd9faa64e16ba4383e5ad0def66: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:14.259294 18819 tablet_bootstrap.cc:492] T 78fae722c3d54220bc93d5ca84e0d537 P 208fee4901d946e09dea603be4ebd29b: Bootstrap starting.
I20260809 20:11:14.259299 18821 tablet_bootstrap.cc:492] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e: Bootstrap starting.
I20260809 20:11:14.260630 18821 tablet_bootstrap.cc:654] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:14.260980 18819 tablet_bootstrap.cc:654] T 78fae722c3d54220bc93d5ca84e0d537 P 208fee4901d946e09dea603be4ebd29b: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:14.263679 18821 tablet_bootstrap.cc:492] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e: No bootstrap required, opened a new log
I20260809 20:11:14.263805 18821 ts_tablet_manager.cc:1397] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260809 20:11:14.263890 18819 tablet_bootstrap.cc:492] T 78fae722c3d54220bc93d5ca84e0d537 P 208fee4901d946e09dea603be4ebd29b: No bootstrap required, opened a new log
I20260809 20:11:14.264029 18819 ts_tablet_manager.cc:1397] T 78fae722c3d54220bc93d5ca84e0d537 P 208fee4901d946e09dea603be4ebd29b: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s
I20260809 20:11:14.264524 18821 raft_consensus.cc:348] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:14.264627 18819 raft_consensus.cc:348] T 78fae722c3d54220bc93d5ca84e0d537 P 208fee4901d946e09dea603be4ebd29b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:14.264796 18821 raft_consensus.cc:374] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:14.264808 18819 raft_consensus.cc:374] T 78fae722c3d54220bc93d5ca84e0d537 P 208fee4901d946e09dea603be4ebd29b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:14.264891 18819 raft_consensus.cc:729] T 78fae722c3d54220bc93d5ca84e0d537 P 208fee4901d946e09dea603be4ebd29b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 208fee4901d946e09dea603be4ebd29b, State: Initialized, Role: FOLLOWER
I20260809 20:11:14.264904 18822 tablet_bootstrap.cc:492] T 78fae722c3d54220bc93d5ca84e0d537 P 8f9eecd9faa64e16ba4383e5ad0def66: No bootstrap required, opened a new log
I20260809 20:11:14.264899 18821 raft_consensus.cc:729] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70528b1b04a34d20927fbc1694432d7e, State: Initialized, Role: FOLLOWER
I20260809 20:11:14.265029 18822 ts_tablet_manager.cc:1397] T 78fae722c3d54220bc93d5ca84e0d537 P 8f9eecd9faa64e16ba4383e5ad0def66: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.005s
I20260809 20:11:14.265100 18819 consensus_queue.cc:260] T 78fae722c3d54220bc93d5ca84e0d537 P 208fee4901d946e09dea603be4ebd29b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:14.265118 18821 consensus_queue.cc:260] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:14.265650 18819 ts_tablet_manager.cc:1428] T 78fae722c3d54220bc93d5ca84e0d537 P 208fee4901d946e09dea603be4ebd29b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 20:11:14.265681 18821 ts_tablet_manager.cc:1428] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260809 20:11:14.265961 18829 tablet_replica.cc:439] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } } }
I20260809 20:11:14.265858 18827 tablet_replica.cc:439] T 78fae722c3d54220bc93d5ca84e0d537 P 208fee4901d946e09dea603be4ebd29b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } } }
I20260809 20:11:14.266208 18827 tablet_replica.cc:442] T 78fae722c3d54220bc93d5ca84e0d537 P 208fee4901d946e09dea603be4ebd29b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 20:11:14.266220 18829 tablet_replica.cc:442] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 20:11:14.266389 18822 raft_consensus.cc:348] T 78fae722c3d54220bc93d5ca84e0d537 P 8f9eecd9faa64e16ba4383e5ad0def66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:14.266644 18822 raft_consensus.cc:374] T 78fae722c3d54220bc93d5ca84e0d537 P 8f9eecd9faa64e16ba4383e5ad0def66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:14.266752 18822 raft_consensus.cc:729] T 78fae722c3d54220bc93d5ca84e0d537 P 8f9eecd9faa64e16ba4383e5ad0def66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9eecd9faa64e16ba4383e5ad0def66, State: Initialized, Role: FOLLOWER
W20260809 20:11:14.266650 18328 tablet.cc:2369] T d4a8859b65484ac587df17e610090fc3 P 8f9eecd9faa64e16ba4383e5ad0def66: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:11:14.267053 18822 consensus_queue.cc:260] T 78fae722c3d54220bc93d5ca84e0d537 P 8f9eecd9faa64e16ba4383e5ad0def66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:14.267658 18822 ts_tablet_manager.cc:1428] T 78fae722c3d54220bc93d5ca84e0d537 P 8f9eecd9faa64e16ba4383e5ad0def66: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260809 20:11:14.267541 18826 tablet_replica.cc:439] T 78fae722c3d54220bc93d5ca84e0d537 P 8f9eecd9faa64e16ba4383e5ad0def66: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } } }
I20260809 20:11:14.267922 18826 tablet_replica.cc:442] T 78fae722c3d54220bc93d5ca84e0d537 P 8f9eecd9faa64e16ba4383e5ad0def66: This TxnStatusTablet replica's current role is: FOLLOWER
W20260809 20:11:14.286621 18551 tablet.cc:2369] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:11:14.415657 18829 raft_consensus.cc:482] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:11:14.415853 18829 raft_consensus.cc:504] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:14.416453 18829 leader_election.cc:288] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9eecd9faa64e16ba4383e5ad0def66 (127.14.181.1:44585), 208fee4901d946e09dea603be4ebd29b (127.14.181.3:38187)
I20260809 20:11:14.416963 18246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78fae722c3d54220bc93d5ca84e0d537" candidate_uuid: "70528b1b04a34d20927fbc1694432d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" is_pre_election: true
I20260809 20:11:14.416976 18702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78fae722c3d54220bc93d5ca84e0d537" candidate_uuid: "70528b1b04a34d20927fbc1694432d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "208fee4901d946e09dea603be4ebd29b" is_pre_election: true
I20260809 20:11:14.417186 18246 raft_consensus.cc:2454] T 78fae722c3d54220bc93d5ca84e0d537 P 8f9eecd9faa64e16ba4383e5ad0def66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70528b1b04a34d20927fbc1694432d7e in term 0.
I20260809 20:11:14.417224 18702 raft_consensus.cc:2454] T 78fae722c3d54220bc93d5ca84e0d537 P 208fee4901d946e09dea603be4ebd29b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70528b1b04a34d20927fbc1694432d7e in term 0.
I20260809 20:11:14.417588 18354 leader_election.cc:302] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70528b1b04a34d20927fbc1694432d7e, 8f9eecd9faa64e16ba4383e5ad0def66; no voters:
I20260809 20:11:14.417889 18829 raft_consensus.cc:2781] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:11:14.417974 18829 raft_consensus.cc:482] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:11:14.418072 18829 raft_consensus.cc:3037] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:14.420080 18829 raft_consensus.cc:504] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:14.420595 18829 leader_election.cc:288] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e [CANDIDATE]: Term 1 election: Requested vote from peers 8f9eecd9faa64e16ba4383e5ad0def66 (127.14.181.1:44585), 208fee4901d946e09dea603be4ebd29b (127.14.181.3:38187)
I20260809 20:11:14.420954 18246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78fae722c3d54220bc93d5ca84e0d537" candidate_uuid: "70528b1b04a34d20927fbc1694432d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9eecd9faa64e16ba4383e5ad0def66"
I20260809 20:11:14.421041 18702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78fae722c3d54220bc93d5ca84e0d537" candidate_uuid: "70528b1b04a34d20927fbc1694432d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "208fee4901d946e09dea603be4ebd29b"
I20260809 20:11:14.421150 18246 raft_consensus.cc:3037] T 78fae722c3d54220bc93d5ca84e0d537 P 8f9eecd9faa64e16ba4383e5ad0def66 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:14.421257 18702 raft_consensus.cc:3037] T 78fae722c3d54220bc93d5ca84e0d537 P 208fee4901d946e09dea603be4ebd29b [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:14.423178 18246 raft_consensus.cc:2454] T 78fae722c3d54220bc93d5ca84e0d537 P 8f9eecd9faa64e16ba4383e5ad0def66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70528b1b04a34d20927fbc1694432d7e in term 1.
I20260809 20:11:14.423259 18702 raft_consensus.cc:2454] T 78fae722c3d54220bc93d5ca84e0d537 P 208fee4901d946e09dea603be4ebd29b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70528b1b04a34d20927fbc1694432d7e in term 1.
I20260809 20:11:14.423527 18354 leader_election.cc:302] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70528b1b04a34d20927fbc1694432d7e, 8f9eecd9faa64e16ba4383e5ad0def66; no voters:
I20260809 20:11:14.423753 18829 raft_consensus.cc:2781] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:14.423907 18829 raft_consensus.cc:686] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e [term 1 LEADER]: Becoming Leader. State: Replica: 70528b1b04a34d20927fbc1694432d7e, State: Running, Role: LEADER
I20260809 20:11:14.424139 18829 consensus_queue.cc:237] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:14.425684 18834 tablet_replica.cc:439] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e: TxnStatusTablet state changed. Reason: New leader 70528b1b04a34d20927fbc1694432d7e. Latest consensus state: current_term: 1 leader_uuid: "70528b1b04a34d20927fbc1694432d7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } } }
I20260809 20:11:14.426045 18834 tablet_replica.cc:442] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e: This TxnStatusTablet replica's current role is: LEADER
I20260809 20:11:14.426766 18853 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 20:11:14.427016 18853 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 20:11:14.426944 17980 catalog_manager.cc:5495] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e reported cstate change: term changed from 0 to 1, leader changed from <none> to 70528b1b04a34d20927fbc1694432d7e (127.14.181.2). New cstate: current_term: 1 leader_uuid: "70528b1b04a34d20927fbc1694432d7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } health_report { overall_health: UNKNOWN } } }
I20260809 20:11:14.462146 18815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:14.455695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50070 (local address 127.14.181.2:35553)
0809 20:11:14.455859 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:14.455865 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:14.455937 (+ 72us) server_negotiation.cc:407] Connection header received
0809 20:11:14.456209 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:14.456215 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:14.456313 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:14.456454 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:11:14.456881 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.458055 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.460047 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.460473 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.460565 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:14.461110 (+ 545us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:11:14.461610 (+ 500us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:11:14.461712 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:14.461858 (+ 146us) server_negotiation.cc:299] Negotiation successful
0809 20:11:14.461926 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 20:11:14.462297 18847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:14.455619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:35553 (local address 127.0.0.1:50070)
0809 20:11:14.455840 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:14.455859 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:14.456011 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:14.456495 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:14.456501 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:14.456514 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 20:11:14.456732 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:14.456743 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.458210 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.458216 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:14.459888 (+ 1672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:14.459903 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.460615 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.460622 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:14.460836 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:14.460907 (+ 71us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 20:11:14.461724 (+ 817us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 20:11:14.461747 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 20:11:14.461838 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 20:11:14.461988 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 20:11:14.469877 18702 raft_consensus.cc:1261] T 78fae722c3d54220bc93d5ca84e0d537 P 208fee4901d946e09dea603be4ebd29b [term 1 FOLLOWER]: Refusing update from remote peer 70528b1b04a34d20927fbc1694432d7e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:11:14.470069 18246 raft_consensus.cc:1261] T 78fae722c3d54220bc93d5ca84e0d537 P 8f9eecd9faa64e16ba4383e5ad0def66 [term 1 FOLLOWER]: Refusing update from remote peer 70528b1b04a34d20927fbc1694432d7e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:11:14.470808 18834 consensus_queue.cc:1035] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:11:14.471143 18829 consensus_queue.cc:1035] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:11:14.489390 18827 tablet_replica.cc:439] T 78fae722c3d54220bc93d5ca84e0d537 P 208fee4901d946e09dea603be4ebd29b: TxnStatusTablet state changed. Reason: New leader 70528b1b04a34d20927fbc1694432d7e. Latest consensus state: current_term: 1 leader_uuid: "70528b1b04a34d20927fbc1694432d7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } } }
I20260809 20:11:14.489634 18827 tablet_replica.cc:442] T 78fae722c3d54220bc93d5ca84e0d537 P 208fee4901d946e09dea603be4ebd29b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 20:11:14.492059 18857 mvcc.cc:205] Tried to move back new op lower bound from 7316710500219125760 to 7316710500043165696. Current Snapshot: MvccSnapshot[applied={T|T < 7316710500219125760}]
I20260809 20:11:14.492707 18861 mvcc.cc:205] Tried to move back new op lower bound from 7316710500219125760 to 7316710500043165696. Current Snapshot: MvccSnapshot[applied={T|T < 7316710500219125760}]
I20260809 20:11:14.496078 18827 tablet_replica.cc:439] T 78fae722c3d54220bc93d5ca84e0d537 P 208fee4901d946e09dea603be4ebd29b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "70528b1b04a34d20927fbc1694432d7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } } }
I20260809 20:11:14.496289 18827 tablet_replica.cc:442] T 78fae722c3d54220bc93d5ca84e0d537 P 208fee4901d946e09dea603be4ebd29b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 20:11:14.496316 18829 tablet_replica.cc:439] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "70528b1b04a34d20927fbc1694432d7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } } }
I20260809 20:11:14.496660 18829 tablet_replica.cc:442] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e: This TxnStatusTablet replica's current role is: LEADER
I20260809 20:11:14.496628 18826 tablet_replica.cc:439] T 78fae722c3d54220bc93d5ca84e0d537 P 8f9eecd9faa64e16ba4383e5ad0def66: TxnStatusTablet state changed. Reason: New leader 70528b1b04a34d20927fbc1694432d7e. Latest consensus state: current_term: 1 leader_uuid: "70528b1b04a34d20927fbc1694432d7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } } }
I20260809 20:11:14.496870 18826 tablet_replica.cc:442] T 78fae722c3d54220bc93d5ca84e0d537 P 8f9eecd9faa64e16ba4383e5ad0def66: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 20:11:14.524487 18873 tablet_replica.cc:439] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "70528b1b04a34d20927fbc1694432d7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } } }
I20260809 20:11:14.524998 18873 tablet_replica.cc:442] T 78fae722c3d54220bc93d5ca84e0d537 P 70528b1b04a34d20927fbc1694432d7e: This TxnStatusTablet replica's current role is: LEADER
I20260809 20:11:14.526219 18826 tablet_replica.cc:439] T 78fae722c3d54220bc93d5ca84e0d537 P 8f9eecd9faa64e16ba4383e5ad0def66: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "70528b1b04a34d20927fbc1694432d7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } } }
I20260809 20:11:14.526468 18826 tablet_replica.cc:442] T 78fae722c3d54220bc93d5ca84e0d537 P 8f9eecd9faa64e16ba4383e5ad0def66: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 20:11:14.534525 18815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:14.529576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50084 (local address 127.14.181.2:35553)
0809 20:11:14.529838 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:14.529844 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:14.529879 (+ 35us) server_negotiation.cc:407] Connection header received
0809 20:11:14.530111 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:14.530117 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:14.530180 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:14.530250 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:11:14.530668 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.531496 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.532807 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.533263 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.533373 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:14.533782 (+ 409us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:11:14.533905 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:11:14.533980 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:14.534137 (+ 157us) server_negotiation.cc:299] Negotiation successful
0809 20:11:14.534212 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132}
I20260809 20:11:14.556067 18829 consensus_queue.cc:1035] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:11:14.560643 18815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:14.544374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:32773 (local address 127.14.181.2:35553)
0809 20:11:14.544538 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:14.544542 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:14.554091 (+ 9549us) server_negotiation.cc:407] Connection header received
0809 20:11:14.554242 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:14.554246 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:14.554297 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:14.554396 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:11:14.554978 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.555977 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.558394 (+ 2417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.559110 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.559205 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:14.559864 (+ 659us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:11:14.560018 (+ 154us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:11:14.560072 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:14.560237 (+ 165us) server_negotiation.cc:299] Negotiation successful
0809 20:11:14.560315 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 20:11:14.561612 18881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:14.544300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:35553 (local address 127.14.181.2:32773)
0809 20:11:14.553996 (+ 9696us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:14.554011 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:14.554135 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:14.554410 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:14.554414 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:14.554424 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 20:11:14.554817 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:14.554830 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.556185 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.556190 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:14.558214 (+ 2024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:14.558232 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.559399 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.559405 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:14.559564 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:14.559648 (+ 84us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 20:11:14.560131 (+ 483us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 20:11:14.560139 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 20:11:14.561041 (+ 902us) client_negotiation.cc:240] Negotiation successful
0809 20:11:14.561200 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9547,"thread_start_us":9374,"threads_started":1}
I20260809 20:11:14.568506 18834 consensus_queue.cc:1035] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:11:14.633425 17981 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56434:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:11:14.633649 17981 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56434:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:11:14.636860 17981 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7b67434792d9426eb98364d99a9ae2b9: Sending DeleteTablet for 3 replicas of tablet d4a8859b65484ac587df17e610090fc3
I20260809 20:11:14.637910 18220 tablet_service.cc:1514] Processing DeleteTablet for tablet d4a8859b65484ac587df17e610090fc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:14 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:55494
I20260809 20:11:14.638195 18666 tablet_service.cc:1514] Processing DeleteTablet for tablet d4a8859b65484ac587df17e610090fc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:14 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:53604
I20260809 20:11:14.638624 18436 tablet_service.cc:1514] Processing DeleteTablet for tablet d4a8859b65484ac587df17e610090fc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:14 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:50068
I20260809 20:11:14.639067 18892 tablet_replica.cc:330] T d4a8859b65484ac587df17e610090fc3 P 208fee4901d946e09dea603be4ebd29b: stopping tablet replica
I20260809 20:11:14.639148 17982 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56434:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 20:11:14.639482 18892 raft_consensus.cc:2229] T d4a8859b65484ac587df17e610090fc3 P 208fee4901d946e09dea603be4ebd29b [term 1 FOLLOWER]: Raft consensus shutting down.
W20260809 20:11:14.639787 17982 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 20:11:14.639825 18892 raft_consensus.cc:2258] T d4a8859b65484ac587df17e610090fc3 P 208fee4901d946e09dea603be4ebd29b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:14.641572 18892 ts_tablet_manager.cc:1905] T d4a8859b65484ac587df17e610090fc3 P 208fee4901d946e09dea603be4ebd29b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:14.646976 18437 tablet_service.cc:1467] Processing CreateTablet for tablet 06e436b35f134f61a756ab34973094fb (DEFAULT_TABLE table=test-table [id=f953af106430427fba5c9239e04177b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:14.647414 18437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06e436b35f134f61a756ab34973094fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:14.648999 18892 ts_tablet_manager.cc:1918] T d4a8859b65484ac587df17e610090fc3 P 208fee4901d946e09dea603be4ebd29b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 20:11:14.649160 18892 log.cc:1196] T d4a8859b65484ac587df17e610090fc3 P 208fee4901d946e09dea603be4ebd29b: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-2/wal/wals/d4a8859b65484ac587df17e610090fc3
I20260809 20:11:14.649670 18892 ts_tablet_manager.cc:1939] T d4a8859b65484ac587df17e610090fc3 P 208fee4901d946e09dea603be4ebd29b: Deleting consensus metadata
I20260809 20:11:14.651011 18218 tablet_service.cc:1467] Processing CreateTablet for tablet 06e436b35f134f61a756ab34973094fb (DEFAULT_TABLE table=test-table [id=f953af106430427fba5c9239e04177b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:14.651477 18218 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06e436b35f134f61a756ab34973094fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:14.654626 17955 catalog_manager.cc:4841] TS 208fee4901d946e09dea603be4ebd29b (127.14.181.3:38187): tablet d4a8859b65484ac587df17e610090fc3 (table test-table [id=f059e22c97974b29ae6146b9bdbde721]) successfully deleted
I20260809 20:11:14.654855 18893 tablet_replica.cc:330] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e: stopping tablet replica
I20260809 20:11:14.655390 18893 raft_consensus.cc:2229] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e [term 1 LEADER]: Raft consensus shutting down.
I20260809 20:11:14.655525 18665 tablet_service.cc:1467] Processing CreateTablet for tablet 06e436b35f134f61a756ab34973094fb (DEFAULT_TABLE table=test-table [id=f953af106430427fba5c9239e04177b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:14.655987 18665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06e436b35f134f61a756ab34973094fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:14.656347 18890 tablet_replica.cc:330] T d4a8859b65484ac587df17e610090fc3 P 8f9eecd9faa64e16ba4383e5ad0def66: stopping tablet replica
I20260809 20:11:14.656625 18893 raft_consensus.cc:2258] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:14.657028 18890 raft_consensus.cc:2229] T d4a8859b65484ac587df17e610090fc3 P 8f9eecd9faa64e16ba4383e5ad0def66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:11:14.657303 18890 raft_consensus.cc:2258] T d4a8859b65484ac587df17e610090fc3 P 8f9eecd9faa64e16ba4383e5ad0def66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:14.659137 18893 ts_tablet_manager.cc:1905] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:14.662070 18819 tablet_bootstrap.cc:492] T 06e436b35f134f61a756ab34973094fb P 208fee4901d946e09dea603be4ebd29b: Bootstrap starting.
I20260809 20:11:14.663648 18819 tablet_bootstrap.cc:654] T 06e436b35f134f61a756ab34973094fb P 208fee4901d946e09dea603be4ebd29b: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:14.665203 18893 ts_tablet_manager.cc:1918] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 20:11:14.665366 18893 log.cc:1196] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-1/wal/wals/d4a8859b65484ac587df17e610090fc3
I20260809 20:11:14.665901 18893 ts_tablet_manager.cc:1939] T d4a8859b65484ac587df17e610090fc3 P 70528b1b04a34d20927fbc1694432d7e: Deleting consensus metadata
I20260809 20:11:14.667585 17954 catalog_manager.cc:4841] TS 70528b1b04a34d20927fbc1694432d7e (127.14.181.2:35553): tablet d4a8859b65484ac587df17e610090fc3 (table test-table [id=f059e22c97974b29ae6146b9bdbde721]) successfully deleted
I20260809 20:11:14.669065 18890 ts_tablet_manager.cc:1905] T d4a8859b65484ac587df17e610090fc3 P 8f9eecd9faa64e16ba4383e5ad0def66: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:14.669900 18819 tablet_bootstrap.cc:492] T 06e436b35f134f61a756ab34973094fb P 208fee4901d946e09dea603be4ebd29b: No bootstrap required, opened a new log
I20260809 20:11:14.670039 18819 ts_tablet_manager.cc:1397] T 06e436b35f134f61a756ab34973094fb P 208fee4901d946e09dea603be4ebd29b: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.004s
I20260809 20:11:14.670756 18819 raft_consensus.cc:348] T 06e436b35f134f61a756ab34973094fb P 208fee4901d946e09dea603be4ebd29b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:14.670974 18819 raft_consensus.cc:374] T 06e436b35f134f61a756ab34973094fb P 208fee4901d946e09dea603be4ebd29b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:14.671041 18819 raft_consensus.cc:729] T 06e436b35f134f61a756ab34973094fb P 208fee4901d946e09dea603be4ebd29b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 208fee4901d946e09dea603be4ebd29b, State: Initialized, Role: FOLLOWER
I20260809 20:11:14.671358 18821 tablet_bootstrap.cc:492] T 06e436b35f134f61a756ab34973094fb P 70528b1b04a34d20927fbc1694432d7e: Bootstrap starting.
I20260809 20:11:14.671265 18819 consensus_queue.cc:260] T 06e436b35f134f61a756ab34973094fb P 208fee4901d946e09dea603be4ebd29b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:14.671780 18819 ts_tablet_manager.cc:1428] T 06e436b35f134f61a756ab34973094fb P 208fee4901d946e09dea603be4ebd29b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260809 20:11:14.672884 18821 tablet_bootstrap.cc:654] T 06e436b35f134f61a756ab34973094fb P 70528b1b04a34d20927fbc1694432d7e: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:14.673913 18822 tablet_bootstrap.cc:492] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66: Bootstrap starting.
I20260809 20:11:14.675545 18822 tablet_bootstrap.cc:654] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:14.676044 18890 ts_tablet_manager.cc:1918] T d4a8859b65484ac587df17e610090fc3 P 8f9eecd9faa64e16ba4383e5ad0def66: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 20:11:14.676203 18890 log.cc:1196] T d4a8859b65484ac587df17e610090fc3 P 8f9eecd9faa64e16ba4383e5ad0def66: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-0/wal/wals/d4a8859b65484ac587df17e610090fc3
I20260809 20:11:14.676700 18890 ts_tablet_manager.cc:1939] T d4a8859b65484ac587df17e610090fc3 P 8f9eecd9faa64e16ba4383e5ad0def66: Deleting consensus metadata
I20260809 20:11:14.678399 17952 catalog_manager.cc:4841] TS 8f9eecd9faa64e16ba4383e5ad0def66 (127.14.181.1:44585): tablet d4a8859b65484ac587df17e610090fc3 (table test-table [id=f059e22c97974b29ae6146b9bdbde721]) successfully deleted
I20260809 20:11:14.680248 18822 tablet_bootstrap.cc:492] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66: No bootstrap required, opened a new log
I20260809 20:11:14.680440 18822 ts_tablet_manager.cc:1397] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.004s
I20260809 20:11:14.680912 18821 tablet_bootstrap.cc:492] T 06e436b35f134f61a756ab34973094fb P 70528b1b04a34d20927fbc1694432d7e: No bootstrap required, opened a new log
I20260809 20:11:14.681066 18821 ts_tablet_manager.cc:1397] T 06e436b35f134f61a756ab34973094fb P 70528b1b04a34d20927fbc1694432d7e: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.001s
I20260809 20:11:14.680979 18822 raft_consensus.cc:348] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:14.681201 18822 raft_consensus.cc:374] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:14.681273 18822 raft_consensus.cc:729] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9eecd9faa64e16ba4383e5ad0def66, State: Initialized, Role: FOLLOWER
I20260809 20:11:14.681499 18822 consensus_queue.cc:260] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:14.681978 18822 ts_tablet_manager.cc:1428] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 20:11:14.681942 18821 raft_consensus.cc:348] T 06e436b35f134f61a756ab34973094fb P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:14.682174 18821 raft_consensus.cc:374] T 06e436b35f134f61a756ab34973094fb P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:14.682252 18821 raft_consensus.cc:729] T 06e436b35f134f61a756ab34973094fb P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70528b1b04a34d20927fbc1694432d7e, State: Initialized, Role: FOLLOWER
I20260809 20:11:14.682520 18821 consensus_queue.cc:260] T 06e436b35f134f61a756ab34973094fb P 70528b1b04a34d20927fbc1694432d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:14.685122 18821 ts_tablet_manager.cc:1428] T 06e436b35f134f61a756ab34973094fb P 70528b1b04a34d20927fbc1694432d7e: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260809 20:11:14.791738 18826 raft_consensus.cc:482] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:11:14.792006 18826 raft_consensus.cc:504] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:14.793956 18826 leader_election.cc:288] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70528b1b04a34d20927fbc1694432d7e (127.14.181.2:35553), 208fee4901d946e09dea603be4ebd29b (127.14.181.3:38187)
I20260809 20:11:14.813619 18815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:14.794498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:60709 (local address 127.14.181.2:35553)
0809 20:11:14.794698 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:14.794704 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:14.806481 (+ 11777us) server_negotiation.cc:407] Connection header received
0809 20:11:14.806993 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:14.807000 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:14.807085 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:14.807150 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:14.808007 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.809186 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.811353 (+ 2167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.812658 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.812809 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:14.812880 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:14.813211 (+ 331us) server_negotiation.cc:299] Negotiation successful
0809 20:11:14.813344 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 20:11:14.813653 18902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:14.794123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:35553 (local address 127.14.181.1:60709)
0809 20:11:14.806360 (+ 12237us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:14.806383 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:14.806792 (+ 409us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:14.807376 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:14.807382 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:14.807411 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:14.807808 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:14.807819 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.809357 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.809363 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:14.811181 (+ 1818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:14.811194 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.812831 (+ 1637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.812838 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:14.813018 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:14.813056 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 20:11:14.813156 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 20:11:14.813293 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12067,"thread_start_us":15068,"threads_started":1}
I20260809 20:11:14.814755 18466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06e436b35f134f61a756ab34973094fb" candidate_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70528b1b04a34d20927fbc1694432d7e" is_pre_election: true
I20260809 20:11:14.815160 18466 raft_consensus.cc:2454] T 06e436b35f134f61a756ab34973094fb P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f9eecd9faa64e16ba4383e5ad0def66 in term 0.
I20260809 20:11:14.815665 18900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:14.794218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:38187 (local address 127.14.181.1:44081)
0809 20:11:14.808988 (+ 14770us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:14.809005 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:14.809138 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:14.809694 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:14.809699 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:14.809723 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:14.810121 (+ 398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:14.810136 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.811595 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.811601 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:14.813399 (+ 1798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:14.813413 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.814953 (+ 1540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.814959 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:14.815131 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:14.815154 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 20:11:14.815233 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 20:11:14.815347 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14647,"thread_start_us":12281,"threads_started":1}
I20260809 20:11:14.815825 18133 leader_election.cc:302] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70528b1b04a34d20927fbc1694432d7e, 8f9eecd9faa64e16ba4383e5ad0def66; no voters:
I20260809 20:11:14.815996 18903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:14.794924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:44081 (local address 127.14.181.3:38187)
0809 20:11:14.808282 (+ 13358us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:14.808288 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:14.809112 (+ 824us) server_negotiation.cc:407] Connection header received
0809 20:11:14.809317 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:14.809324 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:14.809403 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:14.809480 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:14.810324 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.811429 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.813580 (+ 2151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.814752 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.814898 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:14.814966 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:14.815275 (+ 309us) server_negotiation.cc:299] Negotiation successful
0809 20:11:14.815484 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13220,"thread_start_us":13373,"threads_started":1}
I20260809 20:11:14.816218 18826 raft_consensus.cc:2781] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:11:14.816337 18826 raft_consensus.cc:482] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:11:14.816416 18826 raft_consensus.cc:3037] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:14.816473 18700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06e436b35f134f61a756ab34973094fb" candidate_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "208fee4901d946e09dea603be4ebd29b" is_pre_election: true
I20260809 20:11:14.816691 18700 raft_consensus.cc:2454] T 06e436b35f134f61a756ab34973094fb P 208fee4901d946e09dea603be4ebd29b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f9eecd9faa64e16ba4383e5ad0def66 in term 0.
I20260809 20:11:14.819537 18826 raft_consensus.cc:504] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:14.820251 18826 leader_election.cc:288] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66 [CANDIDATE]: Term 1 election: Requested vote from peers 70528b1b04a34d20927fbc1694432d7e (127.14.181.2:35553), 208fee4901d946e09dea603be4ebd29b (127.14.181.3:38187)
I20260809 20:11:14.820637 18466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06e436b35f134f61a756ab34973094fb" candidate_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70528b1b04a34d20927fbc1694432d7e"
I20260809 20:11:14.820794 18700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06e436b35f134f61a756ab34973094fb" candidate_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "208fee4901d946e09dea603be4ebd29b"
I20260809 20:11:14.820871 18466 raft_consensus.cc:3037] T 06e436b35f134f61a756ab34973094fb P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:14.820997 18700 raft_consensus.cc:3037] T 06e436b35f134f61a756ab34973094fb P 208fee4901d946e09dea603be4ebd29b [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:14.824113 18700 raft_consensus.cc:2454] T 06e436b35f134f61a756ab34973094fb P 208fee4901d946e09dea603be4ebd29b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9eecd9faa64e16ba4383e5ad0def66 in term 1.
I20260809 20:11:14.824270 18466 raft_consensus.cc:2454] T 06e436b35f134f61a756ab34973094fb P 70528b1b04a34d20927fbc1694432d7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9eecd9faa64e16ba4383e5ad0def66 in term 1.
I20260809 20:11:14.824600 18134 leader_election.cc:302] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 208fee4901d946e09dea603be4ebd29b, 8f9eecd9faa64e16ba4383e5ad0def66; no voters:
I20260809 20:11:14.824954 18826 raft_consensus.cc:2781] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:14.825424 18826 raft_consensus.cc:686] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66 [term 1 LEADER]: Becoming Leader. State: Replica: 8f9eecd9faa64e16ba4383e5ad0def66, State: Running, Role: LEADER
I20260809 20:11:14.825865 18826 consensus_queue.cc:237] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:14.829741 17980 catalog_manager.cc:5495] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f9eecd9faa64e16ba4383e5ad0def66 (127.14.181.1). New cstate: current_term: 1 leader_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } health_report { overall_health: UNKNOWN } } }
I20260809 20:11:14.880895 18909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:14.872295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55496 (local address 127.14.181.1:44585)
0809 20:11:14.875444 (+ 3149us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:14.875448 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:14.875466 (+ 18us) server_negotiation.cc:407] Connection header received
0809 20:11:14.875537 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:14.875541 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:14.875609 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:14.875747 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:11:14.876194 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.876951 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.878783 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.879186 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.879272 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:14.879757 (+ 485us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:11:14.880273 (+ 516us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:11:14.880374 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:14.880506 (+ 132us) server_negotiation.cc:299] Negotiation successful
0809 20:11:14.880567 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3049,"thread_start_us":2924,"threads_started":1}
I20260809 20:11:14.895457 18815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:14.890293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:48997 (local address 127.14.181.2:35553)
0809 20:11:14.890472 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:14.890479 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:14.890846 (+ 367us) server_negotiation.cc:407] Connection header received
0809 20:11:14.891007 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:14.891015 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:14.891078 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:14.891151 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:11:14.891605 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.892456 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.893813 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.894237 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.894364 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:14.894772 (+ 408us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:11:14.894889 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:11:14.894964 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:14.895095 (+ 131us) server_negotiation.cc:299] Negotiation successful
0809 20:11:14.895169 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 20:11:14.895537 18913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:14.890221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:35553 (local address 127.14.181.1:48997)
0809 20:11:14.890752 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:14.890766 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:14.890895 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:14.891177 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:14.891190 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:14.891202 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 20:11:14.891474 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:14.891482 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.892567 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.892573 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:14.893683 (+ 1110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:14.893697 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.894421 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.894428 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:14.894546 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:14.894594 (+ 48us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 20:11:14.894982 (+ 388us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 20:11:14.894994 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 20:11:14.895060 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 20:11:14.895194 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":267,"threads_started":1}
I20260809 20:11:14.903836 18700 raft_consensus.cc:1261] T 06e436b35f134f61a756ab34973094fb P 208fee4901d946e09dea603be4ebd29b [term 1 FOLLOWER]: Refusing update from remote peer 8f9eecd9faa64e16ba4383e5ad0def66: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:11:14.904206 18466 raft_consensus.cc:1261] T 06e436b35f134f61a756ab34973094fb P 70528b1b04a34d20927fbc1694432d7e [term 1 FOLLOWER]: Refusing update from remote peer 8f9eecd9faa64e16ba4383e5ad0def66: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:11:14.904913 18905 consensus_queue.cc:1035] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:11:14.905210 18826 consensus_queue.cc:1035] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:11:14.910036 18858 mvcc.cc:205] Tried to move back new op lower bound from 7316710502000660480 to 7316710501691359232. Current Snapshot: MvccSnapshot[applied={T|T < 7316710502000660480}]
I20260809 20:11:14.931437 18909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:14.925876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:36941 (local address 127.14.181.1:44585)
0809 20:11:14.926310 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:14.926315 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:14.926567 (+ 252us) server_negotiation.cc:407] Connection header received
0809 20:11:14.926668 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:14.926671 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:14.926732 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:14.926806 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:11:14.927158 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.928057 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.929717 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.930268 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.930413 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:14.930771 (+ 358us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:11:14.930866 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:11:14.930934 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:14.931062 (+ 128us) server_negotiation.cc:299] Negotiation successful
0809 20:11:14.931135 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323}
I20260809 20:11:14.931466 18881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:14.925545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:44585 (local address 127.14.181.2:36941)
0809 20:11:14.926424 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:14.926444 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:14.926556 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:14.926843 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:14.926848 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:14.926861 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 20:11:14.927039 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:14.927048 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.928227 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.928233 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:14.929567 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:14.929580 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:14.930446 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:14.930453 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:14.930596 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:14.930632 (+ 36us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 20:11:14.930956 (+ 324us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 20:11:14.930967 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 20:11:14.931033 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 20:11:14.931190 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":707}
W20260809 20:11:14.933024 18889 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 20:11:16.523167 17981 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56434:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:11:16.523388 17981 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56434:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:11:16.527027 17981 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7b67434792d9426eb98364d99a9ae2b9: Sending DeleteTablet for 3 replicas of tablet 06e436b35f134f61a756ab34973094fb
I20260809 20:11:16.527653 18218 tablet_service.cc:1514] Processing DeleteTablet for tablet 06e436b35f134f61a756ab34973094fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:16 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:55494
I20260809 20:11:16.527904 18665 tablet_service.cc:1514] Processing DeleteTablet for tablet 06e436b35f134f61a756ab34973094fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:16 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:53604
I20260809 20:11:16.527920 18437 tablet_service.cc:1514] Processing DeleteTablet for tablet 06e436b35f134f61a756ab34973094fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:16 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:50068
I20260809 20:11:16.540774 18961 tablet_replica.cc:330] T 06e436b35f134f61a756ab34973094fb P 208fee4901d946e09dea603be4ebd29b: stopping tablet replica
I20260809 20:11:16.540952 18961 raft_consensus.cc:2229] T 06e436b35f134f61a756ab34973094fb P 208fee4901d946e09dea603be4ebd29b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:11:16.541286 18961 raft_consensus.cc:2258] T 06e436b35f134f61a756ab34973094fb P 208fee4901d946e09dea603be4ebd29b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:16.541656 18959 tablet_replica.cc:330] T 06e436b35f134f61a756ab34973094fb P 70528b1b04a34d20927fbc1694432d7e: stopping tablet replica
I20260809 20:11:16.541834 18959 raft_consensus.cc:2229] T 06e436b35f134f61a756ab34973094fb P 70528b1b04a34d20927fbc1694432d7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:11:16.542044 18959 raft_consensus.cc:2258] T 06e436b35f134f61a756ab34973094fb P 70528b1b04a34d20927fbc1694432d7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:16.542766 18961 ts_tablet_manager.cc:1905] T 06e436b35f134f61a756ab34973094fb P 208fee4901d946e09dea603be4ebd29b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:16.544021 18959 ts_tablet_manager.cc:1905] T 06e436b35f134f61a756ab34973094fb P 70528b1b04a34d20927fbc1694432d7e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:16.545331 18956 tablet_replica.cc:330] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66: stopping tablet replica
I20260809 20:11:16.545511 18956 raft_consensus.cc:2229] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66 [term 1 LEADER]: Raft consensus shutting down.
I20260809 20:11:16.545993 18956 raft_consensus.cc:2258] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:16.550415 18961 ts_tablet_manager.cc:1918] T 06e436b35f134f61a756ab34973094fb P 208fee4901d946e09dea603be4ebd29b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 20:11:16.550550 18961 log.cc:1196] T 06e436b35f134f61a756ab34973094fb P 208fee4901d946e09dea603be4ebd29b: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-2/wal/wals/06e436b35f134f61a756ab34973094fb
I20260809 20:11:16.551064 18961 ts_tablet_manager.cc:1939] T 06e436b35f134f61a756ab34973094fb P 208fee4901d946e09dea603be4ebd29b: Deleting consensus metadata
I20260809 20:11:16.551342 18959 ts_tablet_manager.cc:1918] T 06e436b35f134f61a756ab34973094fb P 70528b1b04a34d20927fbc1694432d7e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 20:11:16.551460 18959 log.cc:1196] T 06e436b35f134f61a756ab34973094fb P 70528b1b04a34d20927fbc1694432d7e: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-1/wal/wals/06e436b35f134f61a756ab34973094fb
I20260809 20:11:16.551872 18959 ts_tablet_manager.cc:1939] T 06e436b35f134f61a756ab34973094fb P 70528b1b04a34d20927fbc1694432d7e: Deleting consensus metadata
I20260809 20:11:16.552208 17955 catalog_manager.cc:4841] TS 208fee4901d946e09dea603be4ebd29b (127.14.181.3:38187): tablet 06e436b35f134f61a756ab34973094fb (table test-table [id=f953af106430427fba5c9239e04177b2]) successfully deleted
I20260809 20:11:16.552824 17954 catalog_manager.cc:4841] TS 70528b1b04a34d20927fbc1694432d7e (127.14.181.2:35553): tablet 06e436b35f134f61a756ab34973094fb (table test-table [id=f953af106430427fba5c9239e04177b2]) successfully deleted
I20260809 20:11:16.553292 18956 ts_tablet_manager.cc:1905] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:16.559614 18956 ts_tablet_manager.cc:1918] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 20:11:16.559729 18956 log.cc:1196] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-0/wal/wals/06e436b35f134f61a756ab34973094fb
I20260809 20:11:16.560077 18956 ts_tablet_manager.cc:1939] T 06e436b35f134f61a756ab34973094fb P 8f9eecd9faa64e16ba4383e5ad0def66: Deleting consensus metadata
I20260809 20:11:16.560912 17952 catalog_manager.cc:4841] TS 8f9eecd9faa64e16ba4383e5ad0def66 (127.14.181.1:44585): tablet 06e436b35f134f61a756ab34973094fb (table test-table [id=f953af106430427fba5c9239e04177b2]) successfully deleted
Aug 09 20:11:16 dist-test-slave-6zbq krb5kdc[17895](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306276, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 20:11:16 dist-test-slave-6zbq krb5kdc[17895](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306276, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:16.582594 18978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:16.569372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37332 (local address 127.14.181.62:36821)
0809 20:11:16.569908 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:16.569914 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:16.569997 (+ 83us) server_negotiation.cc:407] Connection header received
0809 20:11:16.570168 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:16.570172 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:16.570248 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:16.570359 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:16.571584 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:16.572339 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:16.573577 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:16.573980 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:16.574090 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:16.577672 (+ 3582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:16.577676 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:16.577680 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:16.577712 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:16.580193 (+ 2481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:16.580798 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:16.580802 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:16.580805 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:16.580927 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:16.581260 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:16.581265 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:16.581269 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:16.581523 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:16.581732 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:16.582024 (+ 292us) server_negotiation.cc:299] Negotiation successful
0809 20:11:16.582249 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":258,"threads_started":1}
I20260809 20:11:16.585520 17981 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37332:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 20:11:16.586079 17981 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 20:11:16.592037 18218 tablet_service.cc:1467] Processing CreateTablet for tablet f50494107ad241118144859f7dddfd1b (DEFAULT_TABLE table=test-table [id=bd45a4c70fc84f2b83f3cfbc3106f539]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:16.592233 18665 tablet_service.cc:1467] Processing CreateTablet for tablet f50494107ad241118144859f7dddfd1b (DEFAULT_TABLE table=test-table [id=bd45a4c70fc84f2b83f3cfbc3106f539]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:16.592479 18218 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f50494107ad241118144859f7dddfd1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:16.592640 18665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f50494107ad241118144859f7dddfd1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:16.596202 18437 tablet_service.cc:1467] Processing CreateTablet for tablet f50494107ad241118144859f7dddfd1b (DEFAULT_TABLE table=test-table [id=bd45a4c70fc84f2b83f3cfbc3106f539]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:16.596647 18437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f50494107ad241118144859f7dddfd1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:16.597710 18979 tablet_bootstrap.cc:492] T f50494107ad241118144859f7dddfd1b P 8f9eecd9faa64e16ba4383e5ad0def66: Bootstrap starting.
I20260809 20:11:16.598861 18981 tablet_bootstrap.cc:492] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b: Bootstrap starting.
I20260809 20:11:16.599298 18979 tablet_bootstrap.cc:654] T f50494107ad241118144859f7dddfd1b P 8f9eecd9faa64e16ba4383e5ad0def66: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:16.600474 18981 tablet_bootstrap.cc:654] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:16.601342 18979 tablet_bootstrap.cc:492] T f50494107ad241118144859f7dddfd1b P 8f9eecd9faa64e16ba4383e5ad0def66: No bootstrap required, opened a new log
I20260809 20:11:16.601498 18979 ts_tablet_manager.cc:1397] T f50494107ad241118144859f7dddfd1b P 8f9eecd9faa64e16ba4383e5ad0def66: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260809 20:11:16.602401 18987 tablet_bootstrap.cc:492] T f50494107ad241118144859f7dddfd1b P 70528b1b04a34d20927fbc1694432d7e: Bootstrap starting.
I20260809 20:11:16.602293 18979 raft_consensus.cc:348] T f50494107ad241118144859f7dddfd1b P 8f9eecd9faa64e16ba4383e5ad0def66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:16.602576 18979 raft_consensus.cc:374] T f50494107ad241118144859f7dddfd1b P 8f9eecd9faa64e16ba4383e5ad0def66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:16.602674 18979 raft_consensus.cc:729] T f50494107ad241118144859f7dddfd1b P 8f9eecd9faa64e16ba4383e5ad0def66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9eecd9faa64e16ba4383e5ad0def66, State: Initialized, Role: FOLLOWER
I20260809 20:11:16.602907 18979 consensus_queue.cc:260] T f50494107ad241118144859f7dddfd1b P 8f9eecd9faa64e16ba4383e5ad0def66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:16.603457 18979 ts_tablet_manager.cc:1428] T f50494107ad241118144859f7dddfd1b P 8f9eecd9faa64e16ba4383e5ad0def66: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260809 20:11:16.604532 18987 tablet_bootstrap.cc:654] T f50494107ad241118144859f7dddfd1b P 70528b1b04a34d20927fbc1694432d7e: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:16.605885 18981 tablet_bootstrap.cc:492] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b: No bootstrap required, opened a new log
I20260809 20:11:16.606082 18981 ts_tablet_manager.cc:1397] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260809 20:11:16.607862 18981 raft_consensus.cc:348] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:16.608120 18981 raft_consensus.cc:374] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:16.608218 18981 raft_consensus.cc:729] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 208fee4901d946e09dea603be4ebd29b, State: Initialized, Role: FOLLOWER
I20260809 20:11:16.608460 18981 consensus_queue.cc:260] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:16.609484 18981 ts_tablet_manager.cc:1428] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260809 20:11:16.610137 18987 tablet_bootstrap.cc:492] T f50494107ad241118144859f7dddfd1b P 70528b1b04a34d20927fbc1694432d7e: No bootstrap required, opened a new log
I20260809 20:11:16.610277 18987 ts_tablet_manager.cc:1397] T f50494107ad241118144859f7dddfd1b P 70528b1b04a34d20927fbc1694432d7e: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260809 20:11:16.611042 18987 raft_consensus.cc:348] T f50494107ad241118144859f7dddfd1b P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:16.611265 18987 raft_consensus.cc:374] T f50494107ad241118144859f7dddfd1b P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:16.611359 18987 raft_consensus.cc:729] T f50494107ad241118144859f7dddfd1b P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70528b1b04a34d20927fbc1694432d7e, State: Initialized, Role: FOLLOWER
I20260809 20:11:16.611577 18987 consensus_queue.cc:260] T f50494107ad241118144859f7dddfd1b P 70528b1b04a34d20927fbc1694432d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:16.612119 18987 ts_tablet_manager.cc:1428] T f50494107ad241118144859f7dddfd1b P 70528b1b04a34d20927fbc1694432d7e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260809 20:11:16.617770 18990 raft_consensus.cc:482] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:11:16.617933 18990 raft_consensus.cc:504] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:16.619303 18990 leader_election.cc:288] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9eecd9faa64e16ba4383e5ad0def66 (127.14.181.1:44585), 70528b1b04a34d20927fbc1694432d7e (127.14.181.2:35553)
I20260809 20:11:16.629235 18993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:16.619551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:55337 (local address 127.14.181.1:44585)
0809 20:11:16.623956 (+ 4405us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:16.623960 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:16.624383 (+ 423us) server_negotiation.cc:407] Connection header received
0809 20:11:16.624526 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:16.624530 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:16.624582 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:16.624689 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:16.625122 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:16.625878 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:16.627571 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:16.628312 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:16.628461 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:16.628528 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:16.628794 (+ 266us) server_negotiation.cc:299] Negotiation successful
0809 20:11:16.628918 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4313,"thread_start_us":4192,"threads_started":1}
I20260809 20:11:16.629560 18996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:16.619519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:44585 (local address 127.14.181.3:55337)
0809 20:11:16.624288 (+ 4769us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:16.624305 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:16.624416 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:16.624708 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:16.624712 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:16.624735 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:16.624980 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:16.624992 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:16.626008 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:16.626013 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:16.627425 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:16.627438 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:16.628489 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:16.628494 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:16.628651 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:16.628678 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 20:11:16.628767 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 20:11:16.629010 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4681,"mutex_wait_us":79,"thread_start_us":4580,"threads_started":1}
I20260809 20:11:16.630089 18246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f50494107ad241118144859f7dddfd1b" candidate_uuid: "208fee4901d946e09dea603be4ebd29b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" is_pre_election: true
I20260809 20:11:16.630306 18246 raft_consensus.cc:2454] T f50494107ad241118144859f7dddfd1b P 8f9eecd9faa64e16ba4383e5ad0def66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 208fee4901d946e09dea603be4ebd29b in term 0.
I20260809 20:11:16.630759 18583 leader_election.cc:302] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 208fee4901d946e09dea603be4ebd29b, 8f9eecd9faa64e16ba4383e5ad0def66; no voters:
I20260809 20:11:16.631074 18990 raft_consensus.cc:2781] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:11:16.631175 18990 raft_consensus.cc:482] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:11:16.631268 18990 raft_consensus.cc:3037] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:16.632021 18998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:16.619847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:32871 (local address 127.14.181.2:35553)
0809 20:11:16.626759 (+ 6912us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:16.626763 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:16.626781 (+ 18us) server_negotiation.cc:407] Connection header received
0809 20:11:16.626829 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:16.626832 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:16.626878 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:16.626966 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:16.627607 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:16.628388 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:16.630279 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:16.631136 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:16.631297 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:16.631364 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:16.631628 (+ 264us) server_negotiation.cc:299] Negotiation successful
0809 20:11:16.631750 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6816,"thread_start_us":6679,"threads_started":1}
I20260809 20:11:16.632047 18991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:16.619500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:35553 (local address 127.14.181.3:32871)
0809 20:11:16.620099 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:16.620120 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:16.620265 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:16.627001 (+ 6736us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:16.627006 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:16.627032 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:16.627432 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:16.627442 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:16.628514 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:16.628518 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:16.630144 (+ 1626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:16.630157 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:16.631325 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:16.631331 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:16.631482 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:16.631505 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 20:11:16.631583 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 20:11:16.631707 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":542,"threads_started":1}
I20260809 20:11:16.632709 18465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f50494107ad241118144859f7dddfd1b" candidate_uuid: "208fee4901d946e09dea603be4ebd29b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70528b1b04a34d20927fbc1694432d7e" is_pre_election: true
I20260809 20:11:16.632910 18465 raft_consensus.cc:2454] T f50494107ad241118144859f7dddfd1b P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 208fee4901d946e09dea603be4ebd29b in term 0.
I20260809 20:11:16.633492 18990 raft_consensus.cc:504] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:16.634058 18990 leader_election.cc:288] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b [CANDIDATE]: Term 1 election: Requested vote from peers 8f9eecd9faa64e16ba4383e5ad0def66 (127.14.181.1:44585), 70528b1b04a34d20927fbc1694432d7e (127.14.181.2:35553)
I20260809 20:11:16.634392 18246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f50494107ad241118144859f7dddfd1b" candidate_uuid: "208fee4901d946e09dea603be4ebd29b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9eecd9faa64e16ba4383e5ad0def66"
I20260809 20:11:16.634573 18246 raft_consensus.cc:3037] T f50494107ad241118144859f7dddfd1b P 8f9eecd9faa64e16ba4383e5ad0def66 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:16.634516 18465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f50494107ad241118144859f7dddfd1b" candidate_uuid: "208fee4901d946e09dea603be4ebd29b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70528b1b04a34d20927fbc1694432d7e"
I20260809 20:11:16.634696 18465 raft_consensus.cc:3037] T f50494107ad241118144859f7dddfd1b P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:16.636487 18246 raft_consensus.cc:2454] T f50494107ad241118144859f7dddfd1b P 8f9eecd9faa64e16ba4383e5ad0def66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 208fee4901d946e09dea603be4ebd29b in term 1.
I20260809 20:11:16.636749 18465 raft_consensus.cc:2454] T f50494107ad241118144859f7dddfd1b P 70528b1b04a34d20927fbc1694432d7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 208fee4901d946e09dea603be4ebd29b in term 1.
I20260809 20:11:16.636798 18583 leader_election.cc:302] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 208fee4901d946e09dea603be4ebd29b, 8f9eecd9faa64e16ba4383e5ad0def66; no voters:
I20260809 20:11:16.637053 18990 raft_consensus.cc:2781] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:16.637486 18990 raft_consensus.cc:686] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b [term 1 LEADER]: Becoming Leader. State: Replica: 208fee4901d946e09dea603be4ebd29b, State: Running, Role: LEADER
I20260809 20:11:16.637805 18990 consensus_queue.cc:237] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:16.640853 17981 catalog_manager.cc:5495] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b reported cstate change: term changed from 0 to 1, leader changed from <none> to 208fee4901d946e09dea603be4ebd29b (127.14.181.3). New cstate: current_term: 1 leader_uuid: "208fee4901d946e09dea603be4ebd29b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } health_report { overall_health: HEALTHY } } }
I20260809 20:11:16.663774 19007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:16.658819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56798 (local address 127.14.181.3:38187)
0809 20:11:16.659288 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:16.659292 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:16.659310 (+ 18us) server_negotiation.cc:407] Connection header received
0809 20:11:16.659377 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:16.659380 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:16.659442 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:16.659564 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:11:16.659850 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:16.660574 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:16.661762 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:16.662123 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:16.662207 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:16.662704 (+ 497us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:11:16.663228 (+ 524us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:11:16.663329 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:16.663398 (+ 69us) server_negotiation.cc:299] Negotiation successful
0809 20:11:16.663455 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":271,"threads_started":1}
I20260809 20:11:16.676676 18998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:16.672328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:36825 (local address 127.14.181.2:35553)
0809 20:11:16.672478 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:16.672482 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:16.672713 (+ 231us) server_negotiation.cc:407] Connection header received
0809 20:11:16.672837 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:16.672841 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:16.672896 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:16.672965 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:11:16.673348 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:16.674070 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:16.675376 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:16.675752 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:16.675838 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:16.676188 (+ 350us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:11:16.676287 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:11:16.676350 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:16.676439 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 20:11:16.676493 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 20:11:16.676815 19012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:16.672107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:35553 (local address 127.14.181.3:36825)
0809 20:11:16.672640 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:16.672655 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:16.672757 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:16.672981 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:16.672984 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:16.672993 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 20:11:16.673250 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:16.673257 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:16.674176 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:16.674179 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:16.675266 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:16.675278 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:16.675885 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:16.675890 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:16.676002 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:16.676049 (+ 47us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 20:11:16.676360 (+ 311us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 20:11:16.676368 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 20:11:16.676418 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 20:11:16.676505 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":272,"threads_started":1}
I20260809 20:11:16.684108 18465 raft_consensus.cc:1261] T f50494107ad241118144859f7dddfd1b P 70528b1b04a34d20927fbc1694432d7e [term 1 FOLLOWER]: Refusing update from remote peer 208fee4901d946e09dea603be4ebd29b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:11:16.684125 18246 raft_consensus.cc:1261] T f50494107ad241118144859f7dddfd1b P 8f9eecd9faa64e16ba4383e5ad0def66 [term 1 FOLLOWER]: Refusing update from remote peer 208fee4901d946e09dea603be4ebd29b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:11:16.684738 18999 consensus_queue.cc:1035] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b [LEADER]: Connected to new peer: Peer: permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:11:16.685052 18990 consensus_queue.cc:1035] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:11:16.710291 19007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:16.705232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:34899 (local address 127.14.181.3:38187)
0809 20:11:16.705362 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:16.705366 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:16.705865 (+ 499us) server_negotiation.cc:407] Connection header received
0809 20:11:16.705988 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:16.705992 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:16.706044 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:16.706112 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:11:16.706569 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:16.707468 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:16.708890 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:16.709287 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:16.709375 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:16.709665 (+ 290us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:11:16.709767 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:11:16.709828 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:16.709976 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 20:11:16.710040 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 20:11:16.710363 19019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:16.705188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:38187 (local address 127.14.181.2:34899)
0809 20:11:16.705794 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:16.705809 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:16.705908 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:16.706124 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:16.706127 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:16.706135 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 20:11:16.706413 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:16.706424 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:16.707603 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:16.707608 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:16.708771 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:16.708785 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:16.709414 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:16.709419 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:16.709533 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:16.709564 (+ 31us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 20:11:16.709858 (+ 294us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 20:11:16.709869 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 20:11:16.709934 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 20:11:16.710059 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":338,"threads_started":1}
I20260809 20:11:16.734123 17980 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37332:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:11:16.734367 17980 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37332:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:11:16.737032 17980 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7b67434792d9426eb98364d99a9ae2b9: Sending DeleteTablet for 3 replicas of tablet f50494107ad241118144859f7dddfd1b
I20260809 20:11:16.737707 18218 tablet_service.cc:1514] Processing DeleteTablet for tablet f50494107ad241118144859f7dddfd1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:16 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:55494
I20260809 20:11:16.737957 18956 tablet_replica.cc:330] T f50494107ad241118144859f7dddfd1b P 8f9eecd9faa64e16ba4383e5ad0def66: stopping tablet replica
I20260809 20:11:16.738163 18956 raft_consensus.cc:2229] T f50494107ad241118144859f7dddfd1b P 8f9eecd9faa64e16ba4383e5ad0def66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:11:16.738284 18437 tablet_service.cc:1514] Processing DeleteTablet for tablet f50494107ad241118144859f7dddfd1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:16 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:50068
I20260809 20:11:16.738368 18956 raft_consensus.cc:2258] T f50494107ad241118144859f7dddfd1b P 8f9eecd9faa64e16ba4383e5ad0def66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:16.738540 18959 tablet_replica.cc:330] T f50494107ad241118144859f7dddfd1b P 70528b1b04a34d20927fbc1694432d7e: stopping tablet replica
I20260809 20:11:16.738714 18959 raft_consensus.cc:2229] T f50494107ad241118144859f7dddfd1b P 70528b1b04a34d20927fbc1694432d7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:11:16.738874 18959 raft_consensus.cc:2258] T f50494107ad241118144859f7dddfd1b P 70528b1b04a34d20927fbc1694432d7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:16.739079 17980 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37332:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 20:11:16.739650 18956 ts_tablet_manager.cc:1905] T f50494107ad241118144859f7dddfd1b P 8f9eecd9faa64e16ba4383e5ad0def66: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:16.739708 18665 tablet_service.cc:1514] Processing DeleteTablet for tablet f50494107ad241118144859f7dddfd1b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:16 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:53604
W20260809 20:11:16.739770 17980 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 20:11:16.739946 18961 tablet_replica.cc:330] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b: stopping tablet replica
I20260809 20:11:16.740131 18961 raft_consensus.cc:2229] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b [term 1 LEADER]: Raft consensus shutting down.
I20260809 20:11:16.740569 18961 raft_consensus.cc:2258] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:16.741606 18959 ts_tablet_manager.cc:1905] T f50494107ad241118144859f7dddfd1b P 70528b1b04a34d20927fbc1694432d7e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:16.741729 18961 ts_tablet_manager.cc:1905] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:16.745873 18956 ts_tablet_manager.cc:1918] T f50494107ad241118144859f7dddfd1b P 8f9eecd9faa64e16ba4383e5ad0def66: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 20:11:16.746065 18956 log.cc:1196] T f50494107ad241118144859f7dddfd1b P 8f9eecd9faa64e16ba4383e5ad0def66: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-0/wal/wals/f50494107ad241118144859f7dddfd1b
I20260809 20:11:16.746551 18956 ts_tablet_manager.cc:1939] T f50494107ad241118144859f7dddfd1b P 8f9eecd9faa64e16ba4383e5ad0def66: Deleting consensus metadata
I20260809 20:11:16.747613 17952 catalog_manager.cc:4841] TS 8f9eecd9faa64e16ba4383e5ad0def66 (127.14.181.1:44585): tablet f50494107ad241118144859f7dddfd1b (table test-table [id=bd45a4c70fc84f2b83f3cfbc3106f539]) successfully deleted
I20260809 20:11:16.747792 18959 ts_tablet_manager.cc:1918] T f50494107ad241118144859f7dddfd1b P 70528b1b04a34d20927fbc1694432d7e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 20:11:16.747963 18959 log.cc:1196] T f50494107ad241118144859f7dddfd1b P 70528b1b04a34d20927fbc1694432d7e: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-1/wal/wals/f50494107ad241118144859f7dddfd1b
I20260809 20:11:16.748299 18959 ts_tablet_manager.cc:1939] T f50494107ad241118144859f7dddfd1b P 70528b1b04a34d20927fbc1694432d7e: Deleting consensus metadata
I20260809 20:11:16.748910 18961 ts_tablet_manager.cc:1918] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 20:11:16.749073 18961 log.cc:1196] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-2/wal/wals/f50494107ad241118144859f7dddfd1b
I20260809 20:11:16.749079 17954 catalog_manager.cc:4841] TS 70528b1b04a34d20927fbc1694432d7e (127.14.181.2:35553): tablet f50494107ad241118144859f7dddfd1b (table test-table [id=bd45a4c70fc84f2b83f3cfbc3106f539]) successfully deleted
I20260809 20:11:16.749536 18961 ts_tablet_manager.cc:1939] T f50494107ad241118144859f7dddfd1b P 208fee4901d946e09dea603be4ebd29b: Deleting consensus metadata
I20260809 20:11:16.750591 17955 catalog_manager.cc:4841] TS 208fee4901d946e09dea603be4ebd29b (127.14.181.3:38187): tablet f50494107ad241118144859f7dddfd1b (table test-table [id=bd45a4c70fc84f2b83f3cfbc3106f539]) successfully deleted
I20260809 20:11:16.756206 18218 tablet_service.cc:1467] Processing CreateTablet for tablet bf6f63c791de4b319c388557cc2c8336 (DEFAULT_TABLE table=test-table [id=48b9b81e2eea43249f8006976f0e1273]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:16.756618 18218 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf6f63c791de4b319c388557cc2c8336. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:16.756582 18437 tablet_service.cc:1467] Processing CreateTablet for tablet bf6f63c791de4b319c388557cc2c8336 (DEFAULT_TABLE table=test-table [id=48b9b81e2eea43249f8006976f0e1273]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:16.756897 18437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf6f63c791de4b319c388557cc2c8336. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:16.758903 18665 tablet_service.cc:1467] Processing CreateTablet for tablet bf6f63c791de4b319c388557cc2c8336 (DEFAULT_TABLE table=test-table [id=48b9b81e2eea43249f8006976f0e1273]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:16.759248 18665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bf6f63c791de4b319c388557cc2c8336. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:16.762826 18979 tablet_bootstrap.cc:492] T bf6f63c791de4b319c388557cc2c8336 P 8f9eecd9faa64e16ba4383e5ad0def66: Bootstrap starting.
I20260809 20:11:16.764389 18979 tablet_bootstrap.cc:654] T bf6f63c791de4b319c388557cc2c8336 P 8f9eecd9faa64e16ba4383e5ad0def66: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:16.765990 18987 tablet_bootstrap.cc:492] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e: Bootstrap starting.
I20260809 20:11:16.767416 18979 tablet_bootstrap.cc:492] T bf6f63c791de4b319c388557cc2c8336 P 8f9eecd9faa64e16ba4383e5ad0def66: No bootstrap required, opened a new log
I20260809 20:11:16.767477 18981 tablet_bootstrap.cc:492] T bf6f63c791de4b319c388557cc2c8336 P 208fee4901d946e09dea603be4ebd29b: Bootstrap starting.
I20260809 20:11:16.767588 18979 ts_tablet_manager.cc:1397] T bf6f63c791de4b319c388557cc2c8336 P 8f9eecd9faa64e16ba4383e5ad0def66: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s
I20260809 20:11:16.767619 18987 tablet_bootstrap.cc:654] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:16.768318 18979 raft_consensus.cc:348] T bf6f63c791de4b319c388557cc2c8336 P 8f9eecd9faa64e16ba4383e5ad0def66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:16.768565 18979 raft_consensus.cc:374] T bf6f63c791de4b319c388557cc2c8336 P 8f9eecd9faa64e16ba4383e5ad0def66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:16.768649 18979 raft_consensus.cc:729] T bf6f63c791de4b319c388557cc2c8336 P 8f9eecd9faa64e16ba4383e5ad0def66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9eecd9faa64e16ba4383e5ad0def66, State: Initialized, Role: FOLLOWER
I20260809 20:11:16.768887 18979 consensus_queue.cc:260] T bf6f63c791de4b319c388557cc2c8336 P 8f9eecd9faa64e16ba4383e5ad0def66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:16.769062 18981 tablet_bootstrap.cc:654] T bf6f63c791de4b319c388557cc2c8336 P 208fee4901d946e09dea603be4ebd29b: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:16.771857 18979 ts_tablet_manager.cc:1428] T bf6f63c791de4b319c388557cc2c8336 P 8f9eecd9faa64e16ba4383e5ad0def66: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260809 20:11:16.775270 18987 tablet_bootstrap.cc:492] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e: No bootstrap required, opened a new log
I20260809 20:11:16.775435 18987 ts_tablet_manager.cc:1397] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.001s
I20260809 20:11:16.775878 18981 tablet_bootstrap.cc:492] T bf6f63c791de4b319c388557cc2c8336 P 208fee4901d946e09dea603be4ebd29b: No bootstrap required, opened a new log
I20260809 20:11:16.776042 18981 ts_tablet_manager.cc:1397] T bf6f63c791de4b319c388557cc2c8336 P 208fee4901d946e09dea603be4ebd29b: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.005s
I20260809 20:11:16.776178 18987 raft_consensus.cc:348] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:16.776419 18987 raft_consensus.cc:374] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:16.776505 18987 raft_consensus.cc:729] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70528b1b04a34d20927fbc1694432d7e, State: Initialized, Role: FOLLOWER
I20260809 20:11:16.776751 18987 consensus_queue.cc:260] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:16.776868 18981 raft_consensus.cc:348] T bf6f63c791de4b319c388557cc2c8336 P 208fee4901d946e09dea603be4ebd29b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:16.777100 18981 raft_consensus.cc:374] T bf6f63c791de4b319c388557cc2c8336 P 208fee4901d946e09dea603be4ebd29b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:16.777181 18981 raft_consensus.cc:729] T bf6f63c791de4b319c388557cc2c8336 P 208fee4901d946e09dea603be4ebd29b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 208fee4901d946e09dea603be4ebd29b, State: Initialized, Role: FOLLOWER
I20260809 20:11:16.777275 18987 ts_tablet_manager.cc:1428] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260809 20:11:16.777419 18981 consensus_queue.cc:260] T bf6f63c791de4b319c388557cc2c8336 P 208fee4901d946e09dea603be4ebd29b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:16.777878 18981 ts_tablet_manager.cc:1428] T bf6f63c791de4b319c388557cc2c8336 P 208fee4901d946e09dea603be4ebd29b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260809 20:11:16.791044 19001 raft_consensus.cc:482] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:11:16.791208 19001 raft_consensus.cc:504] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:16.791858 19001 leader_election.cc:288] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f9eecd9faa64e16ba4383e5ad0def66 (127.14.181.1:44585), 208fee4901d946e09dea603be4ebd29b (127.14.181.3:38187)
I20260809 20:11:16.792322 18700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf6f63c791de4b319c388557cc2c8336" candidate_uuid: "70528b1b04a34d20927fbc1694432d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "208fee4901d946e09dea603be4ebd29b" is_pre_election: true
I20260809 20:11:16.792312 18246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf6f63c791de4b319c388557cc2c8336" candidate_uuid: "70528b1b04a34d20927fbc1694432d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" is_pre_election: true
I20260809 20:11:16.792547 18700 raft_consensus.cc:2454] T bf6f63c791de4b319c388557cc2c8336 P 208fee4901d946e09dea603be4ebd29b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70528b1b04a34d20927fbc1694432d7e in term 0.
I20260809 20:11:16.792550 18246 raft_consensus.cc:2454] T bf6f63c791de4b319c388557cc2c8336 P 8f9eecd9faa64e16ba4383e5ad0def66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70528b1b04a34d20927fbc1694432d7e in term 0.
I20260809 20:11:16.793000 18357 leader_election.cc:302] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 208fee4901d946e09dea603be4ebd29b, 70528b1b04a34d20927fbc1694432d7e, 8f9eecd9faa64e16ba4383e5ad0def66; no voters:
I20260809 20:11:16.793404 19001 raft_consensus.cc:2781] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:11:16.793510 19001 raft_consensus.cc:482] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:11:16.793597 19001 raft_consensus.cc:3037] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:16.795477 19001 raft_consensus.cc:504] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:16.795969 19001 leader_election.cc:288] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e [CANDIDATE]: Term 1 election: Requested vote from peers 8f9eecd9faa64e16ba4383e5ad0def66 (127.14.181.1:44585), 208fee4901d946e09dea603be4ebd29b (127.14.181.3:38187)
I20260809 20:11:16.796387 18246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf6f63c791de4b319c388557cc2c8336" candidate_uuid: "70528b1b04a34d20927fbc1694432d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f9eecd9faa64e16ba4383e5ad0def66"
I20260809 20:11:16.796489 18700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf6f63c791de4b319c388557cc2c8336" candidate_uuid: "70528b1b04a34d20927fbc1694432d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "208fee4901d946e09dea603be4ebd29b"
I20260809 20:11:16.796597 18246 raft_consensus.cc:3037] T bf6f63c791de4b319c388557cc2c8336 P 8f9eecd9faa64e16ba4383e5ad0def66 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:16.796685 18700 raft_consensus.cc:3037] T bf6f63c791de4b319c388557cc2c8336 P 208fee4901d946e09dea603be4ebd29b [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:16.798648 18246 raft_consensus.cc:2454] T bf6f63c791de4b319c388557cc2c8336 P 8f9eecd9faa64e16ba4383e5ad0def66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70528b1b04a34d20927fbc1694432d7e in term 1.
I20260809 20:11:16.799722 18700 raft_consensus.cc:2454] T bf6f63c791de4b319c388557cc2c8336 P 208fee4901d946e09dea603be4ebd29b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70528b1b04a34d20927fbc1694432d7e in term 1.
I20260809 20:11:16.800104 18357 leader_election.cc:302] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 208fee4901d946e09dea603be4ebd29b, 70528b1b04a34d20927fbc1694432d7e; no voters:
I20260809 20:11:16.800504 19001 raft_consensus.cc:2781] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:16.800637 19001 raft_consensus.cc:686] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e [term 1 LEADER]: Becoming Leader. State: Replica: 70528b1b04a34d20927fbc1694432d7e, State: Running, Role: LEADER
I20260809 20:11:16.800868 19001 consensus_queue.cc:237] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } }
I20260809 20:11:16.803095 17981 catalog_manager.cc:5495] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e reported cstate change: term changed from 0 to 1, leader changed from <none> to 70528b1b04a34d20927fbc1694432d7e (127.14.181.2). New cstate: current_term: 1 leader_uuid: "70528b1b04a34d20927fbc1694432d7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70528b1b04a34d20927fbc1694432d7e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 } health_report { overall_health: UNKNOWN } } }
I20260809 20:11:16.826269 18998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:16.820768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50134 (local address 127.14.181.2:35553)
0809 20:11:16.821239 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:16.821245 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:16.821262 (+ 17us) server_negotiation.cc:407] Connection header received
0809 20:11:16.821342 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:16.821347 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:16.821423 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:16.821505 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:11:16.821887 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:16.823055 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:16.824431 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:16.825086 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:16.825239 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:16.825590 (+ 351us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:11:16.825711 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:11:16.825790 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:16.825900 (+ 110us) server_negotiation.cc:299] Negotiation successful
0809 20:11:16.825976 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356}
I20260809 20:11:16.834422 18700 raft_consensus.cc:1261] T bf6f63c791de4b319c388557cc2c8336 P 208fee4901d946e09dea603be4ebd29b [term 1 FOLLOWER]: Refusing update from remote peer 70528b1b04a34d20927fbc1694432d7e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:11:16.834419 18246 raft_consensus.cc:1261] T bf6f63c791de4b319c388557cc2c8336 P 8f9eecd9faa64e16ba4383e5ad0def66 [term 1 FOLLOWER]: Refusing update from remote peer 70528b1b04a34d20927fbc1694432d7e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:11:16.834946 18921 consensus_queue.cc:1035] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "208fee4901d946e09dea603be4ebd29b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:11:16.835247 19001 consensus_queue.cc:1035] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f9eecd9faa64e16ba4383e5ad0def66" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 44585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 20:11:16.857800 18918 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 20:11:18.431876 17981 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37332:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:11:18.432092 17981 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37332:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:11:18.435701 17981 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7b67434792d9426eb98364d99a9ae2b9: Sending DeleteTablet for 3 replicas of tablet bf6f63c791de4b319c388557cc2c8336
I20260809 20:11:18.436383 18218 tablet_service.cc:1514] Processing DeleteTablet for tablet bf6f63c791de4b319c388557cc2c8336 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:18 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:55494
I20260809 20:11:18.436415 18436 tablet_service.cc:1514] Processing DeleteTablet for tablet bf6f63c791de4b319c388557cc2c8336 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:18 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:50068
I20260809 20:11:18.436494 18665 tablet_service.cc:1514] Processing DeleteTablet for tablet bf6f63c791de4b319c388557cc2c8336 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:18 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:53604
I20260809 20:11:18.437280 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 18098
I20260809 20:11:18.449133 19066 tablet_replica.cc:330] T bf6f63c791de4b319c388557cc2c8336 P 8f9eecd9faa64e16ba4383e5ad0def66: stopping tablet replica
I20260809 20:11:18.449242 19069 tablet_replica.cc:330] T bf6f63c791de4b319c388557cc2c8336 P 208fee4901d946e09dea603be4ebd29b: stopping tablet replica
I20260809 20:11:18.449515 19069 raft_consensus.cc:2229] T bf6f63c791de4b319c388557cc2c8336 P 208fee4901d946e09dea603be4ebd29b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:11:18.449609 19068 tablet_replica.cc:330] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e: stopping tablet replica
I20260809 20:11:18.449807 19069 raft_consensus.cc:2258] T bf6f63c791de4b319c388557cc2c8336 P 208fee4901d946e09dea603be4ebd29b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:18.449993 19066 raft_consensus.cc:2229] T bf6f63c791de4b319c388557cc2c8336 P 8f9eecd9faa64e16ba4383e5ad0def66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:11:18.450163 19068 raft_consensus.cc:2229] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e [term 1 LEADER]: Raft consensus shutting down.
I20260809 20:11:18.450517 19066 raft_consensus.cc:2258] T bf6f63c791de4b319c388557cc2c8336 P 8f9eecd9faa64e16ba4383e5ad0def66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:18.450721 19069 ts_tablet_manager.cc:1905] T bf6f63c791de4b319c388557cc2c8336 P 208fee4901d946e09dea603be4ebd29b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:18.450917 19068 raft_consensus.cc:2258] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:18.451974 19066 ts_tablet_manager.cc:1905] T bf6f63c791de4b319c388557cc2c8336 P 8f9eecd9faa64e16ba4383e5ad0def66: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:18.453305 19068 ts_tablet_manager.cc:1905] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:18.457242 19069 ts_tablet_manager.cc:1918] T bf6f63c791de4b319c388557cc2c8336 P 208fee4901d946e09dea603be4ebd29b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 20:11:18.457406 19069 log.cc:1196] T bf6f63c791de4b319c388557cc2c8336 P 208fee4901d946e09dea603be4ebd29b: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-2/wal/wals/bf6f63c791de4b319c388557cc2c8336
I20260809 20:11:18.457836 19069 ts_tablet_manager.cc:1939] T bf6f63c791de4b319c388557cc2c8336 P 208fee4901d946e09dea603be4ebd29b: Deleting consensus metadata
I20260809 20:11:18.458843 17955 catalog_manager.cc:4841] TS 208fee4901d946e09dea603be4ebd29b (127.14.181.3:38187): tablet bf6f63c791de4b319c388557cc2c8336 (table test-table [id=48b9b81e2eea43249f8006976f0e1273]) successfully deleted
I20260809 20:11:18.459824 19068 ts_tablet_manager.cc:1918] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 20:11:18.459964 19068 log.cc:1196] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-1/wal/wals/bf6f63c791de4b319c388557cc2c8336
I20260809 20:11:18.460345 19068 ts_tablet_manager.cc:1939] T bf6f63c791de4b319c388557cc2c8336 P 70528b1b04a34d20927fbc1694432d7e: Deleting consensus metadata
I20260809 20:11:18.461355 17954 catalog_manager.cc:4841] TS 70528b1b04a34d20927fbc1694432d7e (127.14.181.2:35553): tablet bf6f63c791de4b319c388557cc2c8336 (table test-table [id=48b9b81e2eea43249f8006976f0e1273]) successfully deleted
I20260809 20:11:18.462918 19066 ts_tablet_manager.cc:1918] T bf6f63c791de4b319c388557cc2c8336 P 8f9eecd9faa64e16ba4383e5ad0def66: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 20:11:18.463054 19066 log.cc:1196] T bf6f63c791de4b319c388557cc2c8336 P 8f9eecd9faa64e16ba4383e5ad0def66: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786306256699363-15060-0/minicluster-data/ts-0/wal/wals/bf6f63c791de4b319c388557cc2c8336
I20260809 20:11:18.463482 19066 ts_tablet_manager.cc:1939] T bf6f63c791de4b319c388557cc2c8336 P 8f9eecd9faa64e16ba4383e5ad0def66: Deleting consensus metadata
Aug 09 20:11:18 dist-test-slave-6zbq krb5kdc[17895](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306276, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.181.1@KRBTEST.COM
I20260809 20:11:18.464390 17952 catalog_manager.cc:4841] TS 8f9eecd9faa64e16ba4383e5ad0def66 (127.14.181.1:44585): tablet bf6f63c791de4b319c388557cc2c8336 (table test-table [id=48b9b81e2eea43249f8006976f0e1273]) successfully deleted
I20260809 20:11:18.470158 19075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:18.438710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54024 (local address 127.14.181.1:44585)
0809 20:11:18.449762 (+ 11052us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:18.449768 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:18.449792 (+ 24us) server_negotiation.cc:407] Connection header received
0809 20:11:18.449846 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:18.449850 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:18.449935 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:18.451643 (+ 1708us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:18.451821 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:18.452884 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:18.454816 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:18.455404 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:18.455520 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:18.465258 (+ 9738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:18.465272 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:18.465288 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:18.465323 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:18.467939 (+ 2616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:18.468520 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:18.468526 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:18.468529 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:18.468671 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:18.468953 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:18.468955 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:18.468957 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:18.469281 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:18.469479 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:18.469688 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 20:11:18.469844 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10929,"thread_start_us":11339,"threads_started":1}
W20260809 20:11:18.470784 18319 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54024
W20260809 20:11:18.471321 15060 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 18098: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 20:11:18.471520 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 18098
I20260809 20:11:18.503634 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 18331
Aug 09 20:11:18 dist-test-slave-6zbq krb5kdc[17895](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306276, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.181.2@KRBTEST.COM
I20260809 20:11:18.517951 19077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:18.504312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50138 (local address 127.14.181.2:35553)
0809 20:11:18.504805 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:18.504809 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:18.504824 (+ 15us) server_negotiation.cc:407] Connection header received
0809 20:11:18.504875 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:18.504879 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:18.504934 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:18.505026 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:18.506271 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:18.507046 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:18.508224 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:18.508640 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:18.508747 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:18.512714 (+ 3967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:18.512728 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:18.512742 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:18.512773 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:18.515367 (+ 2594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:18.515962 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:18.515969 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:18.515971 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:18.516096 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:18.516428 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:18.516432 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:18.516434 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:18.516786 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:18.517089 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:18.517418 (+ 329us) server_negotiation.cc:299] Negotiation successful
0809 20:11:18.517605 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":234,"threads_started":1}
W20260809 20:11:18.518630 18544 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50138
W20260809 20:11:18.519165 15060 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 18331: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 20:11:18.519296 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 18331
I20260809 20:11:18.548668 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 18556
Aug 09 20:11:18 dist-test-slave-6zbq krb5kdc[17895](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306276, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.14.181.3@KRBTEST.COM
I20260809 20:11:18.562531 19078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:18.549374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56804 (local address 127.14.181.3:38187)
0809 20:11:18.549859 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:18.549864 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:18.549880 (+ 16us) server_negotiation.cc:407] Connection header received
0809 20:11:18.549936 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:18.549939 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:18.549998 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:18.550083 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:18.551280 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:18.552004 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:18.553176 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:18.553561 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:18.553646 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:18.557472 (+ 3826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:18.557487 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:18.557503 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:18.557540 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:18.560291 (+ 2751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:18.560853 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:18.560858 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:18.560860 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:18.560985 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:18.561265 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:18.561268 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:18.561270 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:18.561580 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:18.561802 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:18.561998 (+ 196us) server_negotiation.cc:299] Negotiation successful
0809 20:11:18.562151 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":246,"threads_started":1}
W20260809 20:11:18.563141 18778 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56804
W20260809 20:11:18.563676 15060 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 18556: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 20:11:18.563824 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 18556
I20260809 20:11:18.589846 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 17923
I20260809 20:11:18.590864 18048 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:18.705729 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 17923
2026-08-09T20:11:18Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (9009 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:11:18 dist-test-slave-6zbq krb5kdc[19084](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:11:18 dist-test-slave-6zbq krb5kdc[19084](info): set up 2 sockets
Aug 09 20:11:18 dist-test-slave-6zbq krb5kdc[19084](info): commencing operation
krb5kdc: starting...
W20260809 20:11:19.886983 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.136s user 0.003s sys 0.016s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:11:19 dist-test-slave-6zbq krb5kdc[19084](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306279, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:11:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:11:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:11:20.053355 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:43579
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:38021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:43579
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:20.352743 19109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:20.352983 19109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:20.353104 19109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:20.359870 19109 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:11:20.359962 19109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:20.360038 19109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:20.360114 19109 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:11:20.360172 19109 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:11:20.369252 19109 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:38021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:43579
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:43579
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:20.370362 19109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:20.371512 19109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:20.382365 19118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:20.382431 19117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:20.382404 19120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:20.383625 19109 server_base.cc:1034] running on GCE node
I20260809 20:11:20.384326 19109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:20.385567 19109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:20.386757 19109 hybrid_clock.cc:648] HybridClock initialized: now 1786306280386704 us; error 44 us; skew 500 ppm
I20260809 20:11:20.387034 19109 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:20 dist-test-slave-6zbq krb5kdc[19084](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306280, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:20.389714 19109 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:11:20.391024 19109 webserver.cc:460] Webserver started at http://127.14.181.62:43949/ using document root <none> and password file <none>
I20260809 20:11:20.391611 19109 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:20.391705 19109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:20.391955 19109 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:20.394685 19109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "992f45375fa844bb838da8cab6a84d25"
format_stamp: "Formatted at 2026-08-09 20:11:20 on dist-test-slave-6zbq"
server_key: "ed95a7fe6d811d0ca85590ce0be5d736"
server_key_iv: "6a62b2cf4c3f35b26c3fbb5ca4b3a629"
server_key_version: "encryptionkey@0"
I20260809 20:11:20.395412 19109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "992f45375fa844bb838da8cab6a84d25"
format_stamp: "Formatted at 2026-08-09 20:11:20 on dist-test-slave-6zbq"
server_key: "ed95a7fe6d811d0ca85590ce0be5d736"
server_key_iv: "6a62b2cf4c3f35b26c3fbb5ca4b3a629"
server_key_version: "encryptionkey@0"
I20260809 20:11:20.399984 19109 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260809 20:11:20.403019 19129 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:20.404160 19109 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260809 20:11:20.404294 19109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "992f45375fa844bb838da8cab6a84d25"
format_stamp: "Formatted at 2026-08-09 20:11:20 on dist-test-slave-6zbq"
server_key: "ed95a7fe6d811d0ca85590ce0be5d736"
server_key_iv: "6a62b2cf4c3f35b26c3fbb5ca4b3a629"
server_key_version: "encryptionkey@0"
I20260809 20:11:20.404438 19109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:20.422524 19109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:20.425941 19109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:20.426146 19109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:20.442487 19109 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:43579
I20260809 20:11:20.442520 19209 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:43579 every 8 connection(s)
I20260809 20:11:20.443679 19109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:11:20.446087 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 19109
I20260809 20:11:20.446332 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:11:20.447167 15060 external_mini_cluster.cc:1428] Setting key c7bf8dd447ab3726827fbae421cffd1c
I20260809 20:11:20.447497 19210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:20.461840 19210 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 992f45375fa844bb838da8cab6a84d25: Bootstrap starting.
Aug 09 20:11:20 dist-test-slave-6zbq krb5kdc[19084](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306279, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:20.465389 19210 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 992f45375fa844bb838da8cab6a84d25: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:20.466686 19210 log.cc:824] T 00000000000000000000000000000000 P 992f45375fa844bb838da8cab6a84d25: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:20.469708 19210 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 992f45375fa844bb838da8cab6a84d25: No bootstrap required, opened a new log
I20260809 20:11:20.470901 19215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:20.449071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49376 (local address 127.14.181.62:43579)
0809 20:11:20.449754 (+ 683us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:20.449767 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:20.449807 (+ 40us) server_negotiation.cc:407] Connection header received
0809 20:11:20.451896 (+ 2089us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:20.451917 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:20.452268 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:20.452568 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:20.454420 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:20.456121 (+ 1701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:20.457832 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:20.458541 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:20.458666 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:20.462989 (+ 4323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:20.463000 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:20.463016 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:20.463065 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:20.466714 (+ 3649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:20.467430 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:20.467440 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:20.467446 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:20.467613 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:20.468007 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:20.468011 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:20.468014 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:20.468638 (+ 624us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:20.468913 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:20.469232 (+ 319us) server_negotiation.cc:299] Negotiation successful
0809 20:11:20.469642 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":315,"threads_started":1}
I20260809 20:11:20.476967 19210 raft_consensus.cc:348] T 00000000000000000000000000000000 P 992f45375fa844bb838da8cab6a84d25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "992f45375fa844bb838da8cab6a84d25" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 43579 } }
I20260809 20:11:20.477270 19210 raft_consensus.cc:374] T 00000000000000000000000000000000 P 992f45375fa844bb838da8cab6a84d25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:20.477339 19210 raft_consensus.cc:729] T 00000000000000000000000000000000 P 992f45375fa844bb838da8cab6a84d25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 992f45375fa844bb838da8cab6a84d25, State: Initialized, Role: FOLLOWER
I20260809 20:11:20.477798 19210 consensus_queue.cc:260] T 00000000000000000000000000000000 P 992f45375fa844bb838da8cab6a84d25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "992f45375fa844bb838da8cab6a84d25" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 43579 } }
I20260809 20:11:20.478001 19210 raft_consensus.cc:388] T 00000000000000000000000000000000 P 992f45375fa844bb838da8cab6a84d25 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:11:20.478103 19210 raft_consensus.cc:482] T 00000000000000000000000000000000 P 992f45375fa844bb838da8cab6a84d25 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:11:20.478223 19210 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 992f45375fa844bb838da8cab6a84d25 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:20.480191 19210 raft_consensus.cc:504] T 00000000000000000000000000000000 P 992f45375fa844bb838da8cab6a84d25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "992f45375fa844bb838da8cab6a84d25" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 43579 } }
I20260809 20:11:20.480597 19210 leader_election.cc:302] T 00000000000000000000000000000000 P 992f45375fa844bb838da8cab6a84d25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 992f45375fa844bb838da8cab6a84d25; no voters:
I20260809 20:11:20.481037 19210 leader_election.cc:288] T 00000000000000000000000000000000 P 992f45375fa844bb838da8cab6a84d25 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:11:20.481148 19218 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 992f45375fa844bb838da8cab6a84d25 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:20.481819 19218 raft_consensus.cc:686] T 00000000000000000000000000000000 P 992f45375fa844bb838da8cab6a84d25 [term 1 LEADER]: Becoming Leader. State: Replica: 992f45375fa844bb838da8cab6a84d25, State: Running, Role: LEADER
I20260809 20:11:20.482311 19218 consensus_queue.cc:237] T 00000000000000000000000000000000 P 992f45375fa844bb838da8cab6a84d25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "992f45375fa844bb838da8cab6a84d25" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 43579 } }
I20260809 20:11:20.482945 19210 sys_catalog.cc:564] T 00000000000000000000000000000000 P 992f45375fa844bb838da8cab6a84d25 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:11:20.484723 19219 sys_catalog.cc:455] T 00000000000000000000000000000000 P 992f45375fa844bb838da8cab6a84d25 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "992f45375fa844bb838da8cab6a84d25" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "992f45375fa844bb838da8cab6a84d25" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 43579 } } }
I20260809 20:11:20.485072 19219 sys_catalog.cc:458] T 00000000000000000000000000000000 P 992f45375fa844bb838da8cab6a84d25 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:20.485772 19222 sys_catalog.cc:455] T 00000000000000000000000000000000 P 992f45375fa844bb838da8cab6a84d25 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 992f45375fa844bb838da8cab6a84d25. Latest consensus state: current_term: 1 leader_uuid: "992f45375fa844bb838da8cab6a84d25" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "992f45375fa844bb838da8cab6a84d25" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 43579 } } }
I20260809 20:11:20.486104 19222 sys_catalog.cc:458] T 00000000000000000000000000000000 P 992f45375fa844bb838da8cab6a84d25 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:20.487926 19228 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:11:20.493271 19228 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:11:20.503742 19228 catalog_manager.cc:1347] Generated new cluster ID: ba982f796f974b45992332b72a25b518
I20260809 20:11:20.503842 19228 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:11:20.536821 19228 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:11:20.537957 19228 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:11:20.545526 19228 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 992f45375fa844bb838da8cab6a84d25: Generated new TSK 0
I20260809 20:11:20.546165 19228 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.181.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
I20260809 20:11:20.597298 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:0
--local_ip_for_outbound_sockets=127.14.181.1
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:43579
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:38021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:20.917405 19258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:20.917629 19258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:20.917758 19258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:20.924665 19258 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:20.924765 19258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:20.924909 19258 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:11:20.933867 19258 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:38021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:43579
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:20.934928 19258 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:20.936061 19258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:20.947345 19266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:20.947438 19264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:20.947414 19272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:20.948340 19258 server_base.cc:1034] running on GCE node
I20260809 20:11:20.948884 19258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:20.949682 19258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:20.950867 19258 hybrid_clock.cc:648] HybridClock initialized: now 1786306280950816 us; error 44 us; skew 500 ppm
I20260809 20:11:20.951133 19258 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:20 dist-test-slave-6zbq krb5kdc[19084](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306280, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:20.953923 19258 init.cc:377] Logged in from keytab as kudu/127.14.181.1@KRBTEST.COM (short username kudu)
I20260809 20:11:20.955152 19258 webserver.cc:460] Webserver started at http://127.14.181.1:34103/ using document root <none> and password file <none>
I20260809 20:11:20.955722 19258 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:20.955832 19258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:20.956099 19258 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:20.958735 19258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/data/instance:
uuid: "cf351b06590642848e9f9be3cb6b4958"
format_stamp: "Formatted at 2026-08-09 20:11:20 on dist-test-slave-6zbq"
server_key: "4f2391919c5323cf26f5a9b923568241"
server_key_iv: "18975632a49494098f73b810ae9adb85"
server_key_version: "encryptionkey@0"
I20260809 20:11:20.959460 19258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance:
uuid: "cf351b06590642848e9f9be3cb6b4958"
format_stamp: "Formatted at 2026-08-09 20:11:20 on dist-test-slave-6zbq"
server_key: "4f2391919c5323cf26f5a9b923568241"
server_key_iv: "18975632a49494098f73b810ae9adb85"
server_key_version: "encryptionkey@0"
I20260809 20:11:20.963944 19258 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 20:11:20.966997 19281 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:20.968101 19258 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:11:20.968250 19258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "cf351b06590642848e9f9be3cb6b4958"
format_stamp: "Formatted at 2026-08-09 20:11:20 on dist-test-slave-6zbq"
server_key: "4f2391919c5323cf26f5a9b923568241"
server_key_iv: "18975632a49494098f73b810ae9adb85"
server_key_version: "encryptionkey@0"
I20260809 20:11:20.968406 19258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:20.988855 19258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:20.993839 19258 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:20.994136 19258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:20.995241 19258 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:11:20.996780 19258 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:20.996877 19258 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:20.996985 19258 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:20.997036 19258 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:21.027463 19258 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:37233
I20260809 20:11:21.027518 19465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:37233 every 8 connection(s)
I20260809 20:11:21.028558 19258 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:11:21.031970 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 19258
I20260809 20:11:21.032205 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance
I20260809 20:11:21.033020 15060 external_mini_cluster.cc:1428] Setting key 6509bbbbb67909e50cdf8393097ca86b
Aug 09 20:11:21 dist-test-slave-6zbq krb5kdc[19084](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306280, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:21.049121 19470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:21.030715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:45229 (local address 127.14.181.62:43579)
0809 20:11:21.031097 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:21.031101 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:21.032053 (+ 952us) server_negotiation.cc:407] Connection header received
0809 20:11:21.034324 (+ 2271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:21.034330 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:21.034429 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:21.034539 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:21.036306 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:21.036990 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:21.038947 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:21.039325 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:21.039415 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:21.043219 (+ 3804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:21.043225 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:21.043228 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:21.043259 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:21.046236 (+ 2977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:21.046904 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:21.046909 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:21.046912 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:21.047052 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:21.047506 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:21.047511 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:21.047514 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:21.047832 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:21.047961 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:21.048558 (+ 597us) server_negotiation.cc:299] Negotiation successful
0809 20:11:21.048785 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":200,"threads_started":1}
I20260809 20:11:21.049731 19471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:21.031109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:43579 (local address 127.14.181.1:45229)
0809 20:11:21.031855 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:21.031903 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:21.034085 (+ 2182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:21.034740 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:21.034751 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:21.035409 (+ 658us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:21.036132 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:21.036156 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:21.037138 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:21.037143 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:21.038830 (+ 1687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:21.038844 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:21.039526 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:21.039532 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:21.039803 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:21.040403 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:21.040430 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:21.043015 (+ 2585us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:21.046383 (+ 3368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:21.046389 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:21.046399 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:21.046790 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:21.047158 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:21.047162 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:21.047165 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:21.047381 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:21.047937 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:21.047942 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:21.048208 (+ 266us) client_negotiation.cc:769] Sending connection context
0809 20:11:21.048405 (+ 197us) client_negotiation.cc:240] Negotiation successful
0809 20:11:21.048732 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":245,"threads_started":1}
I20260809 20:11:21.051046 19467 heartbeater.cc:347] Connected to a master server at 127.14.181.62:43579
I20260809 20:11:21.051316 19467 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:21.051926 19467 heartbeater.cc:511] Master 127.14.181.62:43579 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.14.181.2@KRBTEST.COM; defaulting to no policy
I20260809 20:11:21.053716 19157 ts_manager.cc:194] Registered new tserver with Master: cf351b06590642848e9f9be3cb6b4958 (127.14.181.1:37233)
I20260809 20:11:21.055106 19157 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.1@KRBTEST.COM'} at 127.14.181.1:45229
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
I20260809 20:11:21.074600 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:0
--local_ip_for_outbound_sockets=127.14.181.2
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:43579
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:38021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:21.372133 19477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:21.372409 19477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:21.372546 19477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:21.379351 19477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:21.379458 19477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:21.379601 19477 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:11:21.388693 19477 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:38021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:43579
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:21.389781 19477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:21.390997 19477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:21.402707 19484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:21.402668 19486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:21.402626 19488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:21.403548 19477 server_base.cc:1034] running on GCE node
I20260809 20:11:21.404083 19477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:21.404874 19477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:21.406060 19477 hybrid_clock.cc:648] HybridClock initialized: now 1786306281406015 us; error 41 us; skew 500 ppm
I20260809 20:11:21.406333 19477 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:21 dist-test-slave-6zbq krb5kdc[19084](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306281, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:21.409106 19477 init.cc:377] Logged in from keytab as kudu/127.14.181.2@KRBTEST.COM (short username kudu)
I20260809 20:11:21.410416 19477 webserver.cc:460] Webserver started at http://127.14.181.2:36059/ using document root <none> and password file <none>
I20260809 20:11:21.410996 19477 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:21.411106 19477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:21.411371 19477 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:21.413926 19477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/data/instance:
uuid: "dc3d93536b724d56ba012c19272b569b"
format_stamp: "Formatted at 2026-08-09 20:11:21 on dist-test-slave-6zbq"
server_key: "e9fceeb13126b3c30755e7eb5172dc29"
server_key_iv: "ef0b9cb5c45e5f58824ddea9c85269e9"
server_key_version: "encryptionkey@0"
I20260809 20:11:21.414757 19477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance:
uuid: "dc3d93536b724d56ba012c19272b569b"
format_stamp: "Formatted at 2026-08-09 20:11:21 on dist-test-slave-6zbq"
server_key: "e9fceeb13126b3c30755e7eb5172dc29"
server_key_iv: "ef0b9cb5c45e5f58824ddea9c85269e9"
server_key_version: "encryptionkey@0"
I20260809 20:11:21.419289 19477 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 20:11:21.422379 19499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:21.423507 19477 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 20:11:21.423652 19477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "dc3d93536b724d56ba012c19272b569b"
format_stamp: "Formatted at 2026-08-09 20:11:21 on dist-test-slave-6zbq"
server_key: "e9fceeb13126b3c30755e7eb5172dc29"
server_key_iv: "ef0b9cb5c45e5f58824ddea9c85269e9"
server_key_version: "encryptionkey@0"
I20260809 20:11:21.423817 19477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:21.448662 19477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:21.452581 19477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:21.452828 19477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:21.453701 19477 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:11:21.455004 19477 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:21.455081 19477 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:21.455199 19477 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:21.455252 19477 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:21.484359 19477 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:39499
I20260809 20:11:21.484434 19682 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:39499 every 8 connection(s)
I20260809 20:11:21.485495 19477 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:11:21.487890 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 19477
I20260809 20:11:21.488086 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance
I20260809 20:11:21.488617 15060 external_mini_cluster.cc:1428] Setting key c3d6c49b1b0c99e92d7fcdc17b58f603
Aug 09 20:11:21 dist-test-slave-6zbq krb5kdc[19084](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306281, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:21.504422 19470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:21.487680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:36535 (local address 127.14.181.62:43579)
0809 20:11:21.487838 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:21.487843 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:21.489266 (+ 1423us) server_negotiation.cc:407] Connection header received
0809 20:11:21.491222 (+ 1956us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:21.491228 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:21.491312 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:21.491396 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:21.492825 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:21.493526 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:21.495064 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:21.495471 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:21.495577 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:21.499146 (+ 3569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:21.499151 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:21.499154 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:21.499187 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:21.501671 (+ 2484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:21.502309 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:21.502313 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:21.502316 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:21.502480 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:21.502873 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:21.502878 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:21.502882 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:21.503126 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:21.503257 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:21.503885 (+ 628us) server_negotiation.cc:299] Negotiation successful
0809 20:11:21.504106 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 20:11:21.505311 19688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:21.488303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:43579 (local address 127.14.181.2:36535)
0809 20:11:21.489091 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:21.489136 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:21.490965 (+ 1829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:21.491629 (+ 664us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:21.491637 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:21.492124 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:21.492653 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:21.492670 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:21.493667 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:21.493672 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:21.494917 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:21.494934 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:21.495676 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:21.495683 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:21.495898 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:21.496474 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:21.496494 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:21.498928 (+ 2434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:21.501795 (+ 2867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:21.501803 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:21.501817 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:21.502187 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:21.502580 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:21.502585 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:21.502589 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:21.502759 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:21.503243 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:21.503250 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:21.503542 (+ 292us) client_negotiation.cc:769] Sending connection context
0809 20:11:21.503753 (+ 211us) client_negotiation.cc:240] Negotiation successful
0809 20:11:21.504197 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":320,"threads_started":1}
I20260809 20:11:21.506603 19685 heartbeater.cc:347] Connected to a master server at 127.14.181.62:43579
I20260809 20:11:21.506924 19685 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:21.507822 19685 heartbeater.cc:511] Master 127.14.181.62:43579 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.14.181.3@KRBTEST.COM; defaulting to no policy
I20260809 20:11:21.509196 19157 ts_manager.cc:194] Registered new tserver with Master: dc3d93536b724d56ba012c19272b569b (127.14.181.2:39499)
I20260809 20:11:21.509974 19157 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.2@KRBTEST.COM'} at 127.14.181.2:36535
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
I20260809 20:11:21.529946 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:0
--local_ip_for_outbound_sockets=127.14.181.3
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:43579
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:38021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:21.830202 19692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:21.830476 19692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:21.830576 19692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:21.837311 19692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:21.837396 19692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:21.837503 19692 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:11:21.846407 19692 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:38021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:43579
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:21.847396 19692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:21.848538 19692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:21.860499 19707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:21.860898 19703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:21.861799 19713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:21.862185 19692 server_base.cc:1034] running on GCE node
I20260809 20:11:21.862739 19692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:21.863575 19692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:21.864770 19692 hybrid_clock.cc:648] HybridClock initialized: now 1786306281864734 us; error 32 us; skew 500 ppm
I20260809 20:11:21.865056 19692 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:21 dist-test-slave-6zbq krb5kdc[19084](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306281, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:21.867951 19692 init.cc:377] Logged in from keytab as kudu/127.14.181.3@KRBTEST.COM (short username kudu)
I20260809 20:11:21.869306 19692 webserver.cc:460] Webserver started at http://127.14.181.3:41189/ using document root <none> and password file <none>
I20260809 20:11:21.869922 19692 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:21.870033 19692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:21.870319 19692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:21.873111 19692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/data/instance:
uuid: "6bd0b90aa148406b9a39ccfaac8611ad"
format_stamp: "Formatted at 2026-08-09 20:11:21 on dist-test-slave-6zbq"
server_key: "ae339dc6feef20bfe4a7dd5b726632ef"
server_key_iv: "28d41f4458757061b6cf3bcffd90a7e2"
server_key_version: "encryptionkey@0"
I20260809 20:11:21.873818 19692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance:
uuid: "6bd0b90aa148406b9a39ccfaac8611ad"
format_stamp: "Formatted at 2026-08-09 20:11:21 on dist-test-slave-6zbq"
server_key: "ae339dc6feef20bfe4a7dd5b726632ef"
server_key_iv: "28d41f4458757061b6cf3bcffd90a7e2"
server_key_version: "encryptionkey@0"
I20260809 20:11:21.878409 19692 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.008s sys 0.000s
I20260809 20:11:21.881506 19722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:21.882707 19692 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:11:21.882836 19692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "6bd0b90aa148406b9a39ccfaac8611ad"
format_stamp: "Formatted at 2026-08-09 20:11:21 on dist-test-slave-6zbq"
server_key: "ae339dc6feef20bfe4a7dd5b726632ef"
server_key_iv: "28d41f4458757061b6cf3bcffd90a7e2"
server_key_version: "encryptionkey@0"
I20260809 20:11:21.883001 19692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:21.904281 19692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:21.907793 19692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:21.908011 19692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:21.908864 19692 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:11:21.910012 19692 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:21.910084 19692 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:21.910168 19692 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:21.910210 19692 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:21.939180 19692 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:43999
I20260809 20:11:21.939245 19914 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:43999 every 8 connection(s)
I20260809 20:11:21.940292 19692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:11:21.944123 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 19692
I20260809 20:11:21.944289 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance
I20260809 20:11:21.944679 15060 external_mini_cluster.cc:1428] Setting key 8419b7ecd4c50a95ce8df771584c18c5
Aug 09 20:11:21 dist-test-slave-6zbq krb5kdc[19084](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306281, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:21.957746 19470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:21.942532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:59779 (local address 127.14.181.62:43579)
0809 20:11:21.942708 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:21.942712 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:21.943778 (+ 1066us) server_negotiation.cc:407] Connection header received
0809 20:11:21.945662 (+ 1884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:21.945666 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:21.945743 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:21.945830 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:21.947606 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:21.948363 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:21.949800 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:21.950188 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:21.950282 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:21.953168 (+ 2886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:21.953173 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:21.953176 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:21.953207 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:21.955447 (+ 2240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:21.956043 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:21.956047 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:21.956049 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:21.956157 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:21.956478 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:21.956481 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:21.956483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:21.956741 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:21.956868 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:21.957353 (+ 485us) server_negotiation.cc:299] Negotiation successful
0809 20:11:21.957500 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 20:11:21.958580 19920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:21.942965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:43579 (local address 127.14.181.3:59779)
0809 20:11:21.943622 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:21.943665 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:21.945413 (+ 1748us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:21.946072 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:21.946080 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:21.946728 (+ 648us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:21.947447 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:21.947468 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:21.948472 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:21.948476 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:21.949690 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:21.949703 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:21.950373 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:21.950381 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:21.950564 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:21.951082 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:21.951103 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:21.952997 (+ 1894us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:21.955565 (+ 2568us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:21.955571 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:21.955580 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:21.955957 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:21.956229 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:21.956231 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:21.956234 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:21.956394 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:21.956833 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:21.956837 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:21.957087 (+ 250us) client_negotiation.cc:769] Sending connection context
0809 20:11:21.957280 (+ 193us) client_negotiation.cc:240] Negotiation successful
0809 20:11:21.957591 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":253,"threads_started":1}
I20260809 20:11:21.959785 19916 heartbeater.cc:347] Connected to a master server at 127.14.181.62:43579
I20260809 20:11:21.960031 19916 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:21.960626 19916 heartbeater.cc:511] Master 127.14.181.62:43579 requested a full tablet report, sending...
I20260809 20:11:21.961864 19156 ts_manager.cc:194] Registered new tserver with Master: 6bd0b90aa148406b9a39ccfaac8611ad (127.14.181.3:43999)
I20260809 20:11:21.962698 19156 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.3@KRBTEST.COM'} at 127.14.181.3:59779
I20260809 20:11:21.971202 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 20:11:22.002099 19470 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:11:21.999956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49378 (local address 127.14.181.62:43579)
0809 20:11:22.000167 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:22.000174 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:22.000486 (+ 312us) server_negotiation.cc:407] Connection header received
0809 20:11:22.000633 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:22.000637 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:22.000700 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:22.000773 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:22.001841 (+ 1068us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49378: BlockingRecv error: recv got EOF from 127.0.0.1:49378 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 20:11:22.005163 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 19258
W20260809 20:11:22.007557 15060 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 19258: Not authorized: Client connection negotiation failed: client connection to 127.14.181.1:37233: server requires authentication, but client does not have Kerberos credentials available
I20260809 20:11:22.007733 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 19258
I20260809 20:11:22.026180 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 19477
W20260809 20:11:22.028366 15060 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 19477: Not authorized: Client connection negotiation failed: client connection to 127.14.181.2:39499: server requires authentication, but client does not have Kerberos credentials available
I20260809 20:11:22.028517 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 19477
I20260809 20:11:22.050855 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 19692
W20260809 20:11:22.053376 15060 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 19692: Not authorized: Client connection negotiation failed: client connection to 127.14.181.3:43999: server requires authentication, but client does not have Kerberos credentials available
I20260809 20:11:22.053514 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 19692
I20260809 20:11:22.072423 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 19109
I20260809 20:11:22.073410 19200 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:22.173187 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 19109
2026-08-09T20:11:22Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3464 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:11:22 dist-test-slave-6zbq krb5kdc[19954](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:11:22 dist-test-slave-6zbq krb5kdc[19954](info): set up 2 sockets
Aug 09 20:11:22 dist-test-slave-6zbq krb5kdc[19954](info): commencing operation
krb5kdc: starting...
W20260809 20:11:23.361589 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.146s user 0.005s sys 0.012s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:11:23 dist-test-slave-6zbq krb5kdc[19954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306283, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:11:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:11:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:11:23.535081 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:42787
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:41255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:42787
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:23.832142 19978 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:23.832381 19978 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:23.832470 19978 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:23.839178 19978 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:11:23.839264 19978 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:23.839314 19978 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:23.839371 19978 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:11:23.839416 19978 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:11:23.848469 19978 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:41255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:42787
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:42787
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:23.849457 19978 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:23.850589 19978 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:23.861258 19985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:23.861166 19987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:23.861197 19990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:23.861953 19978 server_base.cc:1034] running on GCE node
I20260809 20:11:23.862694 19978 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:23.864573 19978 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:23.865787 19978 hybrid_clock.cc:648] HybridClock initialized: now 1786306283865737 us; error 42 us; skew 500 ppm
I20260809 20:11:23.866084 19978 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:23 dist-test-slave-6zbq krb5kdc[19954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306283, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:23.873193 19978 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:11:23.874562 19978 webserver.cc:460] Webserver started at http://127.14.181.62:33419/ using document root <none> and password file <none>
I20260809 20:11:23.875146 19978 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:23.875262 19978 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:23.875530 19978 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:23.878185 19978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "ddaf3122e444467e84f6ea5909f18262"
format_stamp: "Formatted at 2026-08-09 20:11:23 on dist-test-slave-6zbq"
server_key: "c64adffe84006c7c7a1087da8d570f3e"
server_key_iv: "140b2ef1c46829f6b8b2abeeefbdbda6"
server_key_version: "encryptionkey@0"
I20260809 20:11:23.878971 19978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "ddaf3122e444467e84f6ea5909f18262"
format_stamp: "Formatted at 2026-08-09 20:11:23 on dist-test-slave-6zbq"
server_key: "c64adffe84006c7c7a1087da8d570f3e"
server_key_iv: "140b2ef1c46829f6b8b2abeeefbdbda6"
server_key_version: "encryptionkey@0"
I20260809 20:11:23.883509 19978 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260809 20:11:23.886569 20007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:23.887676 19978 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 20:11:23.887835 19978 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "ddaf3122e444467e84f6ea5909f18262"
format_stamp: "Formatted at 2026-08-09 20:11:23 on dist-test-slave-6zbq"
server_key: "c64adffe84006c7c7a1087da8d570f3e"
server_key_iv: "140b2ef1c46829f6b8b2abeeefbdbda6"
server_key_version: "encryptionkey@0"
I20260809 20:11:23.887997 19978 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:23.907538 19978 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:23.910982 19978 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:23.911207 19978 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:23.927228 19978 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:42787
I20260809 20:11:23.927279 20085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:42787 every 8 connection(s)
I20260809 20:11:23.928361 19978 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:11:23.931699 20086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:23.937844 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 19978
I20260809 20:11:23.938042 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:11:23.938714 15060 external_mini_cluster.cc:1428] Setting key ec60f5d4ae2a4656503aadf0a77d2514
I20260809 20:11:23.941349 20086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ddaf3122e444467e84f6ea5909f18262: Bootstrap starting.
I20260809 20:11:23.944490 20086 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ddaf3122e444467e84f6ea5909f18262: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:23.945693 20086 log.cc:824] T 00000000000000000000000000000000 P ddaf3122e444467e84f6ea5909f18262: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:23.948508 20086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ddaf3122e444467e84f6ea5909f18262: No bootstrap required, opened a new log
Aug 09 20:11:23 dist-test-slave-6zbq krb5kdc[19954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306283, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:23.957825 20086 raft_consensus.cc:348] T 00000000000000000000000000000000 P ddaf3122e444467e84f6ea5909f18262 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddaf3122e444467e84f6ea5909f18262" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42787 } }
I20260809 20:11:23.958174 20086 raft_consensus.cc:374] T 00000000000000000000000000000000 P ddaf3122e444467e84f6ea5909f18262 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:23.958279 20086 raft_consensus.cc:729] T 00000000000000000000000000000000 P ddaf3122e444467e84f6ea5909f18262 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddaf3122e444467e84f6ea5909f18262, State: Initialized, Role: FOLLOWER
I20260809 20:11:23.958859 20086 consensus_queue.cc:260] T 00000000000000000000000000000000 P ddaf3122e444467e84f6ea5909f18262 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddaf3122e444467e84f6ea5909f18262" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42787 } }
I20260809 20:11:23.959123 20086 raft_consensus.cc:388] T 00000000000000000000000000000000 P ddaf3122e444467e84f6ea5909f18262 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:11:23.959326 20086 raft_consensus.cc:482] T 00000000000000000000000000000000 P ddaf3122e444467e84f6ea5909f18262 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:11:23.959525 20086 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ddaf3122e444467e84f6ea5909f18262 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:23.962036 20091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:23.940371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42014 (local address 127.14.181.62:42787)
0809 20:11:23.941124 (+ 753us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:23.941134 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:23.941172 (+ 38us) server_negotiation.cc:407] Connection header received
0809 20:11:23.942900 (+ 1728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:23.942921 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:23.943264 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:23.943538 (+ 274us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:23.945434 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:23.947037 (+ 1603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:23.948708 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:23.949352 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:23.949474 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:23.953670 (+ 4196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:23.953684 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:23.953706 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:23.953751 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:23.957478 (+ 3727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:23.958081 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:23.958089 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:23.958096 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:23.958307 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:23.958714 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:23.958719 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:23.958722 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:23.959433 (+ 711us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:23.959701 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:23.960366 (+ 665us) server_negotiation.cc:299] Negotiation successful
0809 20:11:23.960774 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":334,"threads_started":1}
I20260809 20:11:23.962633 20086 raft_consensus.cc:504] T 00000000000000000000000000000000 P ddaf3122e444467e84f6ea5909f18262 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddaf3122e444467e84f6ea5909f18262" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42787 } }
I20260809 20:11:23.963063 20086 leader_election.cc:302] T 00000000000000000000000000000000 P ddaf3122e444467e84f6ea5909f18262 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ddaf3122e444467e84f6ea5909f18262; no voters:
I20260809 20:11:23.963593 20086 leader_election.cc:288] T 00000000000000000000000000000000 P ddaf3122e444467e84f6ea5909f18262 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:11:23.963735 20094 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ddaf3122e444467e84f6ea5909f18262 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:23.964951 20094 raft_consensus.cc:686] T 00000000000000000000000000000000 P ddaf3122e444467e84f6ea5909f18262 [term 1 LEADER]: Becoming Leader. State: Replica: ddaf3122e444467e84f6ea5909f18262, State: Running, Role: LEADER
I20260809 20:11:23.965610 20086 sys_catalog.cc:564] T 00000000000000000000000000000000 P ddaf3122e444467e84f6ea5909f18262 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:11:23.965515 20094 consensus_queue.cc:237] T 00000000000000000000000000000000 P ddaf3122e444467e84f6ea5909f18262 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddaf3122e444467e84f6ea5909f18262" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42787 } }
I20260809 20:11:23.966183 15060 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 20:11:23.969689 20100 sys_catalog.cc:455] T 00000000000000000000000000000000 P ddaf3122e444467e84f6ea5909f18262 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ddaf3122e444467e84f6ea5909f18262. Latest consensus state: current_term: 1 leader_uuid: "ddaf3122e444467e84f6ea5909f18262" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddaf3122e444467e84f6ea5909f18262" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42787 } } }
I20260809 20:11:23.970038 20100 sys_catalog.cc:458] T 00000000000000000000000000000000 P ddaf3122e444467e84f6ea5909f18262 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:23.971037 20097 sys_catalog.cc:455] T 00000000000000000000000000000000 P ddaf3122e444467e84f6ea5909f18262 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ddaf3122e444467e84f6ea5909f18262" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddaf3122e444467e84f6ea5909f18262" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42787 } } }
I20260809 20:11:23.971340 20097 sys_catalog.cc:458] T 00000000000000000000000000000000 P ddaf3122e444467e84f6ea5909f18262 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:23.973117 20109 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:11:23.978374 20109 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:11:23.986496 20109 catalog_manager.cc:1347] Generated new cluster ID: 3b25c272040b44f4aeba1684f25594bc
I20260809 20:11:23.986589 20109 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:11:23.995972 20109 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:11:23.997154 20109 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:11:24.005836 20109 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ddaf3122e444467e84f6ea5909f18262: Generated new TSK 0
I20260809 20:11:24.006711 20109 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:11:24.016731 20091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:24.008952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42030 (local address 127.14.181.62:42787)
0809 20:11:24.009141 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:24.009148 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:24.009553 (+ 405us) server_negotiation.cc:407] Connection header received
0809 20:11:24.009706 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:24.009712 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:24.009796 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:24.009918 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:24.010897 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:24.012001 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:24.013208 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:24.013883 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:24.014006 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:24.015027 (+ 1021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:24.015034 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:24.015039 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:11:24.015968 (+ 929us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:24.016046 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:11:24.016079 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:24.016201 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:24.016311 (+ 110us) server_negotiation.cc:299] Negotiation successful
0809 20:11:24.016399 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 20:11:24.024137 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 19978
I20260809 20:11:24.025198 20079 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:24.110854 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 19978
2026-08-09T20:11:24Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1936 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:11:24 dist-test-slave-6zbq krb5kdc[20145](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:11:24 dist-test-slave-6zbq krb5kdc[20145](info): set up 2 sockets
Aug 09 20:11:24 dist-test-slave-6zbq krb5kdc[20145](info): commencing operation
krb5kdc: starting...
W20260809 20:11:25.302760 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.151s user 0.002s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:11:25 dist-test-slave-6zbq krb5kdc[20145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306285, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:11:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:11:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:11:25.470757 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:39071
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:37379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:39071
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:25.770026 20166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:25.770274 20166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:25.770419 20166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:25.777220 20166 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:11:25.777310 20166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:25.777379 20166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:25.777451 20166 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:11:25.777511 20166 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:11:25.786485 20166 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:37379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:39071
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:39071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:25.787513 20166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:25.788627 20166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:25.798969 20175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:25.799014 20176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:25.799204 20178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:25.799904 20166 server_base.cc:1034] running on GCE node
I20260809 20:11:25.800568 20166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:25.801712 20166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:25.802896 20166 hybrid_clock.cc:648] HybridClock initialized: now 1786306285802852 us; error 39 us; skew 500 ppm
I20260809 20:11:25.803210 20166 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:25 dist-test-slave-6zbq krb5kdc[20145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306285, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:25.805908 20166 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:11:25.807248 20166 webserver.cc:460] Webserver started at http://127.14.181.62:38243/ using document root <none> and password file <none>
I20260809 20:11:25.807823 20166 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:25.807936 20166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:25.808212 20166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:25.810897 20166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "9c673565c0184d5bab572f80f1bf5763"
format_stamp: "Formatted at 2026-08-09 20:11:25 on dist-test-slave-6zbq"
server_key: "01ac07a1dcf07f05424ec05a62f76ada"
server_key_iv: "d17f0a6779ea99edcde3a4e16217994e"
server_key_version: "encryptionkey@0"
I20260809 20:11:25.811580 20166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "9c673565c0184d5bab572f80f1bf5763"
format_stamp: "Formatted at 2026-08-09 20:11:25 on dist-test-slave-6zbq"
server_key: "01ac07a1dcf07f05424ec05a62f76ada"
server_key_iv: "d17f0a6779ea99edcde3a4e16217994e"
server_key_version: "encryptionkey@0"
I20260809 20:11:25.816215 20166 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 20:11:25.819218 20187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:25.820363 20166 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 20:11:25.820516 20166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "9c673565c0184d5bab572f80f1bf5763"
format_stamp: "Formatted at 2026-08-09 20:11:25 on dist-test-slave-6zbq"
server_key: "01ac07a1dcf07f05424ec05a62f76ada"
server_key_iv: "d17f0a6779ea99edcde3a4e16217994e"
server_key_version: "encryptionkey@0"
I20260809 20:11:25.820684 20166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:25.834524 20166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:25.837782 20166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:25.838013 20166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:25.854069 20166 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:39071
I20260809 20:11:25.854118 20270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:39071 every 8 connection(s)
I20260809 20:11:25.855487 20166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:11:25.858731 20271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:25.863888 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 20166
I20260809 20:11:25.864104 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:11:25.864898 15060 external_mini_cluster.cc:1428] Setting key 2b862d8bf6da552f6864ea7048dd40f0
I20260809 20:11:25.872941 20271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c673565c0184d5bab572f80f1bf5763: Bootstrap starting.
I20260809 20:11:25.876255 20271 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c673565c0184d5bab572f80f1bf5763: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:25.877192 20271 log.cc:824] T 00000000000000000000000000000000 P 9c673565c0184d5bab572f80f1bf5763: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:25.879706 20271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c673565c0184d5bab572f80f1bf5763: No bootstrap required, opened a new log
Aug 09 20:11:25 dist-test-slave-6zbq krb5kdc[20145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306285, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:25.887120 20271 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c673565c0184d5bab572f80f1bf5763 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c673565c0184d5bab572f80f1bf5763" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39071 } }
I20260809 20:11:25.887431 20271 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c673565c0184d5bab572f80f1bf5763 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:25.887542 20271 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c673565c0184d5bab572f80f1bf5763 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c673565c0184d5bab572f80f1bf5763, State: Initialized, Role: FOLLOWER
I20260809 20:11:25.887610 20278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:25.866757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39486 (local address 127.14.181.62:39071)
0809 20:11:25.868813 (+ 2056us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:25.868827 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:25.868875 (+ 48us) server_negotiation.cc:407] Connection header received
0809 20:11:25.871323 (+ 2448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:25.871349 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:25.871785 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:25.872168 (+ 383us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:25.873368 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:25.875262 (+ 1894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:25.876443 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:25.877090 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:25.877266 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:25.881043 (+ 3777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:25.881050 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:25.881063 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:25.881109 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:25.884032 (+ 2923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:25.884639 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:25.884645 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:25.884650 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:25.884820 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:25.885168 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:25.885171 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:25.885174 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:25.885659 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:25.885974 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:25.886378 (+ 404us) server_negotiation.cc:299] Negotiation successful
0809 20:11:25.886736 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1845,"thread_start_us":1666,"threads_started":1}
I20260809 20:11:25.888116 20271 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c673565c0184d5bab572f80f1bf5763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c673565c0184d5bab572f80f1bf5763" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39071 } }
I20260809 20:11:25.888334 20271 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9c673565c0184d5bab572f80f1bf5763 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:11:25.888458 20271 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c673565c0184d5bab572f80f1bf5763 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:11:25.888613 20271 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c673565c0184d5bab572f80f1bf5763 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:25.891274 20271 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c673565c0184d5bab572f80f1bf5763 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c673565c0184d5bab572f80f1bf5763" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39071 } }
I20260809 20:11:25.891750 20271 leader_election.cc:302] T 00000000000000000000000000000000 P 9c673565c0184d5bab572f80f1bf5763 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c673565c0184d5bab572f80f1bf5763; no voters:
I20260809 20:11:25.892370 20271 leader_election.cc:288] T 00000000000000000000000000000000 P 9c673565c0184d5bab572f80f1bf5763 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:11:25.892445 20281 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c673565c0184d5bab572f80f1bf5763 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:25.893067 20281 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c673565c0184d5bab572f80f1bf5763 [term 1 LEADER]: Becoming Leader. State: Replica: 9c673565c0184d5bab572f80f1bf5763, State: Running, Role: LEADER
I20260809 20:11:25.893543 20281 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c673565c0184d5bab572f80f1bf5763 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c673565c0184d5bab572f80f1bf5763" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39071 } }
I20260809 20:11:25.894157 20271 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c673565c0184d5bab572f80f1bf5763 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:11:25.896176 20282 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c673565c0184d5bab572f80f1bf5763 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c673565c0184d5bab572f80f1bf5763" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c673565c0184d5bab572f80f1bf5763" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39071 } } }
I20260809 20:11:25.896550 20282 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c673565c0184d5bab572f80f1bf5763 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:25.896575 20284 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c673565c0184d5bab572f80f1bf5763 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c673565c0184d5bab572f80f1bf5763. Latest consensus state: current_term: 1 leader_uuid: "9c673565c0184d5bab572f80f1bf5763" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c673565c0184d5bab572f80f1bf5763" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39071 } } }
I20260809 20:11:25.896914 20284 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c673565c0184d5bab572f80f1bf5763 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:25.898816 20295 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:11:25.903442 20295 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:11:25.911136 20295 catalog_manager.cc:1347] Generated new cluster ID: 7d949aea859e4fe8a0e6a7c769b4fb2e
I20260809 20:11:25.911243 20295 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:11:25.922633 20295 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:11:25.924307 20295 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:11:25.934944 20295 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9c673565c0184d5bab572f80f1bf5763: Generated new TSK 0
I20260809 20:11:25.935747 20295 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.181.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
I20260809 20:11:25.987730 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:0
--local_ip_for_outbound_sockets=127.14.181.1
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39071
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:37379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:26.295892 20320 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:26.296149 20320 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:26.296275 20320 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:26.303680 20320 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:26.303777 20320 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:26.303912 20320 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:11:26.313342 20320 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:37379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39071
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:26.314507 20320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:26.315685 20320 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:26.327658 20331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:26.327730 20338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:26.327757 20333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:26.328460 20320 server_base.cc:1034] running on GCE node
I20260809 20:11:26.328989 20320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:26.329771 20320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:26.330971 20320 hybrid_clock.cc:648] HybridClock initialized: now 1786306286330917 us; error 42 us; skew 500 ppm
I20260809 20:11:26.331240 20320 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:26 dist-test-slave-6zbq krb5kdc[20145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306286, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:26.334067 20320 init.cc:377] Logged in from keytab as kudu/127.14.181.1@KRBTEST.COM (short username kudu)
I20260809 20:11:26.335323 20320 webserver.cc:460] Webserver started at http://127.14.181.1:34881/ using document root <none> and password file <none>
I20260809 20:11:26.335911 20320 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:26.336021 20320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:26.336282 20320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:26.339027 20320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/data/instance:
uuid: "f1de7ae49dce49e997e739c9f2969400"
format_stamp: "Formatted at 2026-08-09 20:11:26 on dist-test-slave-6zbq"
server_key: "3e467095fe22b5b7ca510d3059de81a6"
server_key_iv: "5f2021c65ecf5d124e9ed007426f9158"
server_key_version: "encryptionkey@0"
I20260809 20:11:26.339747 20320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance:
uuid: "f1de7ae49dce49e997e739c9f2969400"
format_stamp: "Formatted at 2026-08-09 20:11:26 on dist-test-slave-6zbq"
server_key: "3e467095fe22b5b7ca510d3059de81a6"
server_key_iv: "5f2021c65ecf5d124e9ed007426f9158"
server_key_version: "encryptionkey@0"
I20260809 20:11:26.344477 20320 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 20:11:26.347594 20348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:26.348750 20320 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:11:26.348886 20320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "f1de7ae49dce49e997e739c9f2969400"
format_stamp: "Formatted at 2026-08-09 20:11:26 on dist-test-slave-6zbq"
server_key: "3e467095fe22b5b7ca510d3059de81a6"
server_key_iv: "5f2021c65ecf5d124e9ed007426f9158"
server_key_version: "encryptionkey@0"
I20260809 20:11:26.349041 20320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:26.362269 20320 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:26.365922 20320 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:26.366169 20320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:26.366989 20320 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:11:26.368136 20320 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:26.368206 20320 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:26.368331 20320 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:26.368384 20320 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:26.395390 20320 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:43263
I20260809 20:11:26.395444 20532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:43263 every 8 connection(s)
I20260809 20:11:26.396497 20320 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:11:26.403723 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 20320
I20260809 20:11:26.403901 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance
I20260809 20:11:26.404722 15060 external_mini_cluster.cc:1428] Setting key 146c5abfd4089f9de07b271a73f4ab8c
Aug 09 20:11:26 dist-test-slave-6zbq krb5kdc[20145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306286, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:26.415659 20536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:26.398704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:56177 (local address 127.14.181.62:39071)
0809 20:11:26.399092 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:26.399097 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:26.399986 (+ 889us) server_negotiation.cc:407] Connection header received
0809 20:11:26.401641 (+ 1655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:26.401645 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:26.401716 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:26.401812 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:26.403130 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:26.403878 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:26.405918 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:26.406580 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:26.406729 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:26.410449 (+ 3720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:26.410454 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:26.410458 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:26.410488 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:26.412837 (+ 2349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:26.413588 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:26.413591 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:26.413594 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:26.413699 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:26.414065 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:26.414069 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:26.414072 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:26.414434 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:26.414572 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:26.415119 (+ 547us) server_negotiation.cc:299] Negotiation successful
0809 20:11:26.415315 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":199,"threads_started":1}
I20260809 20:11:26.416242 20538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:26.399204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39071 (local address 127.14.181.1:56177)
0809 20:11:26.399848 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:26.399884 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:26.401420 (+ 1536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:26.401983 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:26.401990 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:26.402494 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:26.403000 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:26.403016 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:26.404043 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:26.404049 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:26.405775 (+ 1726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:26.405787 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:26.406807 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:26.406815 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:26.407078 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:26.407696 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:26.407724 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:26.410227 (+ 2503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:26.412963 (+ 2736us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:26.412972 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:26.412984 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:26.413496 (+ 512us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:26.413794 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:26.413799 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:26.413802 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:26.413973 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:26.414537 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:26.414542 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:26.414803 (+ 261us) client_negotiation.cc:769] Sending connection context
0809 20:11:26.414999 (+ 196us) client_negotiation.cc:240] Negotiation successful
0809 20:11:26.415325 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":251,"threads_started":1}
I20260809 20:11:26.417529 20534 heartbeater.cc:347] Connected to a master server at 127.14.181.62:39071
I20260809 20:11:26.417816 20534 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:26.418642 20534 heartbeater.cc:511] Master 127.14.181.62:39071 requested a full tablet report, sending...
I20260809 20:11:26.420564 20217 ts_manager.cc:194] Registered new tserver with Master: f1de7ae49dce49e997e739c9f2969400 (127.14.181.1:43263)
I20260809 20:11:26.422006 20217 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.1@KRBTEST.COM'} at 127.14.181.1:56177
WARNING: no policy specified for kudu/127.14.181.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
I20260809 20:11:26.446012 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:0
--local_ip_for_outbound_sockets=127.14.181.2
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39071
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:37379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:26.750200 20541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:26.750481 20541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:26.750624 20541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:26.757560 20541 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:26.757650 20541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:26.757759 20541 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:11:26.767338 20541 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:37379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39071
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:26.768406 20541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:26.769549 20541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:26.781344 20548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:26.781386 20553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:26.781415 20549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:26.782418 20541 server_base.cc:1034] running on GCE node
I20260809 20:11:26.782915 20541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:26.783703 20541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:26.784884 20541 hybrid_clock.cc:648] HybridClock initialized: now 1786306286784837 us; error 41 us; skew 500 ppm
I20260809 20:11:26.785137 20541 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:26 dist-test-slave-6zbq krb5kdc[20145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306286, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:26.788066 20541 init.cc:377] Logged in from keytab as kudu/127.14.181.2@KRBTEST.COM (short username kudu)
I20260809 20:11:26.789547 20541 webserver.cc:460] Webserver started at http://127.14.181.2:38471/ using document root <none> and password file <none>
I20260809 20:11:26.790179 20541 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:26.790302 20541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:26.790608 20541 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:26.793273 20541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/data/instance:
uuid: "7828b2f8cbd6495e95b7a24cf19eb7e8"
format_stamp: "Formatted at 2026-08-09 20:11:26 on dist-test-slave-6zbq"
server_key: "a94db42b13e2f29d7f94abf584f58970"
server_key_iv: "49f3766995ee805001bcc77262d659dc"
server_key_version: "encryptionkey@0"
I20260809 20:11:26.793995 20541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance:
uuid: "7828b2f8cbd6495e95b7a24cf19eb7e8"
format_stamp: "Formatted at 2026-08-09 20:11:26 on dist-test-slave-6zbq"
server_key: "a94db42b13e2f29d7f94abf584f58970"
server_key_iv: "49f3766995ee805001bcc77262d659dc"
server_key_version: "encryptionkey@0"
I20260809 20:11:26.798779 20541 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260809 20:11:26.801887 20563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:26.803063 20541 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:11:26.803207 20541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "7828b2f8cbd6495e95b7a24cf19eb7e8"
format_stamp: "Formatted at 2026-08-09 20:11:26 on dist-test-slave-6zbq"
server_key: "a94db42b13e2f29d7f94abf584f58970"
server_key_iv: "49f3766995ee805001bcc77262d659dc"
server_key_version: "encryptionkey@0"
I20260809 20:11:26.803370 20541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:26.841053 20541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:26.844657 20541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:26.844915 20541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:26.845763 20541 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:11:26.847007 20541 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:26.847080 20541 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:26.847204 20541 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:26.847257 20541 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:26.876119 20541 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:46345
I20260809 20:11:26.876161 20745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:46345 every 8 connection(s)
I20260809 20:11:26.877192 20541 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:11:26.879963 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 20541
I20260809 20:11:26.880131 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance
I20260809 20:11:26.880717 15060 external_mini_cluster.cc:1428] Setting key 83679e0139c8d8b755be81dfaedfa35a
Aug 09 20:11:26 dist-test-slave-6zbq krb5kdc[20145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306286, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:26.896003 20536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:26.879483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:52807 (local address 127.14.181.62:39071)
0809 20:11:26.879654 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:26.879660 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:26.880880 (+ 1220us) server_negotiation.cc:407] Connection header received
0809 20:11:26.882891 (+ 2011us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:26.882896 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:26.882976 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:26.883074 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:26.884408 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:26.885341 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:26.886820 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:26.887404 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:26.887520 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:26.890785 (+ 3265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:26.890790 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:26.890793 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:26.890823 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:26.893140 (+ 2317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:26.893810 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:26.893815 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:26.893818 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:26.893951 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:26.894373 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:26.894378 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:26.894381 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:26.894650 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:26.894787 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:26.895457 (+ 670us) server_negotiation.cc:299] Negotiation successful
0809 20:11:26.895678 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 20:11:26.896878 20752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:26.880013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39071 (local address 127.14.181.2:52807)
0809 20:11:26.880735 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:26.880777 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:26.882650 (+ 1873us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:26.883253 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:26.883261 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:26.883726 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:26.884241 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:26.884257 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:26.885460 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:26.885464 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:26.886689 (+ 1225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:26.886701 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:26.887572 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:26.887577 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:26.887764 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:26.888334 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:26.888371 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:26.890593 (+ 2222us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:26.893274 (+ 2681us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:26.893283 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:26.893296 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:26.893681 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:26.894054 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:26.894059 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:26.894063 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:26.894238 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:26.894778 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:26.894785 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:26.895113 (+ 328us) client_negotiation.cc:769] Sending connection context
0809 20:11:26.895337 (+ 224us) client_negotiation.cc:240] Negotiation successful
0809 20:11:26.895827 (+ 490us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":305,"threads_started":1}
I20260809 20:11:26.898173 20750 heartbeater.cc:347] Connected to a master server at 127.14.181.62:39071
I20260809 20:11:26.898486 20750 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:26.899135 20750 heartbeater.cc:511] Master 127.14.181.62:39071 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.14.181.3@KRBTEST.COM; defaulting to no policy
I20260809 20:11:26.900460 20217 ts_manager.cc:194] Registered new tserver with Master: 7828b2f8cbd6495e95b7a24cf19eb7e8 (127.14.181.2:46345)
I20260809 20:11:26.901257 20217 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.2@KRBTEST.COM'} at 127.14.181.2:52807
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
I20260809 20:11:26.921330 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:0
--local_ip_for_outbound_sockets=127.14.181.3
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39071
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:37379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:27.224244 20761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:27.224509 20761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:27.224615 20761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:27.231380 20761 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:27.231470 20761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:27.231580 20761 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:11:27.240615 20761 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:37379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39071
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:27.241650 20761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:27.242786 20761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:27.255610 20767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:27.255592 20778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:27.255679 20775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:27.256492 20761 server_base.cc:1034] running on GCE node
I20260809 20:11:27.257082 20761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:27.258090 20761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:27.259312 20761 hybrid_clock.cc:648] HybridClock initialized: now 1786306287259237 us; error 68 us; skew 500 ppm
I20260809 20:11:27.259624 20761 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:27 dist-test-slave-6zbq krb5kdc[20145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306287, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:27.262712 20761 init.cc:377] Logged in from keytab as kudu/127.14.181.3@KRBTEST.COM (short username kudu)
I20260809 20:11:27.264147 20761 webserver.cc:460] Webserver started at http://127.14.181.3:41993/ using document root <none> and password file <none>
I20260809 20:11:27.264822 20761 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:27.264923 20761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:27.265192 20761 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:27.268028 20761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/data/instance:
uuid: "fc5030fe22e0449e83c59ab37af80175"
format_stamp: "Formatted at 2026-08-09 20:11:27 on dist-test-slave-6zbq"
server_key: "cd8fa9eae5012dd9a8f3b4f1f3ad1546"
server_key_iv: "5747f822672fbd5bb5dc27bd73e1141c"
server_key_version: "encryptionkey@0"
I20260809 20:11:27.268767 20761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance:
uuid: "fc5030fe22e0449e83c59ab37af80175"
format_stamp: "Formatted at 2026-08-09 20:11:27 on dist-test-slave-6zbq"
server_key: "cd8fa9eae5012dd9a8f3b4f1f3ad1546"
server_key_iv: "5747f822672fbd5bb5dc27bd73e1141c"
server_key_version: "encryptionkey@0"
I20260809 20:11:27.273658 20761 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 20:11:27.277057 20788 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:27.278301 20761 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 20:11:27.278482 20761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "fc5030fe22e0449e83c59ab37af80175"
format_stamp: "Formatted at 2026-08-09 20:11:27 on dist-test-slave-6zbq"
server_key: "cd8fa9eae5012dd9a8f3b4f1f3ad1546"
server_key_iv: "5747f822672fbd5bb5dc27bd73e1141c"
server_key_version: "encryptionkey@0"
I20260809 20:11:27.278653 20761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:27.295907 20761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:27.299823 20761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:27.300071 20761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:27.301008 20761 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:11:27.302404 20761 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:27.302487 20761 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:27.302632 20761 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:27.302695 20761 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:27.333169 20761 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:46721
I20260809 20:11:27.333235 20982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:46721 every 8 connection(s)
I20260809 20:11:27.334465 20761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:11:27.336184 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 20761
I20260809 20:11:27.336390 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance
I20260809 20:11:27.336840 15060 external_mini_cluster.cc:1428] Setting key e7a583c0cf2b07f382d99edbd9873f6c
Aug 09 20:11:27 dist-test-slave-6zbq krb5kdc[20145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306287, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:27.353395 20536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:27.337106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:34721 (local address 127.14.181.62:39071)
0809 20:11:27.337317 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:27.337323 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:27.338600 (+ 1277us) server_negotiation.cc:407] Connection header received
0809 20:11:27.340498 (+ 1898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:27.340502 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:27.340567 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:27.340644 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:27.342023 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:27.342850 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:27.344316 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:27.344709 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:27.344799 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:27.348016 (+ 3217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:27.348021 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:27.348024 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:27.348056 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:27.350509 (+ 2453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:27.351206 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:27.351212 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:27.351215 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:27.351344 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:27.351742 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:27.351747 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:27.351749 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:27.352044 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:27.352171 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:27.352825 (+ 654us) server_negotiation.cc:299] Negotiation successful
0809 20:11:27.353039 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 20:11:27.354259 20985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:27.337575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39071 (local address 127.14.181.3:34721)
0809 20:11:27.338437 (+ 862us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:27.338496 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:27.340263 (+ 1767us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:27.340818 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:27.340825 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:27.341314 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:27.341857 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:27.341875 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:27.342998 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:27.343002 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:27.344187 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:27.344199 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:27.344867 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:27.344872 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:27.345055 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:27.345655 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:27.345677 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:27.347816 (+ 2139us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:27.350621 (+ 2805us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:27.350629 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:27.350643 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:27.351099 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:27.351448 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:27.351453 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:27.351457 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:27.351631 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:27.352163 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:27.352170 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:27.352481 (+ 311us) client_negotiation.cc:769] Sending connection context
0809 20:11:27.352709 (+ 228us) client_negotiation.cc:240] Negotiation successful
0809 20:11:27.353230 (+ 521us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":308,"threads_started":1}
I20260809 20:11:27.355404 20983 heartbeater.cc:347] Connected to a master server at 127.14.181.62:39071
I20260809 20:11:27.355674 20983 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:27.356371 20983 heartbeater.cc:511] Master 127.14.181.62:39071 requested a full tablet report, sending...
I20260809 20:11:27.357640 20217 ts_manager.cc:194] Registered new tserver with Master: fc5030fe22e0449e83c59ab37af80175 (127.14.181.3:46721)
I20260809 20:11:27.358440 20217 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.3@KRBTEST.COM'} at 127.14.181.3:34721
I20260809 20:11:27.363806 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 20:11:27 dist-test-slave-6zbq krb5kdc[20145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306287, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 09 20:11:27 dist-test-slave-6zbq krb5kdc[20145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306287, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:27.411514 20536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:27.398437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39498 (local address 127.14.181.62:39071)
0809 20:11:27.398635 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:27.398641 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:27.399141 (+ 500us) server_negotiation.cc:407] Connection header received
0809 20:11:27.399312 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:27.399317 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:27.399378 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:27.399456 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:27.401022 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:27.401732 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:27.402930 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:27.403309 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:27.403395 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:27.406772 (+ 3377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:27.406777 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:27.406780 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:27.406810 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:27.409104 (+ 2294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:27.409666 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:27.409670 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:27.409672 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:27.409797 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:27.410144 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:27.410148 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:27.410150 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:27.410508 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:27.410719 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:27.411027 (+ 308us) server_negotiation.cc:299] Negotiation successful
0809 20:11:27.411234 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260809 20:11:27.411971 20217 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:39498
I20260809 20:11:27.413388 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 20320
Aug 09 20:11:27 dist-test-slave-6zbq krb5kdc[20145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306287, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.14.181.1@KRBTEST.COM
I20260809 20:11:27.425028 20534 heartbeater.cc:503] Master 127.14.181.62:39071 was elected leader, sending a full tablet report...
I20260809 20:11:27.427021 21004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:27.414108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38502 (local address 127.14.181.1:43263)
0809 20:11:27.414624 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:27.414630 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:27.414652 (+ 22us) server_negotiation.cc:407] Connection header received
0809 20:11:27.414709 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:27.414715 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:27.414885 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:27.414992 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:27.415989 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:27.416928 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:27.417986 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:27.418574 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:27.418665 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:27.421934 (+ 3269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:27.421944 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:27.421955 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:27.421981 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:27.424335 (+ 2354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:27.424998 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:27.425004 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:27.425007 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:27.425188 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:27.425541 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:27.425545 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:27.425547 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:27.425933 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:27.426218 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:27.426441 (+ 223us) server_negotiation.cc:299] Negotiation successful
0809 20:11:27.426695 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":257,"threads_started":1}
W20260809 20:11:27.428081 20526 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:38502
W20260809 20:11:27.429013 15060 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 20320: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 20:11:27.429210 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 20320
I20260809 20:11:27.452322 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 20541
Aug 09 20:11:27 dist-test-slave-6zbq krb5kdc[20145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306287, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.14.181.2@KRBTEST.COM
I20260809 20:11:27.466166 21005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:27.453182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54404 (local address 127.14.181.2:46345)
0809 20:11:27.453657 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:27.453663 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:27.453686 (+ 23us) server_negotiation.cc:407] Connection header received
0809 20:11:27.453741 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:27.453746 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:27.453943 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:27.454056 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:27.455180 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:27.456159 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:27.457280 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:27.457776 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:27.457865 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:27.461355 (+ 3490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:27.461365 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:27.461376 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:27.461414 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:27.464030 (+ 2616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:27.464547 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:27.464553 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:27.464556 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:27.464667 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:27.464927 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:27.464929 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:27.464931 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:27.465211 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:27.465420 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:27.465616 (+ 196us) server_negotiation.cc:299] Negotiation successful
0809 20:11:27.465819 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":234,"threads_started":1}
W20260809 20:11:27.467418 20741 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:54404
W20260809 20:11:27.468487 15060 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 20541: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 20:11:27.468616 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 20541
I20260809 20:11:27.489866 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 20761
Aug 09 20:11:27 dist-test-slave-6zbq krb5kdc[20145](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306287, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.14.181.3@KRBTEST.COM
I20260809 20:11:27.504470 21008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:27.490706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44872 (local address 127.14.181.3:46721)
0809 20:11:27.491285 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:27.491291 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:27.491319 (+ 28us) server_negotiation.cc:407] Connection header received
0809 20:11:27.491378 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:27.491384 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:27.491576 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:27.491695 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:27.492832 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:27.493851 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:27.495096 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:27.495663 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:27.495765 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:27.499579 (+ 3814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:27.499590 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:27.499602 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:27.499633 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:27.502193 (+ 2560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:27.502839 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:27.502845 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:27.502848 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:27.502965 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:27.503214 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:27.503217 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:27.503219 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:27.503524 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:27.503748 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:27.503944 (+ 196us) server_negotiation.cc:299] Negotiation successful
0809 20:11:27.504129 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":265,"threads_started":1}
W20260809 20:11:27.505578 20977 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:44872
W20260809 20:11:27.506567 15060 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 20761: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 20:11:27.506714 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 20761
I20260809 20:11:27.529052 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 20166
I20260809 20:11:27.530043 20266 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:27.628805 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 20166
2026-08-09T20:11:27Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3520 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:11:27 dist-test-slave-6zbq krb5kdc[21016](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:11:27 dist-test-slave-6zbq krb5kdc[21016](info): set up 2 sockets
Aug 09 20:11:27 dist-test-slave-6zbq krb5kdc[21016](info): commencing operation
krb5kdc: starting...
W20260809 20:11:28.805059 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.001s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:11:28 dist-test-slave-6zbq krb5kdc[21016](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:11:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:11:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:11:28.978830 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:39239
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:43175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:39239
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:29.289408 21036 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:29.289665 21036 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:29.289790 21036 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:29.296747 21036 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:11:29.296839 21036 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:29.296911 21036 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:29.296979 21036 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:11:29.297036 21036 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:11:29.306775 21036 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:43175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:39239
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:39239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:29.307874 21036 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:29.309032 21036 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:29.320708 21046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:29.320768 21043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:29.320742 21042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:29.321717 21036 server_base.cc:1034] running on GCE node
I20260809 20:11:29.322544 21036 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:29.323768 21036 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:29.324957 21036 hybrid_clock.cc:648] HybridClock initialized: now 1786306289324915 us; error 30 us; skew 500 ppm
I20260809 20:11:29.325254 21036 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:29 dist-test-slave-6zbq krb5kdc[21016](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306289, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:29.328033 21036 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:11:29.329275 21036 webserver.cc:460] Webserver started at http://127.14.181.62:39171/ using document root <none> and password file <none>
I20260809 20:11:29.329879 21036 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:29.329988 21036 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:29.330264 21036 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:29.332954 21036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "05a4ec1ce43b4c8e9e5a73bbc79e7981"
format_stamp: "Formatted at 2026-08-09 20:11:29 on dist-test-slave-6zbq"
server_key: "0793bd64c6ff80491895ad97ffa7ce6b"
server_key_iv: "a4848ffff119ee405b6f5541baf37d5e"
server_key_version: "encryptionkey@0"
I20260809 20:11:29.333676 21036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "05a4ec1ce43b4c8e9e5a73bbc79e7981"
format_stamp: "Formatted at 2026-08-09 20:11:29 on dist-test-slave-6zbq"
server_key: "0793bd64c6ff80491895ad97ffa7ce6b"
server_key_iv: "a4848ffff119ee405b6f5541baf37d5e"
server_key_version: "encryptionkey@0"
I20260809 20:11:29.338183 21036 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260809 20:11:29.341289 21056 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:29.342509 21036 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:11:29.342659 21036 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "05a4ec1ce43b4c8e9e5a73bbc79e7981"
format_stamp: "Formatted at 2026-08-09 20:11:29 on dist-test-slave-6zbq"
server_key: "0793bd64c6ff80491895ad97ffa7ce6b"
server_key_iv: "a4848ffff119ee405b6f5541baf37d5e"
server_key_version: "encryptionkey@0"
I20260809 20:11:29.342824 21036 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:29.358397 21036 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:29.361837 21036 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:29.362067 21036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:29.378615 21036 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:39239
I20260809 20:11:29.378615 21135 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:39239 every 8 connection(s)
I20260809 20:11:29.379865 21036 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:11:29.382311 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 21036
I20260809 20:11:29.382570 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:11:29.383355 15060 external_mini_cluster.cc:1428] Setting key 2db9974eecd5aa6332bf87bdd58de441
I20260809 20:11:29.383975 21136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:29.395390 21136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05a4ec1ce43b4c8e9e5a73bbc79e7981: Bootstrap starting.
Aug 09 20:11:29 dist-test-slave-6zbq krb5kdc[21016](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306288, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:29.398705 21136 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05a4ec1ce43b4c8e9e5a73bbc79e7981: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:29.399786 21136 log.cc:824] T 00000000000000000000000000000000 P 05a4ec1ce43b4c8e9e5a73bbc79e7981: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:29.402724 21136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05a4ec1ce43b4c8e9e5a73bbc79e7981: No bootstrap required, opened a new log
I20260809 20:11:29.404728 21140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:29.385347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46228 (local address 127.14.181.62:39239)
0809 20:11:29.386057 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:29.386068 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:29.386103 (+ 35us) server_negotiation.cc:407] Connection header received
0809 20:11:29.388297 (+ 2194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:29.388318 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:29.388671 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:29.389011 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:29.390492 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:29.391699 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:29.392870 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:29.393551 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:29.393721 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:29.397832 (+ 4111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:29.397843 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:29.397855 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:29.397896 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:29.401072 (+ 3176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:29.401817 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:29.401822 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:29.401827 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:29.401974 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:29.402379 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:29.402384 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:29.402388 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:29.402857 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:29.403056 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:29.403491 (+ 435us) server_negotiation.cc:299] Negotiation successful
0809 20:11:29.403776 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":325,"threads_started":1}
I20260809 20:11:29.410212 21136 raft_consensus.cc:348] T 00000000000000000000000000000000 P 05a4ec1ce43b4c8e9e5a73bbc79e7981 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05a4ec1ce43b4c8e9e5a73bbc79e7981" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39239 } }
I20260809 20:11:29.410567 21136 raft_consensus.cc:374] T 00000000000000000000000000000000 P 05a4ec1ce43b4c8e9e5a73bbc79e7981 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:29.410657 21136 raft_consensus.cc:729] T 00000000000000000000000000000000 P 05a4ec1ce43b4c8e9e5a73bbc79e7981 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05a4ec1ce43b4c8e9e5a73bbc79e7981, State: Initialized, Role: FOLLOWER
I20260809 20:11:29.411149 21136 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05a4ec1ce43b4c8e9e5a73bbc79e7981 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05a4ec1ce43b4c8e9e5a73bbc79e7981" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39239 } }
I20260809 20:11:29.411352 21136 raft_consensus.cc:388] T 00000000000000000000000000000000 P 05a4ec1ce43b4c8e9e5a73bbc79e7981 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:11:29.411471 21136 raft_consensus.cc:482] T 00000000000000000000000000000000 P 05a4ec1ce43b4c8e9e5a73bbc79e7981 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:11:29.411607 21136 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 05a4ec1ce43b4c8e9e5a73bbc79e7981 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:29.413573 21136 raft_consensus.cc:504] T 00000000000000000000000000000000 P 05a4ec1ce43b4c8e9e5a73bbc79e7981 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05a4ec1ce43b4c8e9e5a73bbc79e7981" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39239 } }
I20260809 20:11:29.414004 21136 leader_election.cc:302] T 00000000000000000000000000000000 P 05a4ec1ce43b4c8e9e5a73bbc79e7981 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05a4ec1ce43b4c8e9e5a73bbc79e7981; no voters:
I20260809 20:11:29.414531 21136 leader_election.cc:288] T 00000000000000000000000000000000 P 05a4ec1ce43b4c8e9e5a73bbc79e7981 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:11:29.414624 21144 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 05a4ec1ce43b4c8e9e5a73bbc79e7981 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:29.415288 21144 raft_consensus.cc:686] T 00000000000000000000000000000000 P 05a4ec1ce43b4c8e9e5a73bbc79e7981 [term 1 LEADER]: Becoming Leader. State: Replica: 05a4ec1ce43b4c8e9e5a73bbc79e7981, State: Running, Role: LEADER
I20260809 20:11:29.415763 21144 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05a4ec1ce43b4c8e9e5a73bbc79e7981 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05a4ec1ce43b4c8e9e5a73bbc79e7981" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39239 } }
I20260809 20:11:29.416414 21136 sys_catalog.cc:564] T 00000000000000000000000000000000 P 05a4ec1ce43b4c8e9e5a73bbc79e7981 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:11:29.417997 21147 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05a4ec1ce43b4c8e9e5a73bbc79e7981 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05a4ec1ce43b4c8e9e5a73bbc79e7981. Latest consensus state: current_term: 1 leader_uuid: "05a4ec1ce43b4c8e9e5a73bbc79e7981" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05a4ec1ce43b4c8e9e5a73bbc79e7981" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39239 } } }
I20260809 20:11:29.418475 21147 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05a4ec1ce43b4c8e9e5a73bbc79e7981 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:29.418471 21146 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05a4ec1ce43b4c8e9e5a73bbc79e7981 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "05a4ec1ce43b4c8e9e5a73bbc79e7981" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05a4ec1ce43b4c8e9e5a73bbc79e7981" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39239 } } }
I20260809 20:11:29.418821 21146 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05a4ec1ce43b4c8e9e5a73bbc79e7981 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:29.420707 21152 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:11:29.424924 21152 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:11:29.432631 21152 catalog_manager.cc:1347] Generated new cluster ID: 4e84319f6d6146998daca7db621c6672
I20260809 20:11:29.432741 21152 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:11:29.445946 21152 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:11:29.447278 21152 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:11:29.456646 21152 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 05a4ec1ce43b4c8e9e5a73bbc79e7981: Generated new TSK 0
I20260809 20:11:29.457259 21152 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.181.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
I20260809 20:11:29.499298 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:0
--local_ip_for_outbound_sockets=127.14.181.1
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39239
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:43175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:29.802285 21179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:29.802546 21179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:29.802645 21179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:29.809399 21179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:29.809490 21179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:29.809600 21179 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:11:29.818686 21179 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:43175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39239
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:29.819712 21179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:29.820879 21179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:29.832695 21189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:29.832727 21193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:29.832819 21191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:29.833539 21179 server_base.cc:1034] running on GCE node
I20260809 20:11:29.834065 21179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:29.834964 21179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:29.836158 21179 hybrid_clock.cc:648] HybridClock initialized: now 1786306289836107 us; error 37 us; skew 500 ppm
I20260809 20:11:29.836442 21179 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:29 dist-test-slave-6zbq krb5kdc[21016](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306289, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:29.839363 21179 init.cc:377] Logged in from keytab as kudu/127.14.181.1@KRBTEST.COM (short username kudu)
I20260809 20:11:29.840696 21179 webserver.cc:460] Webserver started at http://127.14.181.1:42453/ using document root <none> and password file <none>
I20260809 20:11:29.841322 21179 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:29.841423 21179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:29.841674 21179 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:29.844316 21179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-0/data/instance:
uuid: "2d3e468589814b74ac8601fc63865363"
format_stamp: "Formatted at 2026-08-09 20:11:29 on dist-test-slave-6zbq"
server_key: "edc868d42062b03eabfd324cb5c2e977"
server_key_iv: "11e48c5ce562baaf481094999b199bf1"
server_key_version: "encryptionkey@0"
I20260809 20:11:29.845012 21179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance:
uuid: "2d3e468589814b74ac8601fc63865363"
format_stamp: "Formatted at 2026-08-09 20:11:29 on dist-test-slave-6zbq"
server_key: "edc868d42062b03eabfd324cb5c2e977"
server_key_iv: "11e48c5ce562baaf481094999b199bf1"
server_key_version: "encryptionkey@0"
I20260809 20:11:29.849788 21179 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 20:11:29.853039 21203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:29.854220 21179 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 20:11:29.854383 21179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "2d3e468589814b74ac8601fc63865363"
format_stamp: "Formatted at 2026-08-09 20:11:29 on dist-test-slave-6zbq"
server_key: "edc868d42062b03eabfd324cb5c2e977"
server_key_iv: "11e48c5ce562baaf481094999b199bf1"
server_key_version: "encryptionkey@0"
I20260809 20:11:29.854552 21179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:29.869552 21179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:29.873375 21179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:29.873613 21179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:29.874490 21179 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:11:29.875703 21179 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:29.875774 21179 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:29.875885 21179 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:29.875934 21179 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:29.904348 21179 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:43427
I20260809 20:11:29.904369 21376 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:43427 every 8 connection(s)
I20260809 20:11:29.905545 21179 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:11:29.913501 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 21179
I20260809 20:11:29.913714 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance
I20260809 20:11:29.914558 15060 external_mini_cluster.cc:1428] Setting key c7e242fe0a489a1481d718669fe8c35d
Aug 09 20:11:29 dist-test-slave-6zbq krb5kdc[21016](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306289, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:29.926373 21382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:29.907881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:34315 (local address 127.14.181.62:39239)
0809 20:11:29.908304 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:29.908309 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:29.909081 (+ 772us) server_negotiation.cc:407] Connection header received
0809 20:11:29.910944 (+ 1863us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:29.910950 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:29.911041 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:29.911137 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:29.912860 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:29.913606 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:29.915874 (+ 2268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:29.916402 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:29.916539 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:29.919979 (+ 3440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:29.919985 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:29.919989 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:29.920028 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:29.923002 (+ 2974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:29.923798 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:29.923803 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:29.923806 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:29.923954 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:29.924427 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:29.924431 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:29.924434 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:29.924792 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:29.924936 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:29.925597 (+ 661us) server_negotiation.cc:299] Negotiation successful
0809 20:11:29.925865 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":310,"thread_start_us":215,"threads_started":1}
I20260809 20:11:29.927280 21385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:29.908267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39239 (local address 127.14.181.1:34315)
0809 20:11:29.908929 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:29.908965 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:29.910669 (+ 1704us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:29.911604 (+ 935us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:29.911613 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:29.912115 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:29.912669 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:29.912703 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:29.913785 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:29.913792 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:29.915732 (+ 1940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:29.915748 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:29.916644 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:29.916653 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:29.916898 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:29.917609 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:29.917636 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:29.919753 (+ 2117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:29.923127 (+ 3374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:29.923134 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:29.923148 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:29.923660 (+ 512us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:29.924056 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:29.924060 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:29.924064 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:29.924306 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:29.924911 (+ 605us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:29.924916 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:29.925222 (+ 306us) client_negotiation.cc:769] Sending connection context
0809 20:11:29.925459 (+ 237us) client_negotiation.cc:240] Negotiation successful
0809 20:11:29.925995 (+ 536us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":251,"threads_started":1}
I20260809 20:11:29.928767 21378 heartbeater.cc:347] Connected to a master server at 127.14.181.62:39239
I20260809 20:11:29.929041 21378 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:29.929706 21378 heartbeater.cc:511] Master 127.14.181.62:39239 requested a full tablet report, sending...
I20260809 20:11:29.931957 21087 ts_manager.cc:194] Registered new tserver with Master: 2d3e468589814b74ac8601fc63865363 (127.14.181.1:43427)
I20260809 20:11:29.933969 21087 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.1@KRBTEST.COM'} at 127.14.181.1:34315
WARNING: no policy specified for kudu/127.14.181.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
I20260809 20:11:29.958559 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:0
--local_ip_for_outbound_sockets=127.14.181.2
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39239
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:43175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:30.257645 21389 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:30.257905 21389 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:30.258052 21389 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:30.265026 21389 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:30.265132 21389 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:30.265282 21389 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:11:30.274394 21389 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:43175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39239
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:30.275487 21389 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:30.276669 21389 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:30.288473 21397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:30.288528 21401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:30.288633 21395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:30.289352 21389 server_base.cc:1034] running on GCE node
I20260809 20:11:30.289845 21389 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:30.290685 21389 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:30.291831 21389 hybrid_clock.cc:648] HybridClock initialized: now 1786306290291786 us; error 35 us; skew 500 ppm
I20260809 20:11:30.292092 21389 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:30 dist-test-slave-6zbq krb5kdc[21016](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306290, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:30.294914 21389 init.cc:377] Logged in from keytab as kudu/127.14.181.2@KRBTEST.COM (short username kudu)
I20260809 20:11:30.296133 21389 webserver.cc:460] Webserver started at http://127.14.181.2:41197/ using document root <none> and password file <none>
I20260809 20:11:30.296742 21389 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:30.296856 21389 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:30.297130 21389 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:30.299820 21389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-1/data/instance:
uuid: "0785c672b21e4ceca90d8243fddf4e71"
format_stamp: "Formatted at 2026-08-09 20:11:30 on dist-test-slave-6zbq"
server_key: "724c5e58f9b308e906be09060d20c3f0"
server_key_iv: "04e1090795cd9d9ca437f202dbac0eb5"
server_key_version: "encryptionkey@0"
I20260809 20:11:30.300542 21389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance:
uuid: "0785c672b21e4ceca90d8243fddf4e71"
format_stamp: "Formatted at 2026-08-09 20:11:30 on dist-test-slave-6zbq"
server_key: "724c5e58f9b308e906be09060d20c3f0"
server_key_iv: "04e1090795cd9d9ca437f202dbac0eb5"
server_key_version: "encryptionkey@0"
I20260809 20:11:30.305171 21389 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 20:11:30.308441 21408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:30.309695 21389 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 20:11:30.309835 21389 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "0785c672b21e4ceca90d8243fddf4e71"
format_stamp: "Formatted at 2026-08-09 20:11:30 on dist-test-slave-6zbq"
server_key: "724c5e58f9b308e906be09060d20c3f0"
server_key_iv: "04e1090795cd9d9ca437f202dbac0eb5"
server_key_version: "encryptionkey@0"
I20260809 20:11:30.310019 21389 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:30.332616 21389 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:30.336200 21389 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:30.336457 21389 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:30.337345 21389 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:11:30.338594 21389 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:30.338673 21389 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:30.338786 21389 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:30.338838 21389 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:30.368327 21389 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:45371
I20260809 20:11:30.368371 21583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:45371 every 8 connection(s)
I20260809 20:11:30.369529 21389 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:11:30.373224 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 21389
I20260809 20:11:30.373413 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance
I20260809 20:11:30.373821 15060 external_mini_cluster.cc:1428] Setting key 58667472d39922c32c94232c270ae9da
Aug 09 20:11:30 dist-test-slave-6zbq krb5kdc[21016](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306290, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:30.389981 21382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:30.371902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:41967 (local address 127.14.181.62:39239)
0809 20:11:30.372097 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:30.372103 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:30.373164 (+ 1061us) server_negotiation.cc:407] Connection header received
0809 20:11:30.375196 (+ 2032us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:30.375200 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:30.375282 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:30.375363 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:30.376874 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:30.377549 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:30.379754 (+ 2205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:30.380346 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:30.380471 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:30.384483 (+ 4012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:30.384488 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:30.384491 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:30.384523 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:30.387121 (+ 2598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:30.387804 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:30.387808 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:30.387810 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:30.387959 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:30.388369 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:30.388373 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:30.388375 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:30.388642 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:30.388800 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:30.389427 (+ 627us) server_negotiation.cc:299] Negotiation successful
0809 20:11:30.389649 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 20:11:30.390942 21586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:30.372355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39239 (local address 127.14.181.2:41967)
0809 20:11:30.373018 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:30.373060 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:30.374930 (+ 1870us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:30.375622 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:30.375633 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:30.376183 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:30.376706 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:30.376722 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:30.377697 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:30.377703 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:30.379589 (+ 1886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:30.379604 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:30.380565 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:30.380572 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:30.380848 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:30.381594 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:30.381621 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:30.384296 (+ 2675us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:30.387256 (+ 2960us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:30.387265 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:30.387279 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:30.387684 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:30.388061 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:30.388066 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:30.388070 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:30.388257 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:30.388763 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:30.388771 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:30.389080 (+ 309us) client_negotiation.cc:769] Sending connection context
0809 20:11:30.389301 (+ 221us) client_negotiation.cc:240] Negotiation successful
0809 20:11:30.389795 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":247,"threads_started":1}
I20260809 20:11:30.392207 21584 heartbeater.cc:347] Connected to a master server at 127.14.181.62:39239
I20260809 20:11:30.392498 21584 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:30.393186 21584 heartbeater.cc:511] Master 127.14.181.62:39239 requested a full tablet report, sending...
I20260809 20:11:30.394544 21087 ts_manager.cc:194] Registered new tserver with Master: 0785c672b21e4ceca90d8243fddf4e71 (127.14.181.2:45371)
I20260809 20:11:30.395318 21087 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.2@KRBTEST.COM'} at 127.14.181.2:41967
WARNING: no policy specified for kudu/127.14.181.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
I20260809 20:11:30.423101 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:0
--local_ip_for_outbound_sockets=127.14.181.3
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39239
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:43175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:30.737373 21589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:30.737613 21589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:30.737744 21589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:30.744714 21589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:30.744818 21589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:30.744958 21589 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:11:30.753997 21589 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:43175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39239
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:30.755043 21589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:30.756168 21589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:30.767936 21596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:30.767982 21595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:30.768016 21598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:30.768682 21589 server_base.cc:1034] running on GCE node
I20260809 20:11:30.769207 21589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:30.770010 21589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:30.771194 21589 hybrid_clock.cc:648] HybridClock initialized: now 1786306290771153 us; error 42 us; skew 500 ppm
I20260809 20:11:30.771473 21589 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:30 dist-test-slave-6zbq krb5kdc[21016](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306290, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:30.774286 21589 init.cc:377] Logged in from keytab as kudu/127.14.181.3@KRBTEST.COM (short username kudu)
I20260809 20:11:30.775588 21589 webserver.cc:460] Webserver started at http://127.14.181.3:34597/ using document root <none> and password file <none>
I20260809 20:11:30.776166 21589 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:30.776286 21589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:30.776558 21589 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:30.779251 21589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-2/data/instance:
uuid: "2c5ee0384eee40678bd0ebd4cc9c96e8"
format_stamp: "Formatted at 2026-08-09 20:11:30 on dist-test-slave-6zbq"
server_key: "07a1c249589bdb32fd0f45be88deacdf"
server_key_iv: "eb3e92cfc9ec82e53b7c3076adc34ac1"
server_key_version: "encryptionkey@0"
I20260809 20:11:30.780025 21589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance:
uuid: "2c5ee0384eee40678bd0ebd4cc9c96e8"
format_stamp: "Formatted at 2026-08-09 20:11:30 on dist-test-slave-6zbq"
server_key: "07a1c249589bdb32fd0f45be88deacdf"
server_key_iv: "eb3e92cfc9ec82e53b7c3076adc34ac1"
server_key_version: "encryptionkey@0"
I20260809 20:11:30.784711 21589 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 20:11:30.787808 21609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:30.788915 21589 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 20:11:30.789057 21589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "2c5ee0384eee40678bd0ebd4cc9c96e8"
format_stamp: "Formatted at 2026-08-09 20:11:30 on dist-test-slave-6zbq"
server_key: "07a1c249589bdb32fd0f45be88deacdf"
server_key_iv: "eb3e92cfc9ec82e53b7c3076adc34ac1"
server_key_version: "encryptionkey@0"
I20260809 20:11:30.789240 21589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:30.813128 21589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:30.816788 21589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:30.817036 21589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:30.817925 21589 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:11:30.819160 21589 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:30.819265 21589 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:30.819375 21589 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:30.819425 21589 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:30.848577 21589 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:33659
I20260809 20:11:30.848631 21802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:33659 every 8 connection(s)
I20260809 20:11:30.849682 21589 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:11:30.859862 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 21589
I20260809 20:11:30.860050 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance
I20260809 20:11:30.860481 15060 external_mini_cluster.cc:1428] Setting key 2d8be86372b1f118d7256f94a2f486f5
Aug 09 20:11:30 dist-test-slave-6zbq krb5kdc[21016](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306290, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:30.867515 21382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:30.851915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:46685 (local address 127.14.181.62:39239)
0809 20:11:30.852115 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:30.852122 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:30.853125 (+ 1003us) server_negotiation.cc:407] Connection header received
0809 20:11:30.854903 (+ 1778us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:30.854908 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:30.854977 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:30.855059 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:30.856314 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:30.857016 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:30.858584 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:30.859020 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:30.859128 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:30.862735 (+ 3607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:30.862740 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:30.862743 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:30.862774 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:30.865103 (+ 2329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:30.865707 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:30.865710 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:30.865712 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:30.865834 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:30.866143 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:30.866146 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:30.866148 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:30.866428 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:30.866535 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:30.867122 (+ 587us) server_negotiation.cc:299] Negotiation successful
0809 20:11:30.867293 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 20:11:30.868268 21805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:30.852331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39239 (local address 127.14.181.3:46685)
0809 20:11:30.852978 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:30.853013 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:30.854679 (+ 1666us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:30.855238 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:30.855245 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:30.855682 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:30.856174 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:30.856190 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:30.857119 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:30.857122 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:30.858394 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:30.858408 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:30.859208 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:30.859212 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:30.859407 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:30.859992 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:30.860019 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:30.862536 (+ 2517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:30.865226 (+ 2690us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:30.865232 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:30.865242 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:30.865617 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:30.865907 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:30.865910 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:30.865912 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:30.866067 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:30.866547 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:30.866554 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:30.866850 (+ 296us) client_negotiation.cc:769] Sending connection context
0809 20:11:30.867050 (+ 200us) client_negotiation.cc:240] Negotiation successful
0809 20:11:30.867364 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":244,"threads_started":1}
I20260809 20:11:30.869357 21803 heartbeater.cc:347] Connected to a master server at 127.14.181.62:39239
I20260809 20:11:30.869586 21803 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:30.870157 21803 heartbeater.cc:511] Master 127.14.181.62:39239 requested a full tablet report, sending...
I20260809 20:11:30.871364 21087 ts_manager.cc:194] Registered new tserver with Master: 2c5ee0384eee40678bd0ebd4cc9c96e8 (127.14.181.3:33659)
I20260809 20:11:30.872123 21087 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.3@KRBTEST.COM'} at 127.14.181.3:46685
I20260809 20:11:30.875346 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 20:11:30 dist-test-slave-6zbq krb5kdc[21016](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 20:11:30 dist-test-slave-6zbq krb5kdc[21016](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.1@KRBTEST.COM
I20260809 20:11:30.921962 21812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:30.908531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41528 (local address 127.14.181.1:43427)
0809 20:11:30.909065 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:30.909071 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:30.909095 (+ 24us) server_negotiation.cc:407] Connection header received
0809 20:11:30.909153 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:30.909158 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:30.909323 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:30.909440 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:30.910776 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:30.911767 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:30.912876 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:30.913448 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:30.913536 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:30.917150 (+ 3614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:30.917163 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:30.917178 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:30.917212 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:30.919778 (+ 2566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:30.920328 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:30.920333 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:30.920336 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:30.920446 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:30.920731 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:30.920734 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:30.920736 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:30.921033 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:30.921301 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:30.921491 (+ 190us) server_negotiation.cc:299] Negotiation successful
0809 20:11:30.921689 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":287,"threads_started":1}
Aug 09 20:11:30 dist-test-slave-6zbq krb5kdc[21016](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:30.936885 21378 heartbeater.cc:503] Master 127.14.181.62:39239 was elected leader, sending a full tablet report...
I20260809 20:11:30.937618 21382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:30.925613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46234 (local address 127.14.181.62:39239)
0809 20:11:30.925802 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:30.925807 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:30.925981 (+ 174us) server_negotiation.cc:407] Connection header received
0809 20:11:30.926119 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:30.926123 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:30.926183 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:30.926257 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:30.927438 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:30.928139 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:30.929307 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:30.929706 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:30.929807 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:30.933105 (+ 3298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:30.933109 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:30.933112 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:30.933142 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:30.935273 (+ 2131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:30.935838 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:30.935842 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:30.935845 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:30.935962 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:30.936289 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:30.936294 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:30.936297 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:30.936591 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:30.936815 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:30.937102 (+ 287us) server_negotiation.cc:299] Negotiation successful
0809 20:11:30.937299 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260809 20:11:30.938200 21086 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46234
I20260809 20:11:30.939028 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 21179
I20260809 20:11:30.950064 21812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:30.939685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41530 (local address 127.14.181.1:43427)
0809 20:11:30.939843 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:30.939848 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:30.940090 (+ 242us) server_negotiation.cc:407] Connection header received
0809 20:11:30.940233 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:30.940238 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:30.940299 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:30.940374 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:30.941483 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:30.942156 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:30.943337 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:30.943726 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:30.943830 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:30.945759 (+ 1929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:30.945763 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:30.945766 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:30.945793 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:30.947905 (+ 2112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:30.948455 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:30.948459 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:30.948461 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:30.948573 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:30.948899 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:30.948904 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:30.948907 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:30.949118 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:30.949327 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:30.949602 (+ 275us) server_negotiation.cc:299] Negotiation successful
0809 20:11:30.949813 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 20:11:30.950556 21370 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:31.034510 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 21179
I20260809 20:11:31.054466 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 21389
Aug 09 20:11:31 dist-test-slave-6zbq krb5kdc[21016](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.2@KRBTEST.COM
I20260809 20:11:31.068704 21823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:31.055244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46686 (local address 127.14.181.2:45371)
0809 20:11:31.055827 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:31.055835 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:31.055861 (+ 26us) server_negotiation.cc:407] Connection header received
0809 20:11:31.055923 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:31.055929 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:31.056134 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:31.056261 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:31.057335 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:31.058321 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:31.059529 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:31.060083 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:31.060176 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:31.063888 (+ 3712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:31.063901 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:31.063915 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:31.063955 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:31.066575 (+ 2620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:31.067106 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:31.067111 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:31.067113 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:31.067230 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:31.067482 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:31.067485 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:31.067487 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:31.067798 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:31.068020 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:31.068223 (+ 203us) server_negotiation.cc:299] Negotiation successful
0809 20:11:31.068416 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":281,"threads_started":1}
I20260809 20:11:31.069868 21579 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:31.149915 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 21389
I20260809 20:11:31.173532 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 21589
Aug 09 20:11:31 dist-test-slave-6zbq krb5kdc[21016](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.3@KRBTEST.COM
I20260809 20:11:31.189030 21827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:31.174533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35822 (local address 127.14.181.3:33659)
0809 20:11:31.175149 (+ 616us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:31.175156 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:31.175193 (+ 37us) server_negotiation.cc:407] Connection header received
0809 20:11:31.175255 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:31.175262 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:31.175468 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:31.175607 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:31.176921 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:31.177936 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:31.179293 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:31.179828 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:31.179950 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:31.183886 (+ 3936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:31.183897 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:31.183910 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:31.183941 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:31.186443 (+ 2502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:31.187069 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:31.187076 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:31.187078 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:31.187209 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:31.187557 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:31.187560 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:31.187562 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:31.187878 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:31.188196 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:31.188455 (+ 259us) server_negotiation.cc:299] Negotiation successful
0809 20:11:31.188711 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":464,"thread_start_us":313,"threads_started":1}
I20260809 20:11:31.190209 21796 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:31.286279 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 21589
I20260809 20:11:31.312865 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 21036
I20260809 20:11:31.314056 21129 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:31.413873 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 21036
2026-08-09T20:11:31Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (3788 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:11:31 dist-test-slave-6zbq krb5kdc[21835](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:11:31 dist-test-slave-6zbq krb5kdc[21835](info): set up 2 sockets
Aug 09 20:11:31 dist-test-slave-6zbq krb5kdc[21835](info): commencing operation
krb5kdc: starting...
W20260809 20:11:32.603866 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.143s user 0.000s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:11:32 dist-test-slave-6zbq krb5kdc[21835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:11:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:11:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:11:32.777089 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:42415
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:32933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:42415
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:33.078816 21856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:33.079087 21856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:33.079226 21856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:33.086030 21856 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:11:33.086133 21856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:33.086216 21856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:33.086295 21856 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:11:33.086378 21856 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:11:33.095526 21856 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:32933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:42415
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:42415
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:33.096647 21856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:33.097832 21856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:33.108299 21864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:33.108263 21866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:33.108484 21863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:33.109021 21856 server_base.cc:1034] running on GCE node
I20260809 20:11:33.109738 21856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:33.111032 21856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:33.112239 21856 hybrid_clock.cc:648] HybridClock initialized: now 1786306293112188 us; error 44 us; skew 500 ppm
I20260809 20:11:33.112543 21856 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:33 dist-test-slave-6zbq krb5kdc[21835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306293, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:33.115370 21856 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:11:33.116420 21856 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:33.116528 21856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:33.116813 21856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:33.119586 21856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "c9e3aa46868e4b0f854ff54ee5be123e"
format_stamp: "Formatted at 2026-08-09 20:11:33 on dist-test-slave-6zbq"
server_key: "ed7fa8ed8bb48f2bf70505f712da3adb"
server_key_iv: "d1a4b2b836e81a85f4f5b79a2e9c105c"
server_key_version: "encryptionkey@0"
I20260809 20:11:33.120337 21856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "c9e3aa46868e4b0f854ff54ee5be123e"
format_stamp: "Formatted at 2026-08-09 20:11:33 on dist-test-slave-6zbq"
server_key: "ed7fa8ed8bb48f2bf70505f712da3adb"
server_key_iv: "d1a4b2b836e81a85f4f5b79a2e9c105c"
server_key_version: "encryptionkey@0"
I20260809 20:11:33.124920 21856 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 20:11:33.128130 21874 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:33.129272 21856 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 20:11:33.129426 21856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "c9e3aa46868e4b0f854ff54ee5be123e"
format_stamp: "Formatted at 2026-08-09 20:11:33 on dist-test-slave-6zbq"
server_key: "ed7fa8ed8bb48f2bf70505f712da3adb"
server_key_iv: "d1a4b2b836e81a85f4f5b79a2e9c105c"
server_key_version: "encryptionkey@0"
I20260809 20:11:33.129627 21856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:33.159353 21856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:33.163026 21856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:33.163267 21856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:33.179492 21856 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:42415
I20260809 20:11:33.179512 21962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:42415 every 8 connection(s)
I20260809 20:11:33.180279 21856 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:11:33.183555 21963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:33.190157 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 21856
I20260809 20:11:33.190410 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:11:33.191191 15060 external_mini_cluster.cc:1428] Setting key c75582c7a19ea501dd2f2fdd38f010f1
I20260809 20:11:33.193912 21963 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9e3aa46868e4b0f854ff54ee5be123e: Bootstrap starting.
I20260809 20:11:33.197009 21963 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9e3aa46868e4b0f854ff54ee5be123e: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:33.198202 21963 log.cc:824] T 00000000000000000000000000000000 P c9e3aa46868e4b0f854ff54ee5be123e: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:33.201048 21963 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9e3aa46868e4b0f854ff54ee5be123e: No bootstrap required, opened a new log
Aug 09 20:11:33 dist-test-slave-6zbq krb5kdc[21835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:33.210423 21963 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9e3aa46868e4b0f854ff54ee5be123e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9e3aa46868e4b0f854ff54ee5be123e" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42415 } }
I20260809 20:11:33.210755 21963 raft_consensus.cc:374] T 00000000000000000000000000000000 P c9e3aa46868e4b0f854ff54ee5be123e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:33.210866 21963 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9e3aa46868e4b0f854ff54ee5be123e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9e3aa46868e4b0f854ff54ee5be123e, State: Initialized, Role: FOLLOWER
I20260809 20:11:33.211414 21963 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9e3aa46868e4b0f854ff54ee5be123e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9e3aa46868e4b0f854ff54ee5be123e" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42415 } }
I20260809 20:11:33.211688 21963 raft_consensus.cc:388] T 00000000000000000000000000000000 P c9e3aa46868e4b0f854ff54ee5be123e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:11:33.211829 21963 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9e3aa46868e4b0f854ff54ee5be123e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:11:33.212009 21963 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9e3aa46868e4b0f854ff54ee5be123e [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:33.214468 21971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:33.193083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44582 (local address 127.14.181.62:42415)
0809 20:11:33.193867 (+ 784us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:33.193877 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:33.193918 (+ 41us) server_negotiation.cc:407] Connection header received
0809 20:11:33.195589 (+ 1671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:33.195613 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:33.195956 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:33.196241 (+ 285us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:33.198076 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:33.199689 (+ 1613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:33.201383 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:33.202015 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:33.202136 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:33.206422 (+ 4286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:33.206432 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:33.206450 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:33.206500 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:33.210089 (+ 3589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:33.210759 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:33.210768 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:33.210775 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:33.210985 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:33.211386 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:33.211392 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:33.211395 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:33.212111 (+ 716us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:33.212392 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:33.212739 (+ 347us) server_negotiation.cc:299] Negotiation successful
0809 20:11:33.213162 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":364,"threads_started":1}
I20260809 20:11:33.215034 21963 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9e3aa46868e4b0f854ff54ee5be123e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9e3aa46868e4b0f854ff54ee5be123e" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42415 } }
I20260809 20:11:33.215485 21963 leader_election.cc:302] T 00000000000000000000000000000000 P c9e3aa46868e4b0f854ff54ee5be123e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9e3aa46868e4b0f854ff54ee5be123e; no voters:
I20260809 20:11:33.216079 21963 leader_election.cc:288] T 00000000000000000000000000000000 P c9e3aa46868e4b0f854ff54ee5be123e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:11:33.216161 21974 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9e3aa46868e4b0f854ff54ee5be123e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:33.217907 21963 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9e3aa46868e4b0f854ff54ee5be123e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:11:33.218662 21974 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9e3aa46868e4b0f854ff54ee5be123e [term 1 LEADER]: Becoming Leader. State: Replica: c9e3aa46868e4b0f854ff54ee5be123e, State: Running, Role: LEADER
I20260809 20:11:33.219244 21974 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9e3aa46868e4b0f854ff54ee5be123e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9e3aa46868e4b0f854ff54ee5be123e" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42415 } }
I20260809 20:11:33.222138 21976 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9e3aa46868e4b0f854ff54ee5be123e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c9e3aa46868e4b0f854ff54ee5be123e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9e3aa46868e4b0f854ff54ee5be123e" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42415 } } }
I20260809 20:11:33.222162 21979 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9e3aa46868e4b0f854ff54ee5be123e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9e3aa46868e4b0f854ff54ee5be123e. Latest consensus state: current_term: 1 leader_uuid: "c9e3aa46868e4b0f854ff54ee5be123e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9e3aa46868e4b0f854ff54ee5be123e" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42415 } } }
I20260809 20:11:33.222581 21976 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9e3aa46868e4b0f854ff54ee5be123e [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:33.222586 21979 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9e3aa46868e4b0f854ff54ee5be123e [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:33.225942 21988 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:11:33.229557 21988 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:11:33.237128 21988 catalog_manager.cc:1347] Generated new cluster ID: 6b73027102864d2b80e01b617b353838
I20260809 20:11:33.237236 21988 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:11:33.263973 21988 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:11:33.265087 21988 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:11:33.274693 21988 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c9e3aa46868e4b0f854ff54ee5be123e: Generated new TSK 0
I20260809 20:11:33.275309 21988 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.181.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
I20260809 20:11:33.319250 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:0
--local_ip_for_outbound_sockets=127.14.181.1
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:42415
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:32933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:33.623428 22014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:33.623688 22014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:33.623829 22014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:33.630887 22014 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:33.631001 22014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:33.631152 22014 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:11:33.640499 22014 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:32933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:42415
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:33.641659 22014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:33.642913 22014 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:33.654662 22021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:33.654634 22022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:33.654692 22028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:33.655571 22014 server_base.cc:1034] running on GCE node
I20260809 20:11:33.656093 22014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:33.656916 22014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:33.658103 22014 hybrid_clock.cc:648] HybridClock initialized: now 1786306293658059 us; error 36 us; skew 500 ppm
I20260809 20:11:33.658425 22014 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:33 dist-test-slave-6zbq krb5kdc[21835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306293, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:33.661327 22014 init.cc:377] Logged in from keytab as kudu/127.14.181.1@KRBTEST.COM (short username kudu)
I20260809 20:11:33.662369 22014 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:33.662474 22014 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:33.662760 22014 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:33.665462 22014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-0/data/instance:
uuid: "fefb03ddf10b42a2938c31f2326ef05c"
format_stamp: "Formatted at 2026-08-09 20:11:33 on dist-test-slave-6zbq"
server_key: "e4fdfc1be8212734de1661acbaf3d988"
server_key_iv: "c80374c8fc45292d8a05b6f2c3411781"
server_key_version: "encryptionkey@0"
I20260809 20:11:33.666306 22014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance:
uuid: "fefb03ddf10b42a2938c31f2326ef05c"
format_stamp: "Formatted at 2026-08-09 20:11:33 on dist-test-slave-6zbq"
server_key: "e4fdfc1be8212734de1661acbaf3d988"
server_key_iv: "c80374c8fc45292d8a05b6f2c3411781"
server_key_version: "encryptionkey@0"
I20260809 20:11:33.670842 22014 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 20:11:33.673897 22036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:33.675107 22014 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:11:33.675271 22014 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "fefb03ddf10b42a2938c31f2326ef05c"
format_stamp: "Formatted at 2026-08-09 20:11:33 on dist-test-slave-6zbq"
server_key: "e4fdfc1be8212734de1661acbaf3d988"
server_key_iv: "c80374c8fc45292d8a05b6f2c3411781"
server_key_version: "encryptionkey@0"
I20260809 20:11:33.675465 22014 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:33.695091 22014 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:33.698935 22014 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:33.699163 22014 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:33.700012 22014 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:11:33.701258 22014 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:33.701349 22014 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:33.701452 22014 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:33.701529 22014 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:33.731134 22014 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:42483
I20260809 20:11:33.731201 22220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:42483 every 8 connection(s)
I20260809 20:11:33.731865 22014 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:11:33.735037 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 22014
I20260809 20:11:33.735270 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance
I20260809 20:11:33.736093 15060 external_mini_cluster.cc:1428] Setting key ced7d631c20b0d1ef43c4b8690d9f3a2
Aug 09 20:11:33 dist-test-slave-6zbq krb5kdc[21835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306293, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:33.752948 22225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:33.734112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:52377 (local address 127.14.181.62:42415)
0809 20:11:33.734542 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:33.734546 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:33.735585 (+ 1039us) server_negotiation.cc:407] Connection header received
0809 20:11:33.737760 (+ 2175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:33.737765 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:33.737840 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:33.737954 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:33.739804 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:33.740509 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:33.742530 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:33.742900 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:33.742988 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:33.747072 (+ 4084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:33.747079 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:33.747084 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:33.747124 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:33.750068 (+ 2944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:33.750810 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:33.750816 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:33.750819 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:33.750958 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:33.751335 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:33.751339 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:33.751342 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:33.751674 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:33.751816 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:33.752420 (+ 604us) server_negotiation.cc:299] Negotiation successful
0809 20:11:33.752618 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":241,"threads_started":1}
I20260809 20:11:33.753645 22226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:33.734618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:42415 (local address 127.14.181.1:52377)
0809 20:11:33.735408 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:33.735462 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:33.737520 (+ 2058us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:33.738176 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:33.738186 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:33.738927 (+ 741us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:33.739646 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:33.739669 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:33.740668 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:33.740674 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:33.742406 (+ 1732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:33.742421 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:33.743102 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:33.743108 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:33.743360 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:33.744004 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:33.744030 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:33.746836 (+ 2806us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:33.750200 (+ 3364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:33.750206 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:33.750217 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:33.750668 (+ 451us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:33.751045 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:33.751048 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:33.751050 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:33.751226 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:33.751792 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:33.751797 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:33.752056 (+ 259us) client_negotiation.cc:769] Sending connection context
0809 20:11:33.752278 (+ 222us) client_negotiation.cc:240] Negotiation successful
0809 20:11:33.752607 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":300,"threads_started":1}
I20260809 20:11:33.755010 22221 heartbeater.cc:347] Connected to a master server at 127.14.181.62:42415
I20260809 20:11:33.755316 22221 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:33.756052 22221 heartbeater.cc:511] Master 127.14.181.62:42415 requested a full tablet report, sending...
I20260809 20:11:33.758091 21907 ts_manager.cc:194] Registered new tserver with Master: fefb03ddf10b42a2938c31f2326ef05c (127.14.181.1:42483)
WARNING: no policy specified for kudu/127.14.181.2@KRBTEST.COM; defaulting to no policy
I20260809 20:11:33.759610 21907 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.1@KRBTEST.COM'} at 127.14.181.1:52377
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
I20260809 20:11:33.780404 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:0
--local_ip_for_outbound_sockets=127.14.181.2
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:42415
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:32933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:34.076007 22232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:34.076236 22232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:34.076334 22232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:34.083228 22232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:34.083323 22232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:34.083436 22232 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:11:34.092273 22232 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:32933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:42415
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:34.093291 22232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:34.094451 22232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:34.106328 22239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:34.106453 22243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:34.106568 22232 server_base.cc:1034] running on GCE node
W20260809 20:11:34.106419 22254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:34.107326 22232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:34.108130 22232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:34.109319 22232 hybrid_clock.cc:648] HybridClock initialized: now 1786306294109280 us; error 33 us; skew 500 ppm
I20260809 20:11:34.109592 22232 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:34 dist-test-slave-6zbq krb5kdc[21835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306294, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:34.115424 22232 init.cc:377] Logged in from keytab as kudu/127.14.181.2@KRBTEST.COM (short username kudu)
I20260809 20:11:34.116434 22232 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:34.116532 22232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:34.116828 22232 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:34.119593 22232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-1/data/instance:
uuid: "d51307d345264d559d1ebe5d90b1bd10"
format_stamp: "Formatted at 2026-08-09 20:11:34 on dist-test-slave-6zbq"
server_key: "9251e551d82e1f003e4a5123c9641e4f"
server_key_iv: "7b6a573784e99347c50ab24f55e12d9f"
server_key_version: "encryptionkey@0"
I20260809 20:11:34.120395 22232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance:
uuid: "d51307d345264d559d1ebe5d90b1bd10"
format_stamp: "Formatted at 2026-08-09 20:11:34 on dist-test-slave-6zbq"
server_key: "9251e551d82e1f003e4a5123c9641e4f"
server_key_iv: "7b6a573784e99347c50ab24f55e12d9f"
server_key_version: "encryptionkey@0"
I20260809 20:11:34.125078 22232 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 20:11:34.128326 22270 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:34.129813 22232 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 20:11:34.129951 22232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "d51307d345264d559d1ebe5d90b1bd10"
format_stamp: "Formatted at 2026-08-09 20:11:34 on dist-test-slave-6zbq"
server_key: "9251e551d82e1f003e4a5123c9641e4f"
server_key_iv: "7b6a573784e99347c50ab24f55e12d9f"
server_key_version: "encryptionkey@0"
I20260809 20:11:34.130134 22232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:34.147557 22232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:34.150961 22232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:34.151185 22232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:34.152029 22232 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:11:34.153210 22232 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:34.153304 22232 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:34.153409 22232 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:34.153477 22232 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:34.181828 22232 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:42577
I20260809 20:11:34.181859 22457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:42577 every 8 connection(s)
I20260809 20:11:34.182727 22232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:11:34.184146 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 22232
I20260809 20:11:34.184341 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance
I20260809 20:11:34.184835 15060 external_mini_cluster.cc:1428] Setting key b87bcf7bf204352a14607b09e34e3465
Aug 09 20:11:34 dist-test-slave-6zbq krb5kdc[21835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306294, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:34.203841 22225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:34.185703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:60797 (local address 127.14.181.62:42415)
0809 20:11:34.186165 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:34.186172 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:34.186719 (+ 547us) server_negotiation.cc:407] Connection header received
0809 20:11:34.189128 (+ 2409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:34.189134 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:34.189213 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:34.189311 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:34.191103 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.192235 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.194245 (+ 2010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.194950 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.195064 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:34.198607 (+ 3543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:34.198612 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:34.198615 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:34.198647 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:34.201040 (+ 2393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:34.201717 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:34.201722 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:34.201726 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:34.201857 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:34.202242 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:34.202245 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:34.202247 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:34.202536 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:34.202667 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:34.203297 (+ 630us) server_negotiation.cc:299] Negotiation successful
0809 20:11:34.203517 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335}
I20260809 20:11:34.204727 22465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:34.185700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:42415 (local address 127.14.181.2:60797)
0809 20:11:34.186550 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:34.186607 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:34.188842 (+ 2235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:34.189541 (+ 699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:34.189551 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:34.190190 (+ 639us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:34.190929 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:34.190954 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.192403 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.192408 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:34.194097 (+ 1689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:34.194112 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.195325 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.195332 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:34.195588 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:34.196323 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:34.196349 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:34.198404 (+ 2055us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:34.201181 (+ 2777us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:34.201189 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:34.201201 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:34.201597 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:34.201957 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:34.201962 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:34.201965 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:34.202130 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:34.202659 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:34.202667 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:34.202952 (+ 285us) client_negotiation.cc:769] Sending connection context
0809 20:11:34.203169 (+ 217us) client_negotiation.cc:240] Negotiation successful
0809 20:11:34.203667 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":359,"threads_started":1}
WARNING: no policy specified for kudu/127.14.181.3@KRBTEST.COM; defaulting to no policy
I20260809 20:11:34.206118 22462 heartbeater.cc:347] Connected to a master server at 127.14.181.62:42415
I20260809 20:11:34.206480 22462 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:34.207100 22462 heartbeater.cc:511] Master 127.14.181.62:42415 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.3@KRBTEST.COM" created.
I20260809 20:11:34.208591 21907 ts_manager.cc:194] Registered new tserver with Master: d51307d345264d559d1ebe5d90b1bd10 (127.14.181.2:42577)
I20260809 20:11:34.209369 21907 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.2@KRBTEST.COM'} at 127.14.181.2:60797
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
I20260809 20:11:34.229095 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:0
--local_ip_for_outbound_sockets=127.14.181.3
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:42415
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:32933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:34.531760 22472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:34.531996 22472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:34.532124 22472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:34.539283 22472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:34.539397 22472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:34.539563 22472 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:11:34.549307 22472 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:32933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:42415
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:34.550398 22472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:34.551555 22472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:34.563206 22477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:34.563280 22478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:34.563274 22481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:34.564248 22472 server_base.cc:1034] running on GCE node
I20260809 20:11:34.564795 22472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:34.565599 22472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:34.566776 22472 hybrid_clock.cc:648] HybridClock initialized: now 1786306294566729 us; error 40 us; skew 500 ppm
I20260809 20:11:34.567049 22472 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:34 dist-test-slave-6zbq krb5kdc[21835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306294, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:34.569793 22472 init.cc:377] Logged in from keytab as kudu/127.14.181.3@KRBTEST.COM (short username kudu)
I20260809 20:11:34.570840 22472 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:34.570945 22472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:34.571219 22472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:34.573823 22472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-2/data/instance:
uuid: "014caf1cc8204564864e73095aff4adf"
format_stamp: "Formatted at 2026-08-09 20:11:34 on dist-test-slave-6zbq"
server_key: "a7bee33b58c6b0e499bcd3aeeba70a92"
server_key_iv: "5a801f1853303203e59ec78c346ab7c8"
server_key_version: "encryptionkey@0"
I20260809 20:11:34.574602 22472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance:
uuid: "014caf1cc8204564864e73095aff4adf"
format_stamp: "Formatted at 2026-08-09 20:11:34 on dist-test-slave-6zbq"
server_key: "a7bee33b58c6b0e499bcd3aeeba70a92"
server_key_iv: "5a801f1853303203e59ec78c346ab7c8"
server_key_version: "encryptionkey@0"
I20260809 20:11:34.579074 22472 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 20:11:34.582136 22492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:34.583323 22472 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 20:11:34.583464 22472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "014caf1cc8204564864e73095aff4adf"
format_stamp: "Formatted at 2026-08-09 20:11:34 on dist-test-slave-6zbq"
server_key: "a7bee33b58c6b0e499bcd3aeeba70a92"
server_key_iv: "5a801f1853303203e59ec78c346ab7c8"
server_key_version: "encryptionkey@0"
I20260809 20:11:34.583652 22472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:34.605593 22472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:34.610154 22472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:34.610435 22472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:34.611320 22472 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:11:34.612535 22472 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:34.612632 22472 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:34.612737 22472 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:34.612807 22472 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:34.642217 22472 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:40411
I20260809 20:11:34.642275 22674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:40411 every 8 connection(s)
I20260809 20:11:34.642982 22472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:11:34.645041 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 22472
I20260809 20:11:34.645222 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance
I20260809 20:11:34.645676 15060 external_mini_cluster.cc:1428] Setting key 8d94c91172ec9aceb396f984c18d20b8
Aug 09 20:11:34 dist-test-slave-6zbq krb5kdc[21835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306294, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:34.661041 22225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:34.645180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:57235 (local address 127.14.181.62:42415)
0809 20:11:34.645381 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:34.645387 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:34.646568 (+ 1181us) server_negotiation.cc:407] Connection header received
0809 20:11:34.648521 (+ 1953us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:34.648525 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:34.648591 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:34.648666 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:34.649997 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.650749 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.652231 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.652605 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.652709 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:34.655775 (+ 3066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:34.655780 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:34.655783 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:34.655816 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:34.658181 (+ 2365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:34.658855 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:34.658860 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:34.658862 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:34.658996 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:34.659486 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:34.659491 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:34.659493 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:34.659805 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:34.659968 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:34.660664 (+ 696us) server_negotiation.cc:299] Negotiation successful
0809 20:11:34.660816 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 20:11:34.661900 22678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:34.645636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:42415 (local address 127.14.181.3:57235)
0809 20:11:34.646415 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:34.646466 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:34.648267 (+ 1801us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:34.648859 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:34.648866 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:34.649330 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:34.649867 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:34.649884 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.650898 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.650903 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:34.652082 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:34.652095 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.652815 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.652823 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:34.653029 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:34.653597 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:34.653618 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:34.655578 (+ 1960us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:34.658311 (+ 2733us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:34.658320 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:34.658333 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:34.658745 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:34.659135 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:34.659139 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:34.659142 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:34.659358 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:34.659953 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:34.659960 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:34.660288 (+ 328us) client_negotiation.cc:769] Sending connection context
0809 20:11:34.660562 (+ 274us) client_negotiation.cc:240] Negotiation successful
0809 20:11:34.660921 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":321,"threads_started":1}
I20260809 20:11:34.663048 22675 heartbeater.cc:347] Connected to a master server at 127.14.181.62:42415
I20260809 20:11:34.663302 22675 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:34.663862 22675 heartbeater.cc:511] Master 127.14.181.62:42415 requested a full tablet report, sending...
I20260809 20:11:34.665046 21907 ts_manager.cc:194] Registered new tserver with Master: 014caf1cc8204564864e73095aff4adf (127.14.181.3:40411)
I20260809 20:11:34.665795 21907 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.3@KRBTEST.COM'} at 127.14.181.3:57235
I20260809 20:11:34.672207 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 20:11:34.687716 22225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:34.676402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44592 (local address 127.14.181.62:42415)
0809 20:11:34.676591 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:34.676597 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:34.677005 (+ 408us) server_negotiation.cc:407] Connection header received
0809 20:11:34.677165 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:34.677169 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:34.677224 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:34.677299 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:34.678693 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.679434 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.680581 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.681003 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.681099 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:34.683067 (+ 1968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:34.683072 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:34.683075 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:34.683103 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:34.685382 (+ 2279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:34.685963 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:34.685967 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:34.685969 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:34.686106 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:34.686523 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:34.686527 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:34.686529 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:34.686820 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:34.686987 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:34.687251 (+ 264us) server_negotiation.cc:299] Negotiation successful
0809 20:11:34.687419 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 20:11:34.691191 21907 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44592:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 20:11:34.697659 21907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 20:11:34.720563 22709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:34.710880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50954 (local address 127.14.181.1:42483)
0809 20:11:34.712469 (+ 1589us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:34.712475 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:34.712497 (+ 22us) server_negotiation.cc:407] Connection header received
0809 20:11:34.712575 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:34.712580 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:34.712740 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:34.712941 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:34.713801 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.715289 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.718155 (+ 2866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.719314 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.719434 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:34.719627 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:34.720102 (+ 475us) server_negotiation.cc:299] Negotiation successful
0809 20:11:34.720273 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1447,"thread_start_us":1343,"threads_started":1}
I20260809 20:11:34.720549 22708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:34.710291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:42483 (local address 127.0.0.1:50954)
0809 20:11:34.711554 (+ 1263us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:34.711572 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:34.711677 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:34.713163 (+ 1486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:34.713167 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:34.713194 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:34.713601 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:34.713610 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.715412 (+ 1802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.715418 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:34.718002 (+ 2584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:34.718017 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.719484 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.719490 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:34.719674 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:34.719725 (+ 51us) client_negotiation.cc:769] Sending connection context
0809 20:11:34.719878 (+ 153us) client_negotiation.cc:240] Negotiation successful
0809 20:11:34.720052 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1134,"mutex_wait_us":31,"thread_start_us":988,"threads_started":1}
I20260809 20:11:34.721441 22707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:34.709508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39512 (local address 127.14.181.3:40411)
0809 20:11:34.712242 (+ 2734us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:34.712251 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:34.712286 (+ 35us) server_negotiation.cc:407] Connection header received
0809 20:11:34.712382 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:34.712390 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:34.712627 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:34.712816 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:34.714100 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.715715 (+ 1615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.718234 (+ 2519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.719609 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.719759 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:34.719980 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:34.720540 (+ 560us) server_negotiation.cc:299] Negotiation successful
0809 20:11:34.721032 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2544,"thread_start_us":2391,"threads_started":1}
I20260809 20:11:34.721639 22706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:34.709455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32798 (local address 127.14.181.2:42577)
0809 20:11:34.713555 (+ 4100us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:34.713563 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:34.713589 (+ 26us) server_negotiation.cc:407] Connection header received
0809 20:11:34.713680 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:34.713688 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:34.713902 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:34.714100 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:34.714858 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.716153 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.718537 (+ 2384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.719870 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.720928 (+ 1058us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:34.721117 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:34.721183 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 20:11:34.721325 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3940,"thread_start_us":4167,"threads_started":1}
I20260809 20:11:34.721844 22703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:34.708908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:42577 (local address 127.0.0.1:32798)
0809 20:11:34.709641 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:34.709676 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:34.709841 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:34.714116 (+ 4275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:34.714121 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:34.714279 (+ 158us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:34.714670 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:34.714683 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.716282 (+ 1599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.716287 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:34.718381 (+ 2094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:34.718396 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.720116 (+ 1720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.720124 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:34.720298 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:34.720331 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 20:11:34.720404 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 20:11:34.720520 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"mutex_wait_us":85,"thread_start_us":714,"threads_started":1}
I20260809 20:11:34.724567 22107 tablet_service.cc:1467] Processing CreateTablet for tablet 3ea8bc4fc329481e8947126a49ee5c81 (DEFAULT_TABLE table=test-table [id=bf30cf9e2a754724b90221e2948cbd7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:34.721311 22704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:34.709079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:40411 (local address 127.0.0.1:39512)
0809 20:11:34.710466 (+ 1387us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:34.710482 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:34.710588 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:34.712845 (+ 2257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:34.712852 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:34.712883 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:34.713261 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:34.713274 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.715867 (+ 2593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.715873 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:34.718078 (+ 2205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:34.718089 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.719815 (+ 1726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.719821 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:34.719970 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:34.720001 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 20:11:34.720082 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 20:11:34.720226 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1209,"mutex_wait_us":60,"thread_start_us":1833,"threads_started":1}
I20260809 20:11:34.725862 22107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ea8bc4fc329481e8947126a49ee5c81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:34.728400 22358 tablet_service.cc:1467] Processing CreateTablet for tablet 3ea8bc4fc329481e8947126a49ee5c81 (DEFAULT_TABLE table=test-table [id=bf30cf9e2a754724b90221e2948cbd7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:34.728396 22565 tablet_service.cc:1467] Processing CreateTablet for tablet 3ea8bc4fc329481e8947126a49ee5c81 (DEFAULT_TABLE table=test-table [id=bf30cf9e2a754724b90221e2948cbd7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:34.729643 22358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ea8bc4fc329481e8947126a49ee5c81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:34.729643 22565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ea8bc4fc329481e8947126a49ee5c81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:34.742213 22710 tablet_bootstrap.cc:492] T 3ea8bc4fc329481e8947126a49ee5c81 P fefb03ddf10b42a2938c31f2326ef05c: Bootstrap starting.
I20260809 20:11:34.744620 22712 tablet_bootstrap.cc:492] T 3ea8bc4fc329481e8947126a49ee5c81 P d51307d345264d559d1ebe5d90b1bd10: Bootstrap starting.
I20260809 20:11:34.745887 22710 tablet_bootstrap.cc:654] T 3ea8bc4fc329481e8947126a49ee5c81 P fefb03ddf10b42a2938c31f2326ef05c: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:34.745970 22711 tablet_bootstrap.cc:492] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf: Bootstrap starting.
I20260809 20:11:34.747181 22710 log.cc:824] T 3ea8bc4fc329481e8947126a49ee5c81 P fefb03ddf10b42a2938c31f2326ef05c: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:34.748040 22712 tablet_bootstrap.cc:654] T 3ea8bc4fc329481e8947126a49ee5c81 P d51307d345264d559d1ebe5d90b1bd10: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:34.748931 22711 tablet_bootstrap.cc:654] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:34.749101 22712 log.cc:824] T 3ea8bc4fc329481e8947126a49ee5c81 P d51307d345264d559d1ebe5d90b1bd10: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:34.749915 22711 log.cc:824] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:34.750227 22710 tablet_bootstrap.cc:492] T 3ea8bc4fc329481e8947126a49ee5c81 P fefb03ddf10b42a2938c31f2326ef05c: No bootstrap required, opened a new log
I20260809 20:11:34.750548 22710 ts_tablet_manager.cc:1397] T 3ea8bc4fc329481e8947126a49ee5c81 P fefb03ddf10b42a2938c31f2326ef05c: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.005s
I20260809 20:11:34.752308 22712 tablet_bootstrap.cc:492] T 3ea8bc4fc329481e8947126a49ee5c81 P d51307d345264d559d1ebe5d90b1bd10: No bootstrap required, opened a new log
I20260809 20:11:34.752550 22712 ts_tablet_manager.cc:1397] T 3ea8bc4fc329481e8947126a49ee5c81 P d51307d345264d559d1ebe5d90b1bd10: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260809 20:11:34.752763 22711 tablet_bootstrap.cc:492] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf: No bootstrap required, opened a new log
I20260809 20:11:34.752974 22711 ts_tablet_manager.cc:1397] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260809 20:11:34.759966 22711 raft_consensus.cc:348] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51307d345264d559d1ebe5d90b1bd10" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42577 } } peers { permanent_uuid: "014caf1cc8204564864e73095aff4adf" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40411 } } peers { permanent_uuid: "fefb03ddf10b42a2938c31f2326ef05c" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 42483 } }
I20260809 20:11:34.760304 22711 raft_consensus.cc:374] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:34.760439 22711 raft_consensus.cc:729] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 014caf1cc8204564864e73095aff4adf, State: Initialized, Role: FOLLOWER
I20260809 20:11:34.760742 22710 raft_consensus.cc:348] T 3ea8bc4fc329481e8947126a49ee5c81 P fefb03ddf10b42a2938c31f2326ef05c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51307d345264d559d1ebe5d90b1bd10" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42577 } } peers { permanent_uuid: "014caf1cc8204564864e73095aff4adf" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40411 } } peers { permanent_uuid: "fefb03ddf10b42a2938c31f2326ef05c" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 42483 } }
I20260809 20:11:34.761204 22710 raft_consensus.cc:374] T 3ea8bc4fc329481e8947126a49ee5c81 P fefb03ddf10b42a2938c31f2326ef05c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:34.761034 22711 consensus_queue.cc:260] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51307d345264d559d1ebe5d90b1bd10" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42577 } } peers { permanent_uuid: "014caf1cc8204564864e73095aff4adf" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40411 } } peers { permanent_uuid: "fefb03ddf10b42a2938c31f2326ef05c" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 42483 } }
I20260809 20:11:34.761318 22710 raft_consensus.cc:729] T 3ea8bc4fc329481e8947126a49ee5c81 P fefb03ddf10b42a2938c31f2326ef05c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fefb03ddf10b42a2938c31f2326ef05c, State: Initialized, Role: FOLLOWER
I20260809 20:11:34.761898 22710 consensus_queue.cc:260] T 3ea8bc4fc329481e8947126a49ee5c81 P fefb03ddf10b42a2938c31f2326ef05c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51307d345264d559d1ebe5d90b1bd10" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42577 } } peers { permanent_uuid: "014caf1cc8204564864e73095aff4adf" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40411 } } peers { permanent_uuid: "fefb03ddf10b42a2938c31f2326ef05c" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 42483 } }
I20260809 20:11:34.762302 22221 heartbeater.cc:503] Master 127.14.181.62:42415 was elected leader, sending a full tablet report...
I20260809 20:11:34.763023 22711 ts_tablet_manager.cc:1428] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf: Time spent starting tablet: real 0.010s user 0.007s sys 0.004s
I20260809 20:11:34.762938 22712 raft_consensus.cc:348] T 3ea8bc4fc329481e8947126a49ee5c81 P d51307d345264d559d1ebe5d90b1bd10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51307d345264d559d1ebe5d90b1bd10" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42577 } } peers { permanent_uuid: "014caf1cc8204564864e73095aff4adf" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40411 } } peers { permanent_uuid: "fefb03ddf10b42a2938c31f2326ef05c" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 42483 } }
I20260809 20:11:34.763362 22712 raft_consensus.cc:374] T 3ea8bc4fc329481e8947126a49ee5c81 P d51307d345264d559d1ebe5d90b1bd10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:34.763450 22712 raft_consensus.cc:729] T 3ea8bc4fc329481e8947126a49ee5c81 P d51307d345264d559d1ebe5d90b1bd10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d51307d345264d559d1ebe5d90b1bd10, State: Initialized, Role: FOLLOWER
I20260809 20:11:34.764065 22675 heartbeater.cc:503] Master 127.14.181.62:42415 was elected leader, sending a full tablet report...
I20260809 20:11:34.766060 22710 ts_tablet_manager.cc:1428] T 3ea8bc4fc329481e8947126a49ee5c81 P fefb03ddf10b42a2938c31f2326ef05c: Time spent starting tablet: real 0.015s user 0.007s sys 0.007s
I20260809 20:11:34.765450 22712 consensus_queue.cc:260] T 3ea8bc4fc329481e8947126a49ee5c81 P d51307d345264d559d1ebe5d90b1bd10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51307d345264d559d1ebe5d90b1bd10" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42577 } } peers { permanent_uuid: "014caf1cc8204564864e73095aff4adf" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40411 } } peers { permanent_uuid: "fefb03ddf10b42a2938c31f2326ef05c" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 42483 } }
I20260809 20:11:34.767272 22462 heartbeater.cc:503] Master 127.14.181.62:42415 was elected leader, sending a full tablet report...
I20260809 20:11:34.767794 22712 ts_tablet_manager.cc:1428] T 3ea8bc4fc329481e8947126a49ee5c81 P d51307d345264d559d1ebe5d90b1bd10: Time spent starting tablet: real 0.015s user 0.011s sys 0.002s
I20260809 20:11:34.826574 22719 raft_consensus.cc:482] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:11:34.826885 22719 raft_consensus.cc:504] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51307d345264d559d1ebe5d90b1bd10" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42577 } } peers { permanent_uuid: "014caf1cc8204564864e73095aff4adf" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40411 } } peers { permanent_uuid: "fefb03ddf10b42a2938c31f2326ef05c" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 42483 } }
I20260809 20:11:34.828485 22719 leader_election.cc:288] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d51307d345264d559d1ebe5d90b1bd10 (127.14.181.2:42577), fefb03ddf10b42a2938c31f2326ef05c (127.14.181.1:42483)
I20260809 20:11:34.834627 22678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:34.828881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:42577 (local address 127.14.181.3:41691)
0809 20:11:34.829234 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:34.829253 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:34.829401 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:34.829776 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:34.829781 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:34.829815 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:34.829979 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:34.829988 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.831013 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.831017 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:34.832439 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:34.832454 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.833942 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.833946 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:34.834115 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:34.834152 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 20:11:34.834231 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 20:11:34.834365 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"mutex_wait_us":52}
I20260809 20:11:34.834688 22706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:34.828851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:41691 (local address 127.14.181.2:42577)
0809 20:11:34.829047 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:34.829054 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:34.829345 (+ 291us) server_negotiation.cc:407] Connection header received
0809 20:11:34.829541 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:34.829547 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:34.829630 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:34.829733 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:34.830122 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.830885 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.832640 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.833798 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.833956 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:34.834025 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:34.834277 (+ 252us) server_negotiation.cc:299] Negotiation successful
0809 20:11:34.834426 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 20:11:34.835604 22709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:34.828976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:53953 (local address 127.14.181.1:42483)
0809 20:11:34.829163 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:34.829167 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:34.830052 (+ 885us) server_negotiation.cc:407] Connection header received
0809 20:11:34.830207 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:34.830213 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:34.830271 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:34.830367 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:34.830863 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.831533 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.833502 (+ 1969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.834698 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.834842 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:34.834910 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:34.835245 (+ 335us) server_negotiation.cc:299] Negotiation successful
0809 20:11:34.835370 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 20:11:34.835695 22726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:34.829210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:42483 (local address 127.14.181.3:53953)
0809 20:11:34.829951 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:34.829966 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:34.830081 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:34.830395 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:34.830399 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:34.830421 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:34.830723 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:34.830732 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.831674 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.831679 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:34.833357 (+ 1678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:34.833374 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.834977 (+ 1603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.834983 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:34.835104 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:34.835125 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 20:11:34.835203 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 20:11:34.835318 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"mutex_wait_us":3,"thread_start_us":396,"threads_started":1}
I20260809 20:11:34.835601 22385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ea8bc4fc329481e8947126a49ee5c81" candidate_uuid: "014caf1cc8204564864e73095aff4adf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51307d345264d559d1ebe5d90b1bd10" is_pre_election: true
I20260809 20:11:34.836148 22385 raft_consensus.cc:2454] T 3ea8bc4fc329481e8947126a49ee5c81 P d51307d345264d559d1ebe5d90b1bd10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 014caf1cc8204564864e73095aff4adf in term 0.
I20260809 20:11:34.836570 22148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ea8bc4fc329481e8947126a49ee5c81" candidate_uuid: "014caf1cc8204564864e73095aff4adf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fefb03ddf10b42a2938c31f2326ef05c" is_pre_election: true
I20260809 20:11:34.836784 22493 leader_election.cc:302] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 014caf1cc8204564864e73095aff4adf, d51307d345264d559d1ebe5d90b1bd10; no voters:
I20260809 20:11:34.837007 22148 raft_consensus.cc:2454] T 3ea8bc4fc329481e8947126a49ee5c81 P fefb03ddf10b42a2938c31f2326ef05c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 014caf1cc8204564864e73095aff4adf in term 0.
I20260809 20:11:34.837149 22719 raft_consensus.cc:2781] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:11:34.837292 22719 raft_consensus.cc:482] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:11:34.837391 22719 raft_consensus.cc:3037] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:34.839746 22719 raft_consensus.cc:504] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51307d345264d559d1ebe5d90b1bd10" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42577 } } peers { permanent_uuid: "014caf1cc8204564864e73095aff4adf" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40411 } } peers { permanent_uuid: "fefb03ddf10b42a2938c31f2326ef05c" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 42483 } }
I20260809 20:11:34.840304 22719 leader_election.cc:288] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf [CANDIDATE]: Term 1 election: Requested vote from peers d51307d345264d559d1ebe5d90b1bd10 (127.14.181.2:42577), fefb03ddf10b42a2938c31f2326ef05c (127.14.181.1:42483)
I20260809 20:11:34.840689 22385 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ea8bc4fc329481e8947126a49ee5c81" candidate_uuid: "014caf1cc8204564864e73095aff4adf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d51307d345264d559d1ebe5d90b1bd10"
I20260809 20:11:34.840739 22148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ea8bc4fc329481e8947126a49ee5c81" candidate_uuid: "014caf1cc8204564864e73095aff4adf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fefb03ddf10b42a2938c31f2326ef05c"
I20260809 20:11:34.840875 22385 raft_consensus.cc:3037] T 3ea8bc4fc329481e8947126a49ee5c81 P d51307d345264d559d1ebe5d90b1bd10 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:34.840927 22148 raft_consensus.cc:3037] T 3ea8bc4fc329481e8947126a49ee5c81 P fefb03ddf10b42a2938c31f2326ef05c [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:34.843116 22385 raft_consensus.cc:2454] T 3ea8bc4fc329481e8947126a49ee5c81 P d51307d345264d559d1ebe5d90b1bd10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 014caf1cc8204564864e73095aff4adf in term 1.
I20260809 20:11:34.843132 22148 raft_consensus.cc:2454] T 3ea8bc4fc329481e8947126a49ee5c81 P fefb03ddf10b42a2938c31f2326ef05c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 014caf1cc8204564864e73095aff4adf in term 1.
I20260809 20:11:34.843484 22494 leader_election.cc:302] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 014caf1cc8204564864e73095aff4adf, fefb03ddf10b42a2938c31f2326ef05c; no voters:
I20260809 20:11:34.843775 22719 raft_consensus.cc:2781] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:34.844178 22719 raft_consensus.cc:686] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf [term 1 LEADER]: Becoming Leader. State: Replica: 014caf1cc8204564864e73095aff4adf, State: Running, Role: LEADER
I20260809 20:11:34.844625 22719 consensus_queue.cc:237] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51307d345264d559d1ebe5d90b1bd10" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42577 } } peers { permanent_uuid: "014caf1cc8204564864e73095aff4adf" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40411 } } peers { permanent_uuid: "fefb03ddf10b42a2938c31f2326ef05c" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 42483 } }
I20260809 20:11:34.848436 21905 catalog_manager.cc:5495] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf reported cstate change: term changed from 0 to 1, leader changed from <none> to 014caf1cc8204564864e73095aff4adf (127.14.181.3). New cstate: current_term: 1 leader_uuid: "014caf1cc8204564864e73095aff4adf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d51307d345264d559d1ebe5d90b1bd10" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42577 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "014caf1cc8204564864e73095aff4adf" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 40411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fefb03ddf10b42a2938c31f2326ef05c" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 42483 } health_report { overall_health: UNKNOWN } } }
I20260809 20:11:34.873764 22707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:34.868942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39516 (local address 127.14.181.3:40411)
0809 20:11:34.869127 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:34.869140 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:34.869157 (+ 17us) server_negotiation.cc:407] Connection header received
0809 20:11:34.869255 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:34.869260 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:34.869332 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:34.869441 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:11:34.869719 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.870466 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.871764 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.872170 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.872269 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:34.872717 (+ 448us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:11:34.873241 (+ 524us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:11:34.873351 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:34.873443 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 20:11:34.873508 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 20:11:34.881346 22385 raft_consensus.cc:1261] T 3ea8bc4fc329481e8947126a49ee5c81 P d51307d345264d559d1ebe5d90b1bd10 [term 1 FOLLOWER]: Refusing update from remote peer 014caf1cc8204564864e73095aff4adf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:11:34.881348 22148 raft_consensus.cc:1261] T 3ea8bc4fc329481e8947126a49ee5c81 P fefb03ddf10b42a2938c31f2326ef05c [term 1 FOLLOWER]: Refusing update from remote peer 014caf1cc8204564864e73095aff4adf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:11:34.882252 22727 consensus_queue.cc:1035] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d51307d345264d559d1ebe5d90b1bd10" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:11:34.882606 22719 consensus_queue.cc:1035] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fefb03ddf10b42a2938c31f2326ef05c" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 42483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:11:34.891865 22732 mvcc.cc:205] Tried to move back new op lower bound from 7316710583824773120 to 7316710583687004160. Current Snapshot: MvccSnapshot[applied={T|T < 7316710583824773120}]
I20260809 20:11:34.894330 22734 mvcc.cc:205] Tried to move back new op lower bound from 7316710583824773120 to 7316710583687004160. Current Snapshot: MvccSnapshot[applied={T|T < 7316710583824773120}]
I20260809 20:11:34.907689 21907 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44592:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:11:34.907930 21907 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44592:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:11:34.911334 21907 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c9e3aa46868e4b0f854ff54ee5be123e: Sending DeleteTablet for 3 replicas of tablet 3ea8bc4fc329481e8947126a49ee5c81
I20260809 20:11:34.912372 22358 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ea8bc4fc329481e8947126a49ee5c81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:34 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:32798
I20260809 20:11:34.912562 22565 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ea8bc4fc329481e8947126a49ee5c81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:34 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:39512
I20260809 20:11:34.912750 22107 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ea8bc4fc329481e8947126a49ee5c81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:34 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:50954
I20260809 20:11:34.914579 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 22014
I20260809 20:11:34.924906 22743 tablet_replica.cc:330] T 3ea8bc4fc329481e8947126a49ee5c81 P d51307d345264d559d1ebe5d90b1bd10: stopping tablet replica
I20260809 20:11:34.925135 22745 tablet_replica.cc:330] T 3ea8bc4fc329481e8947126a49ee5c81 P fefb03ddf10b42a2938c31f2326ef05c: stopping tablet replica
I20260809 20:11:34.925612 22745 raft_consensus.cc:2229] T 3ea8bc4fc329481e8947126a49ee5c81 P fefb03ddf10b42a2938c31f2326ef05c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:11:34.925652 22744 tablet_replica.cc:330] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf: stopping tablet replica
I20260809 20:11:34.926136 22745 raft_consensus.cc:2258] T 3ea8bc4fc329481e8947126a49ee5c81 P fefb03ddf10b42a2938c31f2326ef05c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:34.926585 22744 raft_consensus.cc:2229] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf [term 1 LEADER]: Raft consensus shutting down.
I20260809 20:11:34.927281 22744 raft_consensus.cc:2258] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:34.926119 22743 raft_consensus.cc:2229] T 3ea8bc4fc329481e8947126a49ee5c81 P d51307d345264d559d1ebe5d90b1bd10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:11:34.927829 22743 raft_consensus.cc:2258] T 3ea8bc4fc329481e8947126a49ee5c81 P d51307d345264d559d1ebe5d90b1bd10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:34.928330 22745 ts_tablet_manager.cc:1905] T 3ea8bc4fc329481e8947126a49ee5c81 P fefb03ddf10b42a2938c31f2326ef05c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:34.930261 22743 ts_tablet_manager.cc:1905] T 3ea8bc4fc329481e8947126a49ee5c81 P d51307d345264d559d1ebe5d90b1bd10: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 20:11:34 dist-test-slave-6zbq krb5kdc[21835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.1@KRBTEST.COM
I20260809 20:11:34.933532 22744 ts_tablet_manager.cc:1905] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:34.935560 22745 ts_tablet_manager.cc:1918] T 3ea8bc4fc329481e8947126a49ee5c81 P fefb03ddf10b42a2938c31f2326ef05c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:11:34.935799 22745 log.cc:1196] T 3ea8bc4fc329481e8947126a49ee5c81 P fefb03ddf10b42a2938c31f2326ef05c: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-0/wal/wals/3ea8bc4fc329481e8947126a49ee5c81
I20260809 20:11:34.936354 22745 ts_tablet_manager.cc:1939] T 3ea8bc4fc329481e8947126a49ee5c81 P fefb03ddf10b42a2938c31f2326ef05c: Deleting consensus metadata
I20260809 20:11:34.938211 22743 ts_tablet_manager.cc:1918] T 3ea8bc4fc329481e8947126a49ee5c81 P d51307d345264d559d1ebe5d90b1bd10: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:11:34.938426 22743 log.cc:1196] T 3ea8bc4fc329481e8947126a49ee5c81 P d51307d345264d559d1ebe5d90b1bd10: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-1/wal/wals/3ea8bc4fc329481e8947126a49ee5c81
I20260809 20:11:34.938367 21877 catalog_manager.cc:4841] TS fefb03ddf10b42a2938c31f2326ef05c (127.14.181.1:42483): tablet 3ea8bc4fc329481e8947126a49ee5c81 (table test-table [id=bf30cf9e2a754724b90221e2948cbd7a]) successfully deleted
I20260809 20:11:34.938988 22743 ts_tablet_manager.cc:1939] T 3ea8bc4fc329481e8947126a49ee5c81 P d51307d345264d559d1ebe5d90b1bd10: Deleting consensus metadata
I20260809 20:11:34.940544 21875 catalog_manager.cc:4841] TS d51307d345264d559d1ebe5d90b1bd10 (127.14.181.2:42577): tablet 3ea8bc4fc329481e8947126a49ee5c81 (table test-table [id=bf30cf9e2a754724b90221e2948cbd7a]) successfully deleted
I20260809 20:11:34.943209 22744 ts_tablet_manager.cc:1918] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:11:34.943439 22744 log.cc:1196] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786306256699363-15060-0/minicluster-data/ts-2/wal/wals/3ea8bc4fc329481e8947126a49ee5c81
I20260809 20:11:34.944049 22744 ts_tablet_manager.cc:1939] T 3ea8bc4fc329481e8947126a49ee5c81 P 014caf1cc8204564864e73095aff4adf: Deleting consensus metadata
I20260809 20:11:34.944077 22709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:34.915964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50970 (local address 127.14.181.1:42483)
0809 20:11:34.916259 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:34.916267 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:34.918236 (+ 1969us) server_negotiation.cc:407] Connection header received
0809 20:11:34.919161 (+ 925us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:34.919168 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:34.919266 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:34.919337 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:34.925011 (+ 5674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.926098 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.927921 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:34.928528 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:34.928619 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:34.937270 (+ 8651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:34.937281 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:34.937296 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:34.937334 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:34.940874 (+ 3540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:34.941690 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:34.941698 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:34.941702 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:34.941846 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:34.942263 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:34.942268 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:34.942271 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:34.942731 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:34.943020 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:34.943343 (+ 323us) server_negotiation.cc:299] Negotiation successful
0809 20:11:34.943551 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 20:11:34.944770 22215 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:34.945470 21880 catalog_manager.cc:4841] TS 014caf1cc8204564864e73095aff4adf (127.14.181.3:40411): tablet 3ea8bc4fc329481e8947126a49ee5c81 (table test-table [id=bf30cf9e2a754724b90221e2948cbd7a]) successfully deleted
I20260809 20:11:35.031095 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 22014
I20260809 20:11:35.053324 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 22232
Aug 09 20:11:35 dist-test-slave-6zbq krb5kdc[21835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.2@KRBTEST.COM
I20260809 20:11:35.067582 22706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:35.054103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32802 (local address 127.14.181.2:42577)
0809 20:11:35.054278 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:35.054284 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:35.054305 (+ 21us) server_negotiation.cc:407] Connection header received
0809 20:11:35.054532 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:35.054537 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:35.054604 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:35.054700 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:35.055880 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:35.056615 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:35.057833 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:35.058212 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:35.058321 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:35.062377 (+ 4056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:35.062395 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:35.062410 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:35.062446 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:35.065045 (+ 2599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:35.065654 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:35.065661 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:35.065663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:35.065792 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:35.066124 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:35.066129 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:35.066132 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:35.066522 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:35.066798 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:35.067084 (+ 286us) server_negotiation.cc:299] Negotiation successful
0809 20:11:35.067289 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 20:11:35.068410 22452 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:35.154271 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 22232
I20260809 20:11:35.177093 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 22472
Aug 09 20:11:35 dist-test-slave-6zbq krb5kdc[21835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.3@KRBTEST.COM
I20260809 20:11:35.197170 22707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:35.177900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39526 (local address 127.14.181.3:40411)
0809 20:11:35.178072 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:35.178076 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:35.178119 (+ 43us) server_negotiation.cc:407] Connection header received
0809 20:11:35.178358 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:35.178364 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:35.178435 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:35.178526 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:35.180269 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:35.181514 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:35.183541 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:35.184231 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:35.184377 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:35.190069 (+ 5692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:35.190085 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:35.190105 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:35.190158 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:35.194049 (+ 3891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:35.194835 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:35.194845 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:35.194849 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:35.195050 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:35.195484 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:35.195490 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:35.195493 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:35.195990 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:35.196304 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:35.196527 (+ 223us) server_negotiation.cc:299] Negotiation successful
0809 20:11:35.196762 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 20:11:35.197949 22669 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:35.316110 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 22472
I20260809 20:11:35.340734 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 21856
I20260809 20:11:35.341786 21958 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:35.445443 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 21856
2026-08-09T20:11:35Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4030 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-09T20:11:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:11:35Z Disabled control of system clock
I20260809 20:11:35.515210 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:32941
--webserver_interface=127.14.181.62
--webserver_port=0
--builtin_ntp_servers=127.14.181.20:34463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:32941
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 20:11:35.818742 22758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:35.818984 22758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:35.819072 22758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:35.825856 22758 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:11:35.825951 22758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:35.825986 22758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:35.826040 22758 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:11:35.826081 22758 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:11:35.834753 22758 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:34463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:32941
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:32941
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:35.835804 22758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:35.837419 22758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:35.848264 22764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:35.848297 22767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:35.848188 22771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:35.849102 22758 server_base.cc:1034] running on GCE node
I20260809 20:11:35.849782 22758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:35.851104 22758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:35.852299 22758 hybrid_clock.cc:648] HybridClock initialized: now 1786306295852251 us; error 39 us; skew 500 ppm
I20260809 20:11:35.852588 22758 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 20:11:35.854581 22758 webserver.cc:460] Webserver started at http://127.14.181.62:37335/ using document root <none> and password file <none>
I20260809 20:11:35.855178 22758 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:35.855273 22758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:35.855527 22758 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:35.858129 22758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "2cf26c21d1bb46499d785af9fea72be3"
format_stamp: "Formatted at 2026-08-09 20:11:35 on dist-test-slave-6zbq"
server_key: "250a580d635771136dc90aca7e01d64a"
server_key_iv: "49e2d721f669b514fc7b62b9bbbc8ff9"
server_key_version: "encryptionkey@0"
I20260809 20:11:35.859015 22758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "2cf26c21d1bb46499d785af9fea72be3"
format_stamp: "Formatted at 2026-08-09 20:11:35 on dist-test-slave-6zbq"
server_key: "250a580d635771136dc90aca7e01d64a"
server_key_iv: "49e2d721f669b514fc7b62b9bbbc8ff9"
server_key_version: "encryptionkey@0"
I20260809 20:11:35.863540 22758 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260809 20:11:35.866528 22783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:35.867667 22758 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 20:11:35.867801 22758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "2cf26c21d1bb46499d785af9fea72be3"
format_stamp: "Formatted at 2026-08-09 20:11:35 on dist-test-slave-6zbq"
server_key: "250a580d635771136dc90aca7e01d64a"
server_key_iv: "49e2d721f669b514fc7b62b9bbbc8ff9"
server_key_version: "encryptionkey@0"
I20260809 20:11:35.867987 22758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:35.873240 22758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:35.873894 22758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:35.874153 22758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:35.892253 22758 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:32941
I20260809 20:11:35.892289 22862 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:32941 every 8 connection(s)
I20260809 20:11:35.893357 22758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:11:35.896657 22863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:35.899652 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 22758
I20260809 20:11:35.899820 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:11:35.900434 15060 external_mini_cluster.cc:1428] Setting key 0f207227497d5b3947e320e0542bfc60
I20260809 20:11:35.908653 22867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:35.902281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38646 (local address 127.14.181.62:32941)
0809 20:11:35.903300 (+ 1019us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:35.903314 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:35.903362 (+ 48us) server_negotiation.cc:407] Connection header received
0809 20:11:35.904941 (+ 1579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:35.904967 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:35.905477 (+ 510us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:35.905880 (+ 403us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:35.906865 (+ 985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:35.906873 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:35.906889 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:11:35.906906 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:35.906983 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:11:35.907004 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:35.907232 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:35.907371 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 20:11:35.907603 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":564,"thread_start_us":318,"threads_started":1}
I20260809 20:11:35.909313 22863 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cf26c21d1bb46499d785af9fea72be3: Bootstrap starting.
I20260809 20:11:35.912041 22863 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2cf26c21d1bb46499d785af9fea72be3: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:35.912958 22863 log.cc:824] T 00000000000000000000000000000000 P 2cf26c21d1bb46499d785af9fea72be3: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:35.915292 22863 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2cf26c21d1bb46499d785af9fea72be3: No bootstrap required, opened a new log
I20260809 20:11:35.921814 22863 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2cf26c21d1bb46499d785af9fea72be3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cf26c21d1bb46499d785af9fea72be3" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 32941 } }
I20260809 20:11:35.922122 22863 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2cf26c21d1bb46499d785af9fea72be3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:35.922204 22863 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2cf26c21d1bb46499d785af9fea72be3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cf26c21d1bb46499d785af9fea72be3, State: Initialized, Role: FOLLOWER
I20260809 20:11:35.922708 22863 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2cf26c21d1bb46499d785af9fea72be3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cf26c21d1bb46499d785af9fea72be3" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 32941 } }
I20260809 20:11:35.922923 22863 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2cf26c21d1bb46499d785af9fea72be3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:11:35.923040 22863 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2cf26c21d1bb46499d785af9fea72be3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:11:35.923177 22863 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2cf26c21d1bb46499d785af9fea72be3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:35.925148 22863 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2cf26c21d1bb46499d785af9fea72be3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cf26c21d1bb46499d785af9fea72be3" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 32941 } }
I20260809 20:11:35.925573 22863 leader_election.cc:302] T 00000000000000000000000000000000 P 2cf26c21d1bb46499d785af9fea72be3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2cf26c21d1bb46499d785af9fea72be3; no voters:
I20260809 20:11:35.926163 22863 leader_election.cc:288] T 00000000000000000000000000000000 P 2cf26c21d1bb46499d785af9fea72be3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:11:35.926290 22869 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2cf26c21d1bb46499d785af9fea72be3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:35.926941 22869 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2cf26c21d1bb46499d785af9fea72be3 [term 1 LEADER]: Becoming Leader. State: Replica: 2cf26c21d1bb46499d785af9fea72be3, State: Running, Role: LEADER
I20260809 20:11:35.927539 22869 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2cf26c21d1bb46499d785af9fea72be3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cf26c21d1bb46499d785af9fea72be3" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 32941 } }
I20260809 20:11:35.928188 22863 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2cf26c21d1bb46499d785af9fea72be3 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:11:35.930266 22871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cf26c21d1bb46499d785af9fea72be3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2cf26c21d1bb46499d785af9fea72be3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cf26c21d1bb46499d785af9fea72be3" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 32941 } } }
I20260809 20:11:35.930660 22871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cf26c21d1bb46499d785af9fea72be3 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:35.930583 22873 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2cf26c21d1bb46499d785af9fea72be3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2cf26c21d1bb46499d785af9fea72be3. Latest consensus state: current_term: 1 leader_uuid: "2cf26c21d1bb46499d785af9fea72be3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2cf26c21d1bb46499d785af9fea72be3" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 32941 } } }
I20260809 20:11:35.930936 22873 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2cf26c21d1bb46499d785af9fea72be3 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:35.932673 22889 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:11:35.938655 22889 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:11:35.946365 22889 catalog_manager.cc:1347] Generated new cluster ID: 85c09e48202847f4a143bfcf35f6fa19
I20260809 20:11:35.946472 22889 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:11:35.971083 22889 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:11:35.971454 22889 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:11:35.982123 22889 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2cf26c21d1bb46499d785af9fea72be3: Generated new TSK 0
I20260809 20:11:35.982817 22889 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:11:35.990854 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:0
--local_ip_for_outbound_sockets=127.14.181.1
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:32941
--builtin_ntp_servers=127.14.181.20:34463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 20:11:36.357054 22908 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:36.357326 22908 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:36.357414 22908 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:36.364449 22908 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:36.364537 22908 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:36.364650 22908 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:11:36.373447 22908 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:34463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:32941
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:36.374637 22908 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:36.376329 22908 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:36.388477 22913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:36.388417 22915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:36.388456 22917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:36.389276 22908 server_base.cc:1034] running on GCE node
I20260809 20:11:36.389860 22908 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:36.390746 22908 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:36.391947 22908 hybrid_clock.cc:648] HybridClock initialized: now 1786306296391897 us; error 43 us; skew 500 ppm
I20260809 20:11:36.392235 22908 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 20:11:36.394265 22908 webserver.cc:460] Webserver started at http://127.14.181.1:45341/ using document root <none> and password file <none>
I20260809 20:11:36.394930 22908 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:36.395035 22908 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:36.395336 22908 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:36.398002 22908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-0/data/instance:
uuid: "395e20c62dbf4da7a94d587ce9467602"
format_stamp: "Formatted at 2026-08-09 20:11:36 on dist-test-slave-6zbq"
server_key: "afe7307130bc810881fd1a09f3c72e8b"
server_key_iv: "e9eda2a9f9ff3ace2551e70f53b79301"
server_key_version: "encryptionkey@0"
I20260809 20:11:36.398790 22908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance:
uuid: "395e20c62dbf4da7a94d587ce9467602"
format_stamp: "Formatted at 2026-08-09 20:11:36 on dist-test-slave-6zbq"
server_key: "afe7307130bc810881fd1a09f3c72e8b"
server_key_iv: "e9eda2a9f9ff3ace2551e70f53b79301"
server_key_version: "encryptionkey@0"
I20260809 20:11:36.403860 22908 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 20:11:36.407028 22926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:36.408319 22908 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 20:11:36.408463 22908 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "395e20c62dbf4da7a94d587ce9467602"
format_stamp: "Formatted at 2026-08-09 20:11:36 on dist-test-slave-6zbq"
server_key: "afe7307130bc810881fd1a09f3c72e8b"
server_key_iv: "e9eda2a9f9ff3ace2551e70f53b79301"
server_key_version: "encryptionkey@0"
I20260809 20:11:36.408651 22908 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:36.413838 22908 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:36.414629 22908 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:36.414870 22908 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:36.415709 22908 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:11:36.416971 22908 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:36.417065 22908 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:36.417168 22908 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:36.417236 22908 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:36.446808 22908 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:36597
I20260809 20:11:36.446863 23117 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:36597 every 8 connection(s)
I20260809 20:11:36.448056 22908 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:11:36.453876 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 22908
I20260809 20:11:36.454058 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance
I20260809 20:11:36.454905 15060 external_mini_cluster.cc:1428] Setting key 85cd1a5b1a96ab22abd73023d9ed04a1
I20260809 20:11:36.456113 23123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:36.450464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:38713 (local address 127.14.181.62:32941)
0809 20:11:36.450847 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:36.450851 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:36.451944 (+ 1093us) server_negotiation.cc:407] Connection header received
0809 20:11:36.453780 (+ 1836us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:36.453785 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:36.453840 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:36.453931 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:36.455396 (+ 1465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:36.455401 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:36.455405 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:11:36.455420 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:36.455464 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:11:36.455475 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:36.455588 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:36.455801 (+ 213us) server_negotiation.cc:299] Negotiation successful
0809 20:11:36.455855 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":190,"threads_started":1}
I20260809 20:11:36.457046 23124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:36.450954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:32941 (local address 127.14.181.1:38713)
0809 20:11:36.451803 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:36.451845 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:36.453468 (+ 1623us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:36.454196 (+ 728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:36.454207 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:36.454326 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:36.455040 (+ 714us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 20:11:36.455044 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:36.455094 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 20:11:36.455229 (+ 135us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:36.455585 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:36.455597 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:36.455604 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 20:11:36.455870 (+ 266us) client_negotiation.cc:240] Negotiation successful
0809 20:11:36.456084 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":257,"threads_started":1}
I20260809 20:11:36.457800 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:0
--local_ip_for_outbound_sockets=127.14.181.2
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:32941
--builtin_ntp_servers=127.14.181.20:34463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260809 20:11:36.458477 23119 heartbeater.cc:347] Connected to a master server at 127.14.181.62:32941
I20260809 20:11:36.458777 23119 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:36.459410 23119 heartbeater.cc:511] Master 127.14.181.62:32941 requested a full tablet report, sending...
I20260809 20:11:36.461577 22806 ts_manager.cc:194] Registered new tserver with Master: 395e20c62dbf4da7a94d587ce9467602 (127.14.181.1:36597)
W20260809 20:11:36.765951 23125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:36.766198 23125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:36.766286 23125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:36.773029 23125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:36.773113 23125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:36.773218 23125 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:11:36.781505 23125 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:34463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:32941
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:36.782524 23125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:36.784057 23125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:36.795683 23136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:36.795722 23137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:36.795758 23144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:36.796854 23125 server_base.cc:1034] running on GCE node
I20260809 20:11:36.797394 23125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:36.798184 23125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:36.799373 23125 hybrid_clock.cc:648] HybridClock initialized: now 1786306296799332 us; error 31 us; skew 500 ppm
I20260809 20:11:36.799654 23125 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 20:11:36.801586 23125 webserver.cc:460] Webserver started at http://127.14.181.2:44321/ using document root <none> and password file <none>
I20260809 20:11:36.802170 23125 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:36.802268 23125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:36.802593 23125 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:36.805193 23125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-1/data/instance:
uuid: "447575d4b47c4646800c297d81944f8c"
format_stamp: "Formatted at 2026-08-09 20:11:36 on dist-test-slave-6zbq"
server_key: "df5b941b5a80f0b353c17b2f472fd4ad"
server_key_iv: "835a06b0d68cae50dd548223fe98f076"
server_key_version: "encryptionkey@0"
I20260809 20:11:36.805970 23125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance:
uuid: "447575d4b47c4646800c297d81944f8c"
format_stamp: "Formatted at 2026-08-09 20:11:36 on dist-test-slave-6zbq"
server_key: "df5b941b5a80f0b353c17b2f472fd4ad"
server_key_iv: "835a06b0d68cae50dd548223fe98f076"
server_key_version: "encryptionkey@0"
I20260809 20:11:36.810690 23125 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 20:11:36.813829 23155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:36.814988 23125 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:11:36.815145 23125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "447575d4b47c4646800c297d81944f8c"
format_stamp: "Formatted at 2026-08-09 20:11:36 on dist-test-slave-6zbq"
server_key: "df5b941b5a80f0b353c17b2f472fd4ad"
server_key_iv: "835a06b0d68cae50dd548223fe98f076"
server_key_version: "encryptionkey@0"
I20260809 20:11:36.815331 23125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:36.820462 23125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:36.821169 23125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:36.821395 23125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:36.822192 23125 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:11:36.823457 23125 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:36.823550 23125 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:36.823652 23125 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:36.823722 23125 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:36.852725 23125 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:45603
I20260809 20:11:36.852787 23341 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:45603 every 8 connection(s)
I20260809 20:11:36.853964 23125 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:11:36.856793 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 23125
I20260809 20:11:36.856933 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance
I20260809 20:11:36.857372 15060 external_mini_cluster.cc:1428] Setting key f571be3170aada9979eb51056d05fe87
I20260809 20:11:36.860152 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:0
--local_ip_for_outbound_sockets=127.14.181.3
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:32941
--builtin_ntp_servers=127.14.181.20:34463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260809 20:11:36.861604 23123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:36.856299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:40487 (local address 127.14.181.62:32941)
0809 20:11:36.856516 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:36.856522 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:36.857955 (+ 1433us) server_negotiation.cc:407] Connection header received
0809 20:11:36.859573 (+ 1618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:36.859579 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:36.859639 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:36.859757 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:36.860896 (+ 1139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:36.860903 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:36.860907 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:11:36.860927 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:36.860968 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:11:36.860982 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:36.861108 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:36.861249 (+ 141us) server_negotiation.cc:299] Negotiation successful
0809 20:11:36.861325 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 20:11:36.862331 23345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:36.856808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:32941 (local address 127.14.181.2:40487)
0809 20:11:36.857794 (+ 986us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:36.857843 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:36.859332 (+ 1489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:36.859911 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:36.859918 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:36.859998 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:36.860615 (+ 617us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 20:11:36.860617 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:36.860654 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 20:11:36.860733 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:36.861066 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:36.861071 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:36.861076 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 20:11:36.861289 (+ 213us) client_negotiation.cc:240] Negotiation successful
0809 20:11:36.861464 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":304,"threads_started":1}
I20260809 20:11:36.863619 23342 heartbeater.cc:347] Connected to a master server at 127.14.181.62:32941
I20260809 20:11:36.863878 23342 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:36.864408 23342 heartbeater.cc:511] Master 127.14.181.62:32941 requested a full tablet report, sending...
I20260809 20:11:36.865676 22806 ts_manager.cc:194] Registered new tserver with Master: 447575d4b47c4646800c297d81944f8c (127.14.181.2:45603)
W20260809 20:11:37.166682 23346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:37.166939 23346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:37.167054 23346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:37.174226 23346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:37.174330 23346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:37.174492 23346 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:11:37.183244 23346 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:34463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:32941
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:37.184563 23346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:37.186251 23346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:37.198518 23353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:37.198557 23358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:37.198482 23354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:37.199090 23346 server_base.cc:1034] running on GCE node
I20260809 20:11:37.199745 23346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:37.200600 23346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:37.201798 23346 hybrid_clock.cc:648] HybridClock initialized: now 1786306297201747 us; error 38 us; skew 500 ppm
I20260809 20:11:37.202095 23346 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 20:11:37.204195 23346 webserver.cc:460] Webserver started at http://127.14.181.3:38053/ using document root <none> and password file <none>
I20260809 20:11:37.204809 23346 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:37.204908 23346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:37.205219 23346 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:37.207953 23346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-2/data/instance:
uuid: "a5b0b3d1682b4cf1ba808ea5a7aea6bf"
format_stamp: "Formatted at 2026-08-09 20:11:37 on dist-test-slave-6zbq"
server_key: "17d4df3523f9a246e97a43da5aa8deb3"
server_key_iv: "9df4630b1ea72194b24431f58c964220"
server_key_version: "encryptionkey@0"
I20260809 20:11:37.208758 23346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance:
uuid: "a5b0b3d1682b4cf1ba808ea5a7aea6bf"
format_stamp: "Formatted at 2026-08-09 20:11:37 on dist-test-slave-6zbq"
server_key: "17d4df3523f9a246e97a43da5aa8deb3"
server_key_iv: "9df4630b1ea72194b24431f58c964220"
server_key_version: "encryptionkey@0"
I20260809 20:11:37.213814 23346 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 20:11:37.216929 23366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:37.218137 23346 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 20:11:37.218276 23346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "a5b0b3d1682b4cf1ba808ea5a7aea6bf"
format_stamp: "Formatted at 2026-08-09 20:11:37 on dist-test-slave-6zbq"
server_key: "17d4df3523f9a246e97a43da5aa8deb3"
server_key_iv: "9df4630b1ea72194b24431f58c964220"
server_key_version: "encryptionkey@0"
I20260809 20:11:37.218523 23346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:37.223658 23346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:37.224368 23346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:37.224601 23346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:37.225419 23346 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:11:37.226759 23346 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:37.226855 23346 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:37.226958 23346 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:37.227025 23346 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:37.255584 23346 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:34143
I20260809 20:11:37.255645 23561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:34143 every 8 connection(s)
I20260809 20:11:37.256767 23346 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:11:37.259125 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 23346
I20260809 20:11:37.259300 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance
I20260809 20:11:37.259848 15060 external_mini_cluster.cc:1428] Setting key 3dfef51f09d3886cc35069f07082f499
I20260809 20:11:37.264667 23123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:37.259069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:57071 (local address 127.14.181.62:32941)
0809 20:11:37.259250 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:37.259256 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:37.260836 (+ 1580us) server_negotiation.cc:407] Connection header received
0809 20:11:37.262924 (+ 2088us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:37.262928 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:37.262989 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:37.263094 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:37.264153 (+ 1059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:37.264157 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:37.264160 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:11:37.264176 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:37.264208 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:11:37.264220 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:37.264302 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:37.264420 (+ 118us) server_negotiation.cc:299] Negotiation successful
0809 20:11:37.264465 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 20:11:37.265480 23569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:37.259718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:32941 (local address 127.14.181.3:57071)
0809 20:11:37.260711 (+ 993us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:37.260747 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:37.262660 (+ 1913us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:37.263261 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:37.263268 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:37.263352 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:37.263896 (+ 544us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 20:11:37.263898 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:37.263932 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 20:11:37.264010 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:37.264283 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:37.264287 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:37.264292 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 20:11:37.264475 (+ 183us) client_negotiation.cc:240] Negotiation successful
0809 20:11:37.264660 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":299,"threads_started":1}
I20260809 20:11:37.266616 23564 heartbeater.cc:347] Connected to a master server at 127.14.181.62:32941
I20260809 20:11:37.266870 23564 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:37.267411 23564 heartbeater.cc:511] Master 127.14.181.62:32941 requested a full tablet report, sending...
I20260809 20:11:37.268595 22806 ts_manager.cc:194] Registered new tserver with Master: a5b0b3d1682b4cf1ba808ea5a7aea6bf (127.14.181.3:34143)
I20260809 20:11:37.274812 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 20:11:37.282461 23123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:37.280036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38648 (local address 127.14.181.62:32941)
0809 20:11:37.280245 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:37.280251 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:37.280695 (+ 444us) server_negotiation.cc:407] Connection header received
0809 20:11:37.280831 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:37.280836 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:37.280906 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:37.281007 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:37.281885 (+ 878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:37.281891 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:37.281896 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:11:37.281915 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:37.281952 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:11:37.281966 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:37.282085 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:37.282137 (+ 52us) server_negotiation.cc:299] Negotiation successful
0809 20:11:37.282190 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 20:11:37.286182 22806 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38648:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 20:11:37.293187 22806 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 20:11:37.309408 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:37.303756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:34143 (local address 127.0.0.1:58876)
0809 20:11:37.305107 (+ 1351us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:37.305163 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:37.305306 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:37.307066 (+ 1760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:37.307075 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:37.307171 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:37.307972 (+ 801us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 20:11:37.307976 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:37.308010 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 20:11:37.308094 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:37.308639 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:37.308652 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:37.308661 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 20:11:37.308849 (+ 188us) client_negotiation.cc:240] Negotiation successful
0809 20:11:37.308936 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1115,"thread_start_us":954,"threads_started":1}
I20260809 20:11:37.310426 23590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:37.303911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58876 (local address 127.14.181.3:34143)
0809 20:11:37.304502 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:37.304510 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:37.305440 (+ 930us) server_negotiation.cc:407] Connection header received
0809 20:11:37.305518 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:37.305527 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:37.305763 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:37.305907 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:37.308288 (+ 2381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:37.308299 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:37.308314 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:11:37.308335 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:37.308405 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:11:37.308427 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:37.308585 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:37.309894 (+ 1309us) server_negotiation.cc:299] Negotiation successful
0809 20:11:37.310007 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":277,"threads_started":1}
I20260809 20:11:37.313555 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:37.304421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:45603 (local address 127.0.0.1:43812)
0809 20:11:37.309620 (+ 5199us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:37.309638 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:37.309717 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:37.312054 (+ 2337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:37.312059 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:37.312095 (+ 36us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:37.312650 (+ 555us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 20:11:37.312653 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:37.312669 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 20:11:37.312711 (+ 42us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:37.313175 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:37.313180 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:37.313185 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 20:11:37.313278 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 20:11:37.313324 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5105,"thread_start_us":6472,"threads_started":1}
I20260809 20:11:37.313745 23593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:37.304813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43812 (local address 127.14.181.2:45603)
0809 20:11:37.311676 (+ 6863us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:37.311682 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:37.311707 (+ 25us) server_negotiation.cc:407] Connection header received
0809 20:11:37.311767 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:37.311772 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:37.311910 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:37.312035 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:37.312995 (+ 960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:37.313000 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:37.313008 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:11:37.313024 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:37.313057 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:11:37.313069 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:37.313234 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:37.313318 (+ 84us) server_negotiation.cc:299] Negotiation successful
0809 20:11:37.313430 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6721,"thread_start_us":6541,"threads_started":1}
I20260809 20:11:37.317329 23595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:37.306006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40542 (local address 127.14.181.1:36597)
0809 20:11:37.314741 (+ 8735us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:37.314749 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:37.314776 (+ 27us) server_negotiation.cc:407] Connection header received
0809 20:11:37.314842 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:37.314848 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:37.315050 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:37.315632 (+ 582us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:37.316638 (+ 1006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:37.316643 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:37.316651 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:11:37.316661 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:37.316695 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:11:37.316710 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:37.316831 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:37.316947 (+ 116us) server_negotiation.cc:299] Negotiation successful
0809 20:11:37.317040 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8581,"thread_start_us":8466,"threads_started":1}
I20260809 20:11:37.317366 23592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:37.305469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:36597 (local address 127.0.0.1:40542)
0809 20:11:37.311185 (+ 5716us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:37.311202 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:37.311295 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:37.315246 (+ 3951us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:37.315251 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:37.315274 (+ 23us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:37.315888 (+ 614us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 20:11:37.315891 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:37.315906 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 20:11:37.315948 (+ 42us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:37.316818 (+ 870us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:37.316823 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:37.316828 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 20:11:37.316960 (+ 132us) client_negotiation.cc:240] Negotiation successful
0809 20:11:37.317009 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5581,"thread_start_us":9242,"threads_started":1}
I20260809 20:11:37.317602 23230 tablet_service.cc:1467] Processing CreateTablet for tablet 713ca0bec51a454dbcb3599e38ad125d (DEFAULT_TABLE table=test-table [id=228217d07d18401288ce785a787145ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:37.318389 23451 tablet_service.cc:1467] Processing CreateTablet for tablet 713ca0bec51a454dbcb3599e38ad125d (DEFAULT_TABLE table=test-table [id=228217d07d18401288ce785a787145ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:37.319139 23230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 713ca0bec51a454dbcb3599e38ad125d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:37.319761 23451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 713ca0bec51a454dbcb3599e38ad125d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:37.323939 23005 tablet_service.cc:1467] Processing CreateTablet for tablet 713ca0bec51a454dbcb3599e38ad125d (DEFAULT_TABLE table=test-table [id=228217d07d18401288ce785a787145ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:37.324908 23005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 713ca0bec51a454dbcb3599e38ad125d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:37.333467 23596 tablet_bootstrap.cc:492] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c: Bootstrap starting.
I20260809 20:11:37.336503 23598 tablet_bootstrap.cc:492] T 713ca0bec51a454dbcb3599e38ad125d P 395e20c62dbf4da7a94d587ce9467602: Bootstrap starting.
I20260809 20:11:37.337592 23596 tablet_bootstrap.cc:654] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:37.338574 23597 tablet_bootstrap.cc:492] T 713ca0bec51a454dbcb3599e38ad125d P a5b0b3d1682b4cf1ba808ea5a7aea6bf: Bootstrap starting.
I20260809 20:11:37.339006 23596 log.cc:824] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:37.340097 23598 tablet_bootstrap.cc:654] T 713ca0bec51a454dbcb3599e38ad125d P 395e20c62dbf4da7a94d587ce9467602: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:37.341173 23598 log.cc:824] T 713ca0bec51a454dbcb3599e38ad125d P 395e20c62dbf4da7a94d587ce9467602: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:37.341847 23597 tablet_bootstrap.cc:654] T 713ca0bec51a454dbcb3599e38ad125d P a5b0b3d1682b4cf1ba808ea5a7aea6bf: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:37.342218 23596 tablet_bootstrap.cc:492] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c: No bootstrap required, opened a new log
I20260809 20:11:37.342556 23596 ts_tablet_manager.cc:1397] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260809 20:11:37.343003 23597 log.cc:824] T 713ca0bec51a454dbcb3599e38ad125d P a5b0b3d1682b4cf1ba808ea5a7aea6bf: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:37.343609 23598 tablet_bootstrap.cc:492] T 713ca0bec51a454dbcb3599e38ad125d P 395e20c62dbf4da7a94d587ce9467602: No bootstrap required, opened a new log
I20260809 20:11:37.343899 23598 ts_tablet_manager.cc:1397] T 713ca0bec51a454dbcb3599e38ad125d P 395e20c62dbf4da7a94d587ce9467602: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.005s
I20260809 20:11:37.345959 23597 tablet_bootstrap.cc:492] T 713ca0bec51a454dbcb3599e38ad125d P a5b0b3d1682b4cf1ba808ea5a7aea6bf: No bootstrap required, opened a new log
I20260809 20:11:37.346202 23597 ts_tablet_manager.cc:1397] T 713ca0bec51a454dbcb3599e38ad125d P a5b0b3d1682b4cf1ba808ea5a7aea6bf: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260809 20:11:37.350869 23598 raft_consensus.cc:348] T 713ca0bec51a454dbcb3599e38ad125d P 395e20c62dbf4da7a94d587ce9467602 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5b0b3d1682b4cf1ba808ea5a7aea6bf" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 34143 } } peers { permanent_uuid: "395e20c62dbf4da7a94d587ce9467602" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 36597 } } peers { permanent_uuid: "447575d4b47c4646800c297d81944f8c" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 45603 } }
I20260809 20:11:37.351224 23598 raft_consensus.cc:374] T 713ca0bec51a454dbcb3599e38ad125d P 395e20c62dbf4da7a94d587ce9467602 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:37.351349 23598 raft_consensus.cc:729] T 713ca0bec51a454dbcb3599e38ad125d P 395e20c62dbf4da7a94d587ce9467602 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 395e20c62dbf4da7a94d587ce9467602, State: Initialized, Role: FOLLOWER
I20260809 20:11:37.351912 23598 consensus_queue.cc:260] T 713ca0bec51a454dbcb3599e38ad125d P 395e20c62dbf4da7a94d587ce9467602 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5b0b3d1682b4cf1ba808ea5a7aea6bf" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 34143 } } peers { permanent_uuid: "395e20c62dbf4da7a94d587ce9467602" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 36597 } } peers { permanent_uuid: "447575d4b47c4646800c297d81944f8c" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 45603 } }
I20260809 20:11:37.352909 23119 heartbeater.cc:503] Master 127.14.181.62:32941 was elected leader, sending a full tablet report...
I20260809 20:11:37.353572 23598 ts_tablet_manager.cc:1428] T 713ca0bec51a454dbcb3599e38ad125d P 395e20c62dbf4da7a94d587ce9467602: Time spent starting tablet: real 0.010s user 0.009s sys 0.000s
I20260809 20:11:37.354362 23596 raft_consensus.cc:348] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5b0b3d1682b4cf1ba808ea5a7aea6bf" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 34143 } } peers { permanent_uuid: "395e20c62dbf4da7a94d587ce9467602" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 36597 } } peers { permanent_uuid: "447575d4b47c4646800c297d81944f8c" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 45603 } }
I20260809 20:11:37.354804 23596 raft_consensus.cc:374] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:37.354943 23596 raft_consensus.cc:729] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 447575d4b47c4646800c297d81944f8c, State: Initialized, Role: FOLLOWER
I20260809 20:11:37.355538 23596 consensus_queue.cc:260] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5b0b3d1682b4cf1ba808ea5a7aea6bf" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 34143 } } peers { permanent_uuid: "395e20c62dbf4da7a94d587ce9467602" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 36597 } } peers { permanent_uuid: "447575d4b47c4646800c297d81944f8c" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 45603 } }
I20260809 20:11:37.356225 23597 raft_consensus.cc:348] T 713ca0bec51a454dbcb3599e38ad125d P a5b0b3d1682b4cf1ba808ea5a7aea6bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5b0b3d1682b4cf1ba808ea5a7aea6bf" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 34143 } } peers { permanent_uuid: "395e20c62dbf4da7a94d587ce9467602" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 36597 } } peers { permanent_uuid: "447575d4b47c4646800c297d81944f8c" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 45603 } }
I20260809 20:11:37.356666 23342 heartbeater.cc:503] Master 127.14.181.62:32941 was elected leader, sending a full tablet report...
I20260809 20:11:37.356680 23597 raft_consensus.cc:374] T 713ca0bec51a454dbcb3599e38ad125d P a5b0b3d1682b4cf1ba808ea5a7aea6bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:37.356781 23597 raft_consensus.cc:729] T 713ca0bec51a454dbcb3599e38ad125d P a5b0b3d1682b4cf1ba808ea5a7aea6bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5b0b3d1682b4cf1ba808ea5a7aea6bf, State: Initialized, Role: FOLLOWER
I20260809 20:11:37.357260 23596 ts_tablet_manager.cc:1428] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c: Time spent starting tablet: real 0.015s user 0.012s sys 0.000s
I20260809 20:11:37.357352 23597 consensus_queue.cc:260] T 713ca0bec51a454dbcb3599e38ad125d P a5b0b3d1682b4cf1ba808ea5a7aea6bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5b0b3d1682b4cf1ba808ea5a7aea6bf" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 34143 } } peers { permanent_uuid: "395e20c62dbf4da7a94d587ce9467602" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 36597 } } peers { permanent_uuid: "447575d4b47c4646800c297d81944f8c" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 45603 } }
I20260809 20:11:37.358664 23564 heartbeater.cc:503] Master 127.14.181.62:32941 was elected leader, sending a full tablet report...
I20260809 20:11:37.359295 23597 ts_tablet_manager.cc:1428] T 713ca0bec51a454dbcb3599e38ad125d P a5b0b3d1682b4cf1ba808ea5a7aea6bf: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
W20260809 20:11:37.450042 23120 tablet.cc:2369] T 713ca0bec51a454dbcb3599e38ad125d P 395e20c62dbf4da7a94d587ce9467602: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:11:37.484041 23603 raft_consensus.cc:482] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:11:37.484333 23603 raft_consensus.cc:504] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5b0b3d1682b4cf1ba808ea5a7aea6bf" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 34143 } } peers { permanent_uuid: "395e20c62dbf4da7a94d587ce9467602" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 36597 } } peers { permanent_uuid: "447575d4b47c4646800c297d81944f8c" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 45603 } }
I20260809 20:11:37.485786 23603 leader_election.cc:288] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5b0b3d1682b4cf1ba808ea5a7aea6bf (127.14.181.3:34143), 395e20c62dbf4da7a94d587ce9467602 (127.14.181.1:36597)
I20260809 20:11:37.488529 23602 raft_consensus.cc:482] T 713ca0bec51a454dbcb3599e38ad125d P 395e20c62dbf4da7a94d587ce9467602 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:11:37.488768 23606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:37.486023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:34143 (local address 127.14.181.2:57339)
0809 20:11:37.486562 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:37.486579 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:37.486694 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:37.487174 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:37.487179 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:37.487206 (+ 27us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:37.487916 (+ 710us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 20:11:37.487919 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:37.487938 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 20:11:37.487990 (+ 52us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:37.488336 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:37.488341 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:37.488347 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 20:11:37.488439 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 20:11:37.488481 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":256,"threads_started":1}
I20260809 20:11:37.488807 23590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:37.486305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:57339 (local address 127.14.181.3:34143)
0809 20:11:37.486516 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:37.486521 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:37.486668 (+ 147us) server_negotiation.cc:407] Connection header received
0809 20:11:37.486814 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:37.486818 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:37.486878 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:37.486979 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:37.488149 (+ 1170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:37.488155 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:37.488160 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:11:37.488180 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:37.488220 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:11:37.488237 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:37.488364 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:37.488486 (+ 122us) server_negotiation.cc:299] Negotiation successful
0809 20:11:37.488551 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 20:11:37.488840 23602 raft_consensus.cc:504] T 713ca0bec51a454dbcb3599e38ad125d P 395e20c62dbf4da7a94d587ce9467602 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5b0b3d1682b4cf1ba808ea5a7aea6bf" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 34143 } } peers { permanent_uuid: "395e20c62dbf4da7a94d587ce9467602" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 36597 } } peers { permanent_uuid: "447575d4b47c4646800c297d81944f8c" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 45603 } }
I20260809 20:11:37.489809 23595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:37.487011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:56303 (local address 127.14.181.1:36597)
0809 20:11:37.487215 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:37.487220 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:37.487403 (+ 183us) server_negotiation.cc:407] Connection header received
0809 20:11:37.487552 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:37.487556 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:37.487613 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:37.487716 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:37.489211 (+ 1495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:37.489216 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:37.489221 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:11:37.489239 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:37.489275 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:11:37.489291 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:37.489404 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:37.489492 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 20:11:37.489546 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260809 20:11:37.489929 23607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:37.486693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:36597 (local address 127.14.181.2:56303)
0809 20:11:37.487309 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:37.487331 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:37.487447 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:37.487737 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:37.487741 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:37.487764 (+ 23us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:37.489006 (+ 1242us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 20:11:37.489008 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:37.489022 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 20:11:37.489065 (+ 43us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:37.489389 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:37.489394 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:37.489399 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 20:11:37.489517 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 20:11:37.489566 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":274,"threads_started":1}
I20260809 20:11:37.490115 23483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "713ca0bec51a454dbcb3599e38ad125d" candidate_uuid: "447575d4b47c4646800c297d81944f8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5b0b3d1682b4cf1ba808ea5a7aea6bf" is_pre_election: true
I20260809 20:11:37.490723 23483 raft_consensus.cc:2454] T 713ca0bec51a454dbcb3599e38ad125d P a5b0b3d1682b4cf1ba808ea5a7aea6bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 447575d4b47c4646800c297d81944f8c in term 0.
I20260809 20:11:37.490725 23602 leader_election.cc:288] T 713ca0bec51a454dbcb3599e38ad125d P 395e20c62dbf4da7a94d587ce9467602 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5b0b3d1682b4cf1ba808ea5a7aea6bf (127.14.181.3:34143), 447575d4b47c4646800c297d81944f8c (127.14.181.2:45603)
I20260809 20:11:37.491036 23039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "713ca0bec51a454dbcb3599e38ad125d" candidate_uuid: "447575d4b47c4646800c297d81944f8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "395e20c62dbf4da7a94d587ce9467602" is_pre_election: true
I20260809 20:11:37.491513 23039 raft_consensus.cc:2454] T 713ca0bec51a454dbcb3599e38ad125d P 395e20c62dbf4da7a94d587ce9467602 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 447575d4b47c4646800c297d81944f8c in term 0.
I20260809 20:11:37.491683 23158 leader_election.cc:302] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 447575d4b47c4646800c297d81944f8c, a5b0b3d1682b4cf1ba808ea5a7aea6bf; no voters:
I20260809 20:11:37.492154 23603 raft_consensus.cc:2781] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:11:37.492309 23603 raft_consensus.cc:482] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:11:37.492412 23603 raft_consensus.cc:3037] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:37.494624 23603 raft_consensus.cc:504] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5b0b3d1682b4cf1ba808ea5a7aea6bf" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 34143 } } peers { permanent_uuid: "395e20c62dbf4da7a94d587ce9467602" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 36597 } } peers { permanent_uuid: "447575d4b47c4646800c297d81944f8c" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 45603 } }
I20260809 20:11:37.495151 23603 leader_election.cc:288] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c [CANDIDATE]: Term 1 election: Requested vote from peers a5b0b3d1682b4cf1ba808ea5a7aea6bf (127.14.181.3:34143), 395e20c62dbf4da7a94d587ce9467602 (127.14.181.1:36597)
I20260809 20:11:37.495611 23483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "713ca0bec51a454dbcb3599e38ad125d" candidate_uuid: "447575d4b47c4646800c297d81944f8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5b0b3d1682b4cf1ba808ea5a7aea6bf"
I20260809 20:11:37.495820 23483 raft_consensus.cc:3037] T 713ca0bec51a454dbcb3599e38ad125d P a5b0b3d1682b4cf1ba808ea5a7aea6bf [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:37.496407 23039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "713ca0bec51a454dbcb3599e38ad125d" candidate_uuid: "447575d4b47c4646800c297d81944f8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "395e20c62dbf4da7a94d587ce9467602"
I20260809 20:11:37.496690 23039 raft_consensus.cc:3037] T 713ca0bec51a454dbcb3599e38ad125d P 395e20c62dbf4da7a94d587ce9467602 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:37.498209 23483 raft_consensus.cc:2454] T 713ca0bec51a454dbcb3599e38ad125d P a5b0b3d1682b4cf1ba808ea5a7aea6bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 447575d4b47c4646800c297d81944f8c in term 1.
I20260809 20:11:37.498610 23158 leader_election.cc:302] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 447575d4b47c4646800c297d81944f8c, a5b0b3d1682b4cf1ba808ea5a7aea6bf; no voters:
I20260809 20:11:37.498934 23603 raft_consensus.cc:2781] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:37.500030 23611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:37.490858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:34143 (local address 127.14.181.1:44191)
0809 20:11:37.495761 (+ 4903us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:37.495784 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:37.495936 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:37.496442 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:37.496446 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:37.496470 (+ 24us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:37.498977 (+ 2507us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 20:11:37.498980 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:37.498997 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 20:11:37.499043 (+ 46us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:37.499435 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:37.499440 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:37.499445 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 20:11:37.499569 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 20:11:37.499617 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4783,"thread_start_us":8030,"threads_started":1}
I20260809 20:11:37.500070 23039 raft_consensus.cc:2454] T 713ca0bec51a454dbcb3599e38ad125d P 395e20c62dbf4da7a94d587ce9467602 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 447575d4b47c4646800c297d81944f8c in term 1.
I20260809 20:11:37.500746 23590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:37.491304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:44191 (local address 127.14.181.3:34143)
0809 20:11:37.492035 (+ 731us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:37.492040 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:37.495856 (+ 3816us) server_negotiation.cc:407] Connection header received
0809 20:11:37.496070 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:37.496075 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:37.496151 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:37.496229 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:37.499195 (+ 2966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:37.499200 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:37.499205 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:11:37.499221 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:37.499254 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:11:37.499269 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:37.499382 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:37.500216 (+ 834us) server_negotiation.cc:299] Negotiation successful
0809 20:11:37.500270 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":629}
I20260809 20:11:37.501153 23603 raft_consensus.cc:686] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c [term 1 LEADER]: Becoming Leader. State: Replica: 447575d4b47c4646800c297d81944f8c, State: Running, Role: LEADER
I20260809 20:11:37.501199 23483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "713ca0bec51a454dbcb3599e38ad125d" candidate_uuid: "395e20c62dbf4da7a94d587ce9467602" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5b0b3d1682b4cf1ba808ea5a7aea6bf" is_pre_election: true
I20260809 20:11:37.501513 23483 raft_consensus.cc:2379] T 713ca0bec51a454dbcb3599e38ad125d P a5b0b3d1682b4cf1ba808ea5a7aea6bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 395e20c62dbf4da7a94d587ce9467602 in current term 1: Already voted for candidate 447575d4b47c4646800c297d81944f8c in this term.
I20260809 20:11:37.501611 23603 consensus_queue.cc:237] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5b0b3d1682b4cf1ba808ea5a7aea6bf" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 34143 } } peers { permanent_uuid: "395e20c62dbf4da7a94d587ce9467602" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 36597 } } peers { permanent_uuid: "447575d4b47c4646800c297d81944f8c" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 45603 } }
I20260809 20:11:37.502113 23593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:37.492082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:56165 (local address 127.14.181.2:45603)
0809 20:11:37.492223 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:37.492228 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:37.499510 (+ 7282us) server_negotiation.cc:407] Connection header received
0809 20:11:37.499722 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:37.499727 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:37.499783 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:37.499844 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:37.500969 (+ 1125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:37.500973 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:37.500976 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:11:37.500991 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:37.501020 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:11:37.501031 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:37.501186 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:37.501846 (+ 660us) server_negotiation.cc:299] Negotiation successful
0809 20:11:37.501900 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 20:11:37.502867 23609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:37.491172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:45603 (local address 127.14.181.1:56165)
0809 20:11:37.499416 (+ 8244us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:37.499434 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:37.499592 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:37.500046 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:37.500051 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:37.500078 (+ 27us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:37.500726 (+ 648us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 20:11:37.500730 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:37.500747 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 20:11:37.500795 (+ 48us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:37.501506 (+ 711us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:37.501516 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:37.501522 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 20:11:37.502311 (+ 789us) client_negotiation.cc:240] Negotiation successful
0809 20:11:37.502383 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8114,"thread_start_us":4283,"threads_started":1}
I20260809 20:11:37.503721 23271 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "713ca0bec51a454dbcb3599e38ad125d" candidate_uuid: "395e20c62dbf4da7a94d587ce9467602" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "447575d4b47c4646800c297d81944f8c" is_pre_election: true
I20260809 20:11:37.504741 22931 leader_election.cc:302] T 713ca0bec51a454dbcb3599e38ad125d P 395e20c62dbf4da7a94d587ce9467602 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 395e20c62dbf4da7a94d587ce9467602; no voters: 447575d4b47c4646800c297d81944f8c, a5b0b3d1682b4cf1ba808ea5a7aea6bf
I20260809 20:11:37.505048 23602 raft_consensus.cc:2726] T 713ca0bec51a454dbcb3599e38ad125d P 395e20c62dbf4da7a94d587ce9467602 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260809 20:11:37.506585 22806 catalog_manager.cc:5495] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c reported cstate change: term changed from 0 to 1, leader changed from <none> to 447575d4b47c4646800c297d81944f8c (127.14.181.2). New cstate: current_term: 1 leader_uuid: "447575d4b47c4646800c297d81944f8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5b0b3d1682b4cf1ba808ea5a7aea6bf" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 34143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "395e20c62dbf4da7a94d587ce9467602" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 36597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "447575d4b47c4646800c297d81944f8c" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 45603 } health_report { overall_health: HEALTHY } } }
W20260809 20:11:37.508229 23568 tablet.cc:2369] T 713ca0bec51a454dbcb3599e38ad125d P a5b0b3d1682b4cf1ba808ea5a7aea6bf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:11:37.557020 23593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:37.554947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43828 (local address 127.14.181.2:45603)
0809 20:11:37.555119 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:37.555125 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:37.555261 (+ 136us) server_negotiation.cc:407] Connection header received
0809 20:11:37.555478 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:37.555482 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:37.555568 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:37.555650 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:37.556418 (+ 768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:37.556424 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:37.556429 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:11:37.556446 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:37.556475 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:11:37.556487 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:37.556592 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:37.556711 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 20:11:37.556766 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 20:11:37.564324 23483 raft_consensus.cc:1261] T 713ca0bec51a454dbcb3599e38ad125d P a5b0b3d1682b4cf1ba808ea5a7aea6bf [term 1 FOLLOWER]: Refusing update from remote peer 447575d4b47c4646800c297d81944f8c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:11:37.564366 23039 raft_consensus.cc:1261] T 713ca0bec51a454dbcb3599e38ad125d P 395e20c62dbf4da7a94d587ce9467602 [term 1 FOLLOWER]: Refusing update from remote peer 447575d4b47c4646800c297d81944f8c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:11:37.565079 23615 consensus_queue.cc:1035] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "395e20c62dbf4da7a94d587ce9467602" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 36597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:11:37.565407 23603 consensus_queue.cc:1035] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5b0b3d1682b4cf1ba808ea5a7aea6bf" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 34143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:11:37.574939 23620 mvcc.cc:205] Tried to move back new op lower bound from 7316710594814558208 to 7316710594571464704. Current Snapshot: MvccSnapshot[applied={T|T < 7316710594814558208}]
I20260809 20:11:37.588238 22805 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38648:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:11:37.588464 22805 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38648:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:11:37.591876 22805 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2cf26c21d1bb46499d785af9fea72be3: Sending DeleteTablet for 3 replicas of tablet 713ca0bec51a454dbcb3599e38ad125d
I20260809 20:11:37.592981 23230 tablet_service.cc:1514] Processing DeleteTablet for tablet 713ca0bec51a454dbcb3599e38ad125d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:37 UTC) from {username='slave'} at 127.0.0.1:43812
I20260809 20:11:37.593019 23005 tablet_service.cc:1514] Processing DeleteTablet for tablet 713ca0bec51a454dbcb3599e38ad125d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:37 UTC) from {username='slave'} at 127.0.0.1:40542
I20260809 20:11:37.593967 23451 tablet_service.cc:1514] Processing DeleteTablet for tablet 713ca0bec51a454dbcb3599e38ad125d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:37 UTC) from {username='slave'} at 127.0.0.1:58876
I20260809 20:11:37.596724 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 22908
I20260809 20:11:37.604840 23637 tablet_replica.cc:330] T 713ca0bec51a454dbcb3599e38ad125d P a5b0b3d1682b4cf1ba808ea5a7aea6bf: stopping tablet replica
I20260809 20:11:37.605360 23637 raft_consensus.cc:2229] T 713ca0bec51a454dbcb3599e38ad125d P a5b0b3d1682b4cf1ba808ea5a7aea6bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:11:37.606974 23637 raft_consensus.cc:2258] T 713ca0bec51a454dbcb3599e38ad125d P a5b0b3d1682b4cf1ba808ea5a7aea6bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:37.608253 23634 tablet_replica.cc:330] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c: stopping tablet replica
I20260809 20:11:37.608697 23634 raft_consensus.cc:2229] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c [term 1 LEADER]: Raft consensus shutting down.
I20260809 20:11:37.609061 23637 ts_tablet_manager.cc:1905] T 713ca0bec51a454dbcb3599e38ad125d P a5b0b3d1682b4cf1ba808ea5a7aea6bf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:37.609337 23634 raft_consensus.cc:2258] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:37.610152 23636 tablet_replica.cc:330] T 713ca0bec51a454dbcb3599e38ad125d P 395e20c62dbf4da7a94d587ce9467602: stopping tablet replica
I20260809 20:11:37.612115 23634 ts_tablet_manager.cc:1905] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:37.612121 23595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:37.598095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40548 (local address 127.14.181.1:36597)
0809 20:11:37.598272 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:37.598279 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:37.610034 (+ 11755us) server_negotiation.cc:407] Connection header received
0809 20:11:37.610218 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:37.610223 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:37.610316 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:37.610443 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:37.611373 (+ 930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:37.611379 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:37.611383 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:11:37.611401 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:37.611437 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:11:37.611453 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:37.611543 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:37.611790 (+ 247us) server_negotiation.cc:299] Negotiation successful
0809 20:11:37.611850 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 20:11:37.615108 23111 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:37.618397 23637 ts_tablet_manager.cc:1918] T 713ca0bec51a454dbcb3599e38ad125d P a5b0b3d1682b4cf1ba808ea5a7aea6bf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:11:37.618552 23637 log.cc:1196] T 713ca0bec51a454dbcb3599e38ad125d P a5b0b3d1682b4cf1ba808ea5a7aea6bf: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-2/wal/wals/713ca0bec51a454dbcb3599e38ad125d
I20260809 20:11:37.619158 23637 ts_tablet_manager.cc:1939] T 713ca0bec51a454dbcb3599e38ad125d P a5b0b3d1682b4cf1ba808ea5a7aea6bf: Deleting consensus metadata
I20260809 20:11:37.619419 23634 ts_tablet_manager.cc:1918] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:11:37.619639 23634 log.cc:1196] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786306256699363-15060-0/minicluster-data/ts-1/wal/wals/713ca0bec51a454dbcb3599e38ad125d
I20260809 20:11:37.620245 23634 ts_tablet_manager.cc:1939] T 713ca0bec51a454dbcb3599e38ad125d P 447575d4b47c4646800c297d81944f8c: Deleting consensus metadata
I20260809 20:11:37.621011 22786 catalog_manager.cc:4841] TS a5b0b3d1682b4cf1ba808ea5a7aea6bf (127.14.181.3:34143): tablet 713ca0bec51a454dbcb3599e38ad125d (table test-table [id=228217d07d18401288ce785a787145ad]) successfully deleted
I20260809 20:11:37.622584 22790 catalog_manager.cc:4841] TS 447575d4b47c4646800c297d81944f8c (127.14.181.2:45603): tablet 713ca0bec51a454dbcb3599e38ad125d (table test-table [id=228217d07d18401288ce785a787145ad]) successfully deleted
I20260809 20:11:37.615185 23636 raft_consensus.cc:2229] T 713ca0bec51a454dbcb3599e38ad125d P 395e20c62dbf4da7a94d587ce9467602 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:11:37.706323 23636 raft_consensus.cc:2258] T 713ca0bec51a454dbcb3599e38ad125d P 395e20c62dbf4da7a94d587ce9467602 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:37.706430 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 22908
W20260809 20:11:37.737275 22786 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.181.1:36597 (error 108)
I20260809 20:11:37.738018 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 23125
I20260809 20:11:37.739727 23592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:37.739171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:36597 (local address 127.0.0.1:40558)
0809 20:11:37.739350 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:37.739553 (+ 203us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:36597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260809 20:11:37.740010 22786 catalog_manager.cc:4584] TS 395e20c62dbf4da7a94d587ce9467602 (127.14.181.1:36597): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 713ca0bec51a454dbcb3599e38ad125d: Network error: Client connection negotiation failed: client connection to 127.14.181.1:36597: connect: Connection refused (error 111)
I20260809 20:11:37.741040 23593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:37.738952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43840 (local address 127.14.181.2:45603)
0809 20:11:37.739136 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:37.739142 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:37.739161 (+ 19us) server_negotiation.cc:407] Connection header received
0809 20:11:37.739344 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:37.739350 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:37.739419 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:37.739532 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:37.740445 (+ 913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:37.740452 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:37.740457 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:11:37.740476 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:37.740507 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:11:37.740519 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:37.740652 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:37.740728 (+ 76us) server_negotiation.cc:299] Negotiation successful
0809 20:11:37.740789 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 20:11:37.741923 23335 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:37.793587 23592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:37.793066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:36597 (local address 127.0.0.1:40562)
0809 20:11:37.793293 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:37.793404 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:36597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260809 20:11:37.794644 23592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:37.794245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:36597 (local address 127.0.0.1:40572)
0809 20:11:37.794412 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:37.794495 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:36597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 20:11:37.851630 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 23125
I20260809 20:11:37.855093 23592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:37.854537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:36597 (local address 127.0.0.1:40584)
0809 20:11:37.854808 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:37.854904 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:36597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149}
I20260809 20:11:37.856336 23592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:37.855902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:36597 (local address 127.0.0.1:40588)
0809 20:11:37.856074 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:37.856170 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:36597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 20:11:37.883801 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 23346
I20260809 20:11:37.886606 23590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:37.884559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58878 (local address 127.14.181.3:34143)
0809 20:11:37.884719 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:37.884723 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:37.884784 (+ 61us) server_negotiation.cc:407] Connection header received
0809 20:11:37.884970 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:37.884974 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:37.885051 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:37.885145 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:37.886002 (+ 857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:37.886006 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:37.886009 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:11:37.886025 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:37.886055 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:11:37.886067 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:37.886166 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:37.886263 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 20:11:37.886310 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 20:11:37.887326 23551 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:37.936818 23592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:37.936376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:36597 (local address 127.0.0.1:40592)
0809 20:11:37.936588 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:37.936674 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:36597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260809 20:11:37.937793 23592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:37.937407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:36597 (local address 127.0.0.1:40594)
0809 20:11:37.937606 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:37.937674 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:36597: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260809 20:11:37.971238 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 23346
I20260809 20:11:37.990095 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 22758
I20260809 20:11:37.991209 22856 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:38.092628 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 22758
2026-08-09T20:11:38Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2646 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260809 20:11:38.137633 15060 mini_oidc.cc:152] Starting JWKS server
I20260809 20:11:38.141677 15060 webserver.cc:460] Webserver started at https://127.0.0.1:36337/ using document root <none> and password file <none>
I20260809 20:11:38.142014 15060 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 20:11:38.142709 15060 webserver.cc:460] Webserver started at http://127.0.0.1:41535/ using document root <none> and password file <none>
2026-08-09T20:11:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:11:38Z Disabled control of system clock
I20260809 20:11:38.171310 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:33319
--webserver_interface=127.14.181.62
--webserver_port=0
--builtin_ntp_servers=127.14.181.20:33197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:33319
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36337/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786306256699363-15060-0/testchainca.cert with env {}
W20260809 20:11:38.474063 23656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:38.474368 23656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:38.474498 23656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:38.481434 23656 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:11:38.481537 23656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:38.481600 23656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:38.481686 23656 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:11:38.481742 23656 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 20:11:38.481825 23656 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 20:11:38.481877 23656 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36337/jwks.json
I20260809 20:11:38.491343 23656 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:33197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:33319
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:33319
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36337/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786306256699363-15060-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:38.492501 23656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:38.493711 23656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:38.504714 23664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:38.504765 23671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:38.504724 23665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:38.505585 23656 server_base.cc:1034] running on GCE node
I20260809 20:11:38.506284 23656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:38.507582 23656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:38.508771 23656 hybrid_clock.cc:648] HybridClock initialized: now 1786306298508716 us; error 47 us; skew 500 ppm
I20260809 20:11:38.509071 23656 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 20:11:38.511219 23656 webserver.cc:460] Webserver started at http://127.14.181.62:38887/ using document root <none> and password file <none>
I20260809 20:11:38.511850 23656 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:38.511938 23656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:38.512185 23656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:38.515156 23656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "9bfd8889aaf84e28b818dca42f62f23c"
format_stamp: "Formatted at 2026-08-09 20:11:38 on dist-test-slave-6zbq"
server_key: "890ba3f125617aed41dd0fcd58b74ea5"
server_key_iv: "a74a92f2f62d2388d1e0a921e9d71cd8"
server_key_version: "encryptionkey@0"
I20260809 20:11:38.516036 23656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "9bfd8889aaf84e28b818dca42f62f23c"
format_stamp: "Formatted at 2026-08-09 20:11:38 on dist-test-slave-6zbq"
server_key: "890ba3f125617aed41dd0fcd58b74ea5"
server_key_iv: "a74a92f2f62d2388d1e0a921e9d71cd8"
server_key_version: "encryptionkey@0"
I20260809 20:11:38.521072 23656 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260809 20:11:38.524220 23684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:38.525435 23656 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 20:11:38.525593 23656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "9bfd8889aaf84e28b818dca42f62f23c"
format_stamp: "Formatted at 2026-08-09 20:11:38 on dist-test-slave-6zbq"
server_key: "890ba3f125617aed41dd0fcd58b74ea5"
server_key_iv: "a74a92f2f62d2388d1e0a921e9d71cd8"
server_key_version: "encryptionkey@0"
I20260809 20:11:38.525794 23656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:38.576051 23656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:38.576877 23656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:38.577167 23656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:38.593708 23656 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:33319
I20260809 20:11:38.593727 23778 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:33319 every 8 connection(s)
I20260809 20:11:38.594959 23656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:11:38.596114 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 23656
I20260809 20:11:38.596334 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:11:38.597143 15060 external_mini_cluster.cc:1428] Setting key a32189db0f4b50c76bf725e7729d648f
I20260809 20:11:38.599372 23779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:38.611809 23786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:38.599001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50948 (local address 127.14.181.62:33319)
0809 20:11:38.599940 (+ 939us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:38.599951 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:38.599987 (+ 36us) server_negotiation.cc:407] Connection header received
0809 20:11:38.601588 (+ 1601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:38.601608 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:38.602041 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:38.602387 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:38.602974 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:38.604962 (+ 1988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:38.606931 (+ 1969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:38.607966 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:38.608145 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:38.609505 (+ 1360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:38.609515 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:38.609535 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:11:38.610059 (+ 524us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:38.610131 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:11:38.610156 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:38.610271 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:38.610637 (+ 366us) server_negotiation.cc:299] Negotiation successful
0809 20:11:38.610968 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":370,"threads_started":1}
I20260809 20:11:38.612855 23779 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9bfd8889aaf84e28b818dca42f62f23c: Bootstrap starting.
I20260809 20:11:38.615427 15060 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 20:11:38.616129 23779 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9bfd8889aaf84e28b818dca42f62f23c: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:38.617293 23779 log.cc:824] T 00000000000000000000000000000000 P 9bfd8889aaf84e28b818dca42f62f23c: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:38.620041 23779 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9bfd8889aaf84e28b818dca42f62f23c: No bootstrap required, opened a new log
I20260809 20:11:38.626930 23779 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9bfd8889aaf84e28b818dca42f62f23c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bfd8889aaf84e28b818dca42f62f23c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33319 } }
I20260809 20:11:38.627234 23779 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9bfd8889aaf84e28b818dca42f62f23c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:38.627310 23779 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9bfd8889aaf84e28b818dca42f62f23c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bfd8889aaf84e28b818dca42f62f23c, State: Initialized, Role: FOLLOWER
I20260809 20:11:38.627741 23779 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9bfd8889aaf84e28b818dca42f62f23c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bfd8889aaf84e28b818dca42f62f23c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33319 } }
I20260809 20:11:38.628001 23779 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9bfd8889aaf84e28b818dca42f62f23c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:11:38.628146 23779 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9bfd8889aaf84e28b818dca42f62f23c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:11:38.628320 23779 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9bfd8889aaf84e28b818dca42f62f23c [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:38.630532 23779 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9bfd8889aaf84e28b818dca42f62f23c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bfd8889aaf84e28b818dca42f62f23c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33319 } }
I20260809 20:11:38.631042 23779 leader_election.cc:302] T 00000000000000000000000000000000 P 9bfd8889aaf84e28b818dca42f62f23c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9bfd8889aaf84e28b818dca42f62f23c; no voters:
I20260809 20:11:38.631524 23779 leader_election.cc:288] T 00000000000000000000000000000000 P 9bfd8889aaf84e28b818dca42f62f23c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:11:38.631640 23789 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9bfd8889aaf84e28b818dca42f62f23c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:38.632282 23789 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9bfd8889aaf84e28b818dca42f62f23c [term 1 LEADER]: Becoming Leader. State: Replica: 9bfd8889aaf84e28b818dca42f62f23c, State: Running, Role: LEADER
I20260809 20:11:38.632742 23789 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9bfd8889aaf84e28b818dca42f62f23c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bfd8889aaf84e28b818dca42f62f23c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33319 } }
I20260809 20:11:38.633298 23779 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9bfd8889aaf84e28b818dca42f62f23c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:11:38.635938 23791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9bfd8889aaf84e28b818dca42f62f23c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9bfd8889aaf84e28b818dca42f62f23c. Latest consensus state: current_term: 1 leader_uuid: "9bfd8889aaf84e28b818dca42f62f23c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bfd8889aaf84e28b818dca42f62f23c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33319 } } }
I20260809 20:11:38.636020 23790 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9bfd8889aaf84e28b818dca42f62f23c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9bfd8889aaf84e28b818dca42f62f23c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bfd8889aaf84e28b818dca42f62f23c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33319 } } }
I20260809 20:11:38.636327 23791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9bfd8889aaf84e28b818dca42f62f23c [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:38.636365 23790 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9bfd8889aaf84e28b818dca42f62f23c [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:38.637770 23797 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:11:38.642494 23797 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:11:38.651294 23797 catalog_manager.cc:1347] Generated new cluster ID: 723016613dd44dd2ab7e7884fad883d3
I20260809 20:11:38.651386 23797 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:11:38.674510 23797 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:11:38.676177 23797 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:11:38.686159 23797 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9bfd8889aaf84e28b818dca42f62f23c: Generated new TSK 0
I20260809 20:11:38.686883 23797 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 20:11:38.741183 23825 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260809 20:11:38.741348 23825 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 20:11:38.742997 23786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:38.713471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50952 (local address 127.14.181.62:33319)
0809 20:11:38.713674 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:38.713681 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:38.714247 (+ 566us) server_negotiation.cc:407] Connection header received
0809 20:11:38.714652 (+ 405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:38.714656 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:38.714721 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:38.714825 (+ 104us) server_negotiation.cc:226] Negotiated authn=JWT
0809 20:11:38.715471 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:38.716210 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:38.718250 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:38.718728 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:38.718833 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:38.719436 (+ 603us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 20:11:38.742512 (+ 23076us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36337/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 20:11:38.742773 (+ 261us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50952: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36337/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":61}
W20260809 20:11:38.743122 23786 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50952: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36337/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260809 20:11:38.745090 23824 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:11:38.713480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:33319 (local address 127.0.0.1:50952)
0809 20:11:38.714136 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:38.714164 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:38.714361 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:38.714872 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:38.714877 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:38.714891 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0809 20:11:38.715300 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:38.715314 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:38.716337 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:38.716342 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:38.718109 (+ 1767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:38.718125 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:38.718904 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:38.718911 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:38.719095 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:38.719197 (+ 102us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 20:11:38.742745 (+ 23548us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36337/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 20:11:38.743059 (+ 314us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.14.181.62:33319: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36337/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":308,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.14.181.62:33319: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36337/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260809 20:11:38.746744 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 23656
I20260809 20:11:38.747855 23770 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:38.839039 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 23656
2026-08-09T20:11:38Z chronyd exiting
I20260809 20:11:38.891134 15060 test_util.cc:175] -----------------------------------------------
I20260809 20:11:38.891281 15060 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786306256699363-15060-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (758 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260809 20:11:38.895047 15060 mini_oidc.cc:152] Starting JWKS server
I20260809 20:11:38.896770 15060 webserver.cc:460] Webserver started at https://127.0.0.1:46437/ using document root <none> and password file <none>
I20260809 20:11:38.896967 15060 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 20:11:38.897559 15060 webserver.cc:460] Webserver started at http://127.0.0.1:46633/ using document root <none> and password file <none>
2026-08-09T20:11:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:11:38Z Disabled control of system clock
I20260809 20:11:38.925071 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:41385
--webserver_interface=127.14.181.62
--webserver_port=0
--builtin_ntp_servers=127.14.181.20:45961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:41385
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46437/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786306256699363-15060-0/testchainca.cert with env {}
W20260809 20:11:39.245217 23841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:39.245493 23841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:39.245585 23841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:39.252615 23841 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:11:39.252724 23841 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:39.252769 23841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:39.252823 23841 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:11:39.252866 23841 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 20:11:39.252925 23841 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 20:11:39.252964 23841 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:46437/jwks.json
I20260809 20:11:39.262791 23841 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:45961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:41385
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:41385
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46437/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786306256699363-15060-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:39.263936 23841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:39.265111 23841 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:39.275880 23850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:39.275976 23857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:39.275949 23854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:39.276854 23841 server_base.cc:1034] running on GCE node
I20260809 20:11:39.277513 23841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:39.278743 23841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:39.279922 23841 hybrid_clock.cc:648] HybridClock initialized: now 1786306299279884 us; error 29 us; skew 500 ppm
I20260809 20:11:39.280225 23841 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 20:11:39.285462 23841 webserver.cc:460] Webserver started at http://127.14.181.62:41345/ using document root <none> and password file <none>
I20260809 20:11:39.286064 23841 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:39.286159 23841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:39.286510 23841 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:39.289124 23841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "4268fd8bc4944fa68610cbf2556ff10e"
format_stamp: "Formatted at 2026-08-09 20:11:39 on dist-test-slave-6zbq"
server_key: "935429014a09685720b23eb03bcdf57f"
server_key_iv: "b366acf050bda66e04bbd2c6b1b3747e"
server_key_version: "encryptionkey@0"
I20260809 20:11:39.289855 23841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "4268fd8bc4944fa68610cbf2556ff10e"
format_stamp: "Formatted at 2026-08-09 20:11:39 on dist-test-slave-6zbq"
server_key: "935429014a09685720b23eb03bcdf57f"
server_key_iv: "b366acf050bda66e04bbd2c6b1b3747e"
server_key_version: "encryptionkey@0"
I20260809 20:11:39.294482 23841 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260809 20:11:39.297570 23866 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:39.298818 23841 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 20:11:39.298970 23841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "4268fd8bc4944fa68610cbf2556ff10e"
format_stamp: "Formatted at 2026-08-09 20:11:39 on dist-test-slave-6zbq"
server_key: "935429014a09685720b23eb03bcdf57f"
server_key_iv: "b366acf050bda66e04bbd2c6b1b3747e"
server_key_version: "encryptionkey@0"
I20260809 20:11:39.299142 23841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:39.314823 23841 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:39.315528 23841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:39.315795 23841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:39.332903 23841 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:41385
I20260809 20:11:39.332921 23955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:41385 every 8 connection(s)
I20260809 20:11:39.334389 23841 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:11:39.337962 23956 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:39.343323 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 23841
I20260809 20:11:39.343564 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:11:39.344259 15060 external_mini_cluster.cc:1428] Setting key b97e032b6023427d0a98149a11e7df55
I20260809 20:11:39.349747 23956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4268fd8bc4944fa68610cbf2556ff10e: Bootstrap starting.
I20260809 20:11:39.353508 23956 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4268fd8bc4944fa68610cbf2556ff10e: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:39.354485 23956 log.cc:824] T 00000000000000000000000000000000 P 4268fd8bc4944fa68610cbf2556ff10e: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:39.357581 23956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4268fd8bc4944fa68610cbf2556ff10e: No bootstrap required, opened a new log
I20260809 20:11:39.359508 23960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:39.346472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58700 (local address 127.14.181.62:41385)
0809 20:11:39.347568 (+ 1096us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:39.347582 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:39.347642 (+ 60us) server_negotiation.cc:407] Connection header received
0809 20:11:39.349920 (+ 2278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:39.349947 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:39.350496 (+ 549us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:39.350909 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:39.351438 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:39.353316 (+ 1878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:39.354629 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:39.355470 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:39.355616 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:39.356720 (+ 1104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:39.356732 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:39.356749 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:11:39.357410 (+ 661us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:39.357511 (+ 101us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:11:39.357538 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:39.357748 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:39.357951 (+ 203us) server_negotiation.cc:299] Negotiation successful
0809 20:11:39.358285 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":568,"thread_start_us":336,"threads_started":1}
I20260809 20:11:39.363058 15060 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 20:11:39.365509 23956 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4268fd8bc4944fa68610cbf2556ff10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4268fd8bc4944fa68610cbf2556ff10e" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 41385 } }
I20260809 20:11:39.365847 23956 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4268fd8bc4944fa68610cbf2556ff10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:39.365954 23956 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4268fd8bc4944fa68610cbf2556ff10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4268fd8bc4944fa68610cbf2556ff10e, State: Initialized, Role: FOLLOWER
I20260809 20:11:39.366523 23956 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4268fd8bc4944fa68610cbf2556ff10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4268fd8bc4944fa68610cbf2556ff10e" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 41385 } }
I20260809 20:11:39.366734 23956 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4268fd8bc4944fa68610cbf2556ff10e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:11:39.366829 23956 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4268fd8bc4944fa68610cbf2556ff10e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:11:39.366946 23956 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4268fd8bc4944fa68610cbf2556ff10e [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:39.369297 23956 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4268fd8bc4944fa68610cbf2556ff10e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4268fd8bc4944fa68610cbf2556ff10e" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 41385 } }
I20260809 20:11:39.369735 23956 leader_election.cc:302] T 00000000000000000000000000000000 P 4268fd8bc4944fa68610cbf2556ff10e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4268fd8bc4944fa68610cbf2556ff10e; no voters:
I20260809 20:11:39.370190 23956 leader_election.cc:288] T 00000000000000000000000000000000 P 4268fd8bc4944fa68610cbf2556ff10e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:11:39.370363 23962 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4268fd8bc4944fa68610cbf2556ff10e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:39.371012 23962 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4268fd8bc4944fa68610cbf2556ff10e [term 1 LEADER]: Becoming Leader. State: Replica: 4268fd8bc4944fa68610cbf2556ff10e, State: Running, Role: LEADER
I20260809 20:11:39.371521 23962 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4268fd8bc4944fa68610cbf2556ff10e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4268fd8bc4944fa68610cbf2556ff10e" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 41385 } }
I20260809 20:11:39.372167 23956 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4268fd8bc4944fa68610cbf2556ff10e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:11:39.374280 23963 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4268fd8bc4944fa68610cbf2556ff10e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4268fd8bc4944fa68610cbf2556ff10e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4268fd8bc4944fa68610cbf2556ff10e" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 41385 } } }
I20260809 20:11:39.374370 23964 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4268fd8bc4944fa68610cbf2556ff10e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4268fd8bc4944fa68610cbf2556ff10e. Latest consensus state: current_term: 1 leader_uuid: "4268fd8bc4944fa68610cbf2556ff10e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4268fd8bc4944fa68610cbf2556ff10e" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 41385 } } }
I20260809 20:11:39.374683 23963 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4268fd8bc4944fa68610cbf2556ff10e [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:39.374861 23964 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4268fd8bc4944fa68610cbf2556ff10e [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:39.380560 23973 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:11:39.384918 23973 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:11:39.392351 23973 catalog_manager.cc:1347] Generated new cluster ID: 033fd0f91b4341c8bce8d8f4de289c2e
I20260809 20:11:39.392452 23973 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:11:39.406486 23973 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:11:39.407610 23973 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:11:39.419260 23973 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4268fd8bc4944fa68610cbf2556ff10e: Generated new TSK 0
I20260809 20:11:39.420007 23973 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 20:11:39.456323 23998 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260809 20:11:39.456425 23998 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 20:11:39.457723 23960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:39.437848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58710 (local address 127.14.181.62:41385)
0809 20:11:39.438029 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:39.438036 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:39.438546 (+ 510us) server_negotiation.cc:407] Connection header received
0809 20:11:39.438733 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:39.438739 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:39.438840 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:39.439008 (+ 168us) server_negotiation.cc:226] Negotiated authn=JWT
0809 20:11:39.439473 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:39.440579 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:39.441884 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:39.442608 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:39.442734 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:39.443165 (+ 431us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 20:11:39.457006 (+ 13841us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46437/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 20:11:39.457446 (+ 440us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58710: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46437/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":53}
W20260809 20:11:39.457757 23995 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:11:39.437840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:41385 (local address 127.0.0.1:58710)
0809 20:11:39.438453 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:39.438469 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:39.438582 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:39.439020 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:39.439023 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:39.439034 (+ 11us) client_negotiation.cc:189] Negotiated authn=JWT
0809 20:11:39.439319 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:39.439327 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:39.440691 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:39.440694 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:39.441744 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:39.441755 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:39.442762 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:39.442767 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:39.442897 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:39.442928 (+ 31us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 20:11:39.457290 (+ 14362us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46437/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 20:11:39.457465 (+ 175us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.14.181.62:41385: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46437/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":317,"threads_started":1}
W20260809 20:11:39.457846 23960 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58710: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46437/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260809 20:11:39.459168 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 23841
I20260809 20:11:39.460255 23949 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:39.550599 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 23841
2026-08-09T20:11:39Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (717 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260809 20:11:39.612903 15060 mini_oidc.cc:152] Starting JWKS server
I20260809 20:11:39.614727 15060 webserver.cc:460] Webserver started at https://127.0.0.1:43467/ using document root <none> and password file <none>
I20260809 20:11:39.614943 15060 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 20:11:39.615506 15060 webserver.cc:460] Webserver started at http://127.0.0.1:35715/ using document root <none> and password file <none>
2026-08-09T20:11:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:11:39Z Disabled control of system clock
I20260809 20:11:39.644469 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:45707
--webserver_interface=127.14.181.62
--webserver_port=0
--builtin_ntp_servers=127.14.181.20:45761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:45707
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43467/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 20:11:39.951105 24009 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:39.951349 24009 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:39.951473 24009 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:39.958438 24009 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:11:39.958554 24009 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:39.958626 24009 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:39.958706 24009 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:11:39.958775 24009 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 20:11:39.958855 24009 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 20:11:39.958909 24009 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:43467/jwks.json
I20260809 20:11:39.967535 24009 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:45761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:45707
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:45707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43467/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:39.968608 24009 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:39.970214 24009 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:39.980633 24018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:39.980640 24019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:39.980859 24022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:39.981463 24009 server_base.cc:1034] running on GCE node
I20260809 20:11:39.982122 24009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:39.983353 24009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:39.984527 24009 hybrid_clock.cc:648] HybridClock initialized: now 1786306299984486 us; error 40 us; skew 500 ppm
I20260809 20:11:39.984829 24009 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 20:11:39.986915 24009 webserver.cc:460] Webserver started at http://127.14.181.62:37301/ using document root <none> and password file <none>
I20260809 20:11:39.987522 24009 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:39.987620 24009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:39.987921 24009 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:39.990649 24009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "38dd42f93b9049628b0af30c8f76e0a9"
format_stamp: "Formatted at 2026-08-09 20:11:39 on dist-test-slave-6zbq"
server_key: "6aea1cf02b41c5e99aed663070417a68"
server_key_iv: "da7bb11fe1a45d0715452f2dc25a4c32"
server_key_version: "encryptionkey@0"
I20260809 20:11:39.991410 24009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "38dd42f93b9049628b0af30c8f76e0a9"
format_stamp: "Formatted at 2026-08-09 20:11:39 on dist-test-slave-6zbq"
server_key: "6aea1cf02b41c5e99aed663070417a68"
server_key_iv: "da7bb11fe1a45d0715452f2dc25a4c32"
server_key_version: "encryptionkey@0"
I20260809 20:11:39.996047 24009 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 20:11:39.999119 24035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:40.000283 24009 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:11:40.000429 24009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "38dd42f93b9049628b0af30c8f76e0a9"
format_stamp: "Formatted at 2026-08-09 20:11:39 on dist-test-slave-6zbq"
server_key: "6aea1cf02b41c5e99aed663070417a68"
server_key_iv: "da7bb11fe1a45d0715452f2dc25a4c32"
server_key_version: "encryptionkey@0"
I20260809 20:11:40.000610 24009 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:40.015552 24009 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:40.016227 24009 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:40.016484 24009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:40.032619 24009 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:45707
I20260809 20:11:40.032642 24115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:45707 every 8 connection(s)
I20260809 20:11:40.033736 24009 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:11:40.036993 24116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:40.040062 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 24009
I20260809 20:11:40.040246 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:11:40.040848 15060 external_mini_cluster.cc:1428] Setting key 40c036da016befc3b0c74c1a5a6b5042
I20260809 20:11:40.048007 24116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38dd42f93b9049628b0af30c8f76e0a9: Bootstrap starting.
I20260809 20:11:40.050779 24116 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38dd42f93b9049628b0af30c8f76e0a9: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:40.051764 24116 log.cc:824] T 00000000000000000000000000000000 P 38dd42f93b9049628b0af30c8f76e0a9: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:40.052925 24122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:40.042471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33886 (local address 127.14.181.62:45707)
0809 20:11:40.043332 (+ 861us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:40.043342 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:40.043379 (+ 37us) server_negotiation.cc:407] Connection header received
0809 20:11:40.044874 (+ 1495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:40.044893 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:40.045309 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:40.045656 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:40.046183 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:40.047425 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:40.048722 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:40.049382 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:40.049553 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:40.050582 (+ 1029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:40.050590 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:40.050601 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:11:40.051124 (+ 523us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:40.051215 (+ 91us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:11:40.051239 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:40.051342 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:40.051581 (+ 239us) server_negotiation.cc:299] Negotiation successful
0809 20:11:40.051843 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":321,"threads_started":1}
I20260809 20:11:40.054754 24116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38dd42f93b9049628b0af30c8f76e0a9: No bootstrap required, opened a new log
I20260809 20:11:40.056414 15060 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 20:11:40.061991 24116 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38dd42f93b9049628b0af30c8f76e0a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38dd42f93b9049628b0af30c8f76e0a9" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 45707 } }
I20260809 20:11:40.062314 24116 raft_consensus.cc:374] T 00000000000000000000000000000000 P 38dd42f93b9049628b0af30c8f76e0a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:40.062426 24116 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38dd42f93b9049628b0af30c8f76e0a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38dd42f93b9049628b0af30c8f76e0a9, State: Initialized, Role: FOLLOWER
I20260809 20:11:40.062915 24116 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38dd42f93b9049628b0af30c8f76e0a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38dd42f93b9049628b0af30c8f76e0a9" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 45707 } }
I20260809 20:11:40.063117 24116 raft_consensus.cc:388] T 00000000000000000000000000000000 P 38dd42f93b9049628b0af30c8f76e0a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:11:40.063248 24116 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38dd42f93b9049628b0af30c8f76e0a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:11:40.063383 24116 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38dd42f93b9049628b0af30c8f76e0a9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:40.065426 24116 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38dd42f93b9049628b0af30c8f76e0a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38dd42f93b9049628b0af30c8f76e0a9" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 45707 } }
I20260809 20:11:40.065899 24116 leader_election.cc:302] T 00000000000000000000000000000000 P 38dd42f93b9049628b0af30c8f76e0a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 38dd42f93b9049628b0af30c8f76e0a9; no voters:
I20260809 20:11:40.066452 24116 leader_election.cc:288] T 00000000000000000000000000000000 P 38dd42f93b9049628b0af30c8f76e0a9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:11:40.066546 24125 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38dd42f93b9049628b0af30c8f76e0a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:40.067186 24125 raft_consensus.cc:686] T 00000000000000000000000000000000 P 38dd42f93b9049628b0af30c8f76e0a9 [term 1 LEADER]: Becoming Leader. State: Replica: 38dd42f93b9049628b0af30c8f76e0a9, State: Running, Role: LEADER
I20260809 20:11:40.067672 24125 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38dd42f93b9049628b0af30c8f76e0a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38dd42f93b9049628b0af30c8f76e0a9" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 45707 } }
I20260809 20:11:40.068275 24116 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38dd42f93b9049628b0af30c8f76e0a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:11:40.070147 24130 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38dd42f93b9049628b0af30c8f76e0a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38dd42f93b9049628b0af30c8f76e0a9. Latest consensus state: current_term: 1 leader_uuid: "38dd42f93b9049628b0af30c8f76e0a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38dd42f93b9049628b0af30c8f76e0a9" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 45707 } } }
I20260809 20:11:40.070466 24130 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38dd42f93b9049628b0af30c8f76e0a9 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:40.070926 24127 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38dd42f93b9049628b0af30c8f76e0a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "38dd42f93b9049628b0af30c8f76e0a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38dd42f93b9049628b0af30c8f76e0a9" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 45707 } } }
I20260809 20:11:40.071233 24127 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38dd42f93b9049628b0af30c8f76e0a9 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:40.071915 24136 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:11:40.076184 24136 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:11:40.083842 24136 catalog_manager.cc:1347] Generated new cluster ID: d208863677aa4025a43a265b99d7973e
I20260809 20:11:40.083938 24136 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:11:40.092075 24136 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:11:40.093184 24136 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:11:40.101809 24136 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 38dd42f93b9049628b0af30c8f76e0a9: Generated new TSK 0
I20260809 20:11:40.102469 24136 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:11:40.125563 24122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:40.117581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33894 (local address 127.14.181.62:45707)
0809 20:11:40.117756 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:40.117763 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:40.118265 (+ 502us) server_negotiation.cc:407] Connection header received
0809 20:11:40.118513 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:40.118516 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:40.118591 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:40.118715 (+ 124us) server_negotiation.cc:226] Negotiated authn=JWT
0809 20:11:40.119268 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:40.119958 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:40.121937 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:40.122361 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:40.122455 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:40.123000 (+ 545us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 20:11:40.124970 (+ 1970us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43467/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 20:11:40.125285 (+ 315us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:33894: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43467/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":52}
W20260809 20:11:40.125669 24122 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:33894: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43467/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260809 20:11:40.127761 24159 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:11:40.117578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:45707 (local address 127.0.0.1:33894)
0809 20:11:40.118137 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:40.118162 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:40.118318 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:40.118753 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:40.118759 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:40.118771 (+ 12us) client_negotiation.cc:189] Negotiated authn=JWT
0809 20:11:40.119114 (+ 343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:40.119127 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:40.120093 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:40.120100 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:40.121807 (+ 1707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:40.121823 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:40.122546 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:40.122553 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:40.122735 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:40.122781 (+ 46us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 20:11:40.125177 (+ 2396us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43467/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 20:11:40.127344 (+ 2167us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.14.181.62:45707: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43467/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":427,"mutex_wait_us":1837,"thread_start_us":280,"threads_started":1}
I20260809 20:11:40.129195 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 24009
I20260809 20:11:40.130257 24105 generic_service.cc:196] Checking for leaks (request via RPC)
E20260809 20:11:40.137247 24160 webserver.cc:533] Webserver: sslize failed:
E20260809 20:11:40.137326 24160 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 20:11:40.217410 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 24009
2026-08-09T20:11:40Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (659 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-09T20:11:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:11:40Z Disabled control of system clock
I20260809 20:11:40.298736 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:36305
--webserver_interface=127.14.181.62
--webserver_port=0
--builtin_ntp_servers=127.14.181.20:36085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:36305
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786306256699363-15060-0/testchainca.cert with env {}
W20260809 20:11:40.603114 24169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:40.603432 24169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:40.603588 24169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:40.611529 24169 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:11:40.611622 24169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:40.611681 24169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:40.611763 24169 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:11:40.611824 24169 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 20:11:40.611900 24169 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 20:11:40.611950 24169 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260809 20:11:40.621337 24169 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:36305
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:36305
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786306256699363-15060-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:40.622506 24169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:40.623684 24169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:40.634450 24176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:40.634526 24180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:40.634563 24177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:40.635236 24169 server_base.cc:1034] running on GCE node
I20260809 20:11:40.635941 24169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:40.637117 24169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:40.638302 24169 hybrid_clock.cc:648] HybridClock initialized: now 1786306300638259 us; error 40 us; skew 500 ppm
I20260809 20:11:40.638614 24169 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 20:11:40.640635 24169 webserver.cc:460] Webserver started at http://127.14.181.62:38799/ using document root <none> and password file <none>
I20260809 20:11:40.641255 24169 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:40.641343 24169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:40.641584 24169 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:40.644207 24169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "794a6410ae1d4fd0b18d4b444dfa2f51"
format_stamp: "Formatted at 2026-08-09 20:11:40 on dist-test-slave-6zbq"
server_key: "4061f52497e40e5eaacb614c10a5799e"
server_key_iv: "d246e8e824e2c9140d6f0191b8c6cdb4"
server_key_version: "encryptionkey@0"
I20260809 20:11:40.644929 24169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "794a6410ae1d4fd0b18d4b444dfa2f51"
format_stamp: "Formatted at 2026-08-09 20:11:40 on dist-test-slave-6zbq"
server_key: "4061f52497e40e5eaacb614c10a5799e"
server_key_iv: "d246e8e824e2c9140d6f0191b8c6cdb4"
server_key_version: "encryptionkey@0"
I20260809 20:11:40.649433 24169 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 20:11:40.652522 24188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:40.653679 24169 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 20:11:40.653806 24169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "794a6410ae1d4fd0b18d4b444dfa2f51"
format_stamp: "Formatted at 2026-08-09 20:11:40 on dist-test-slave-6zbq"
server_key: "4061f52497e40e5eaacb614c10a5799e"
server_key_iv: "d246e8e824e2c9140d6f0191b8c6cdb4"
server_key_version: "encryptionkey@0"
I20260809 20:11:40.653970 24169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:40.665774 24169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:40.666555 24169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:40.666795 24169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:40.683117 24169 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:36305
I20260809 20:11:40.683135 24276 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:36305 every 8 connection(s)
I20260809 20:11:40.684309 24169 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:11:40.687703 24280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:40.693190 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 24169
I20260809 20:11:40.693398 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:11:40.694245 15060 external_mini_cluster.cc:1428] Setting key 6a4bdf0ebdce247480e14b663a8f53b4
I20260809 20:11:40.698143 24280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 794a6410ae1d4fd0b18d4b444dfa2f51: Bootstrap starting.
I20260809 20:11:40.701227 24280 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 794a6410ae1d4fd0b18d4b444dfa2f51: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:40.702406 24280 log.cc:824] T 00000000000000000000000000000000 P 794a6410ae1d4fd0b18d4b444dfa2f51: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:40.705420 24280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 794a6410ae1d4fd0b18d4b444dfa2f51: No bootstrap required, opened a new log
I20260809 20:11:40.707302 24284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:40.696065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33050 (local address 127.14.181.62:36305)
0809 20:11:40.696996 (+ 931us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:40.697007 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:40.697045 (+ 38us) server_negotiation.cc:407] Connection header received
0809 20:11:40.698665 (+ 1620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:40.698688 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:40.699095 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:40.699386 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:40.699988 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:40.701232 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:40.702957 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:40.703911 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:40.704044 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:40.705174 (+ 1130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:40.705181 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:40.705194 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:11:40.705715 (+ 521us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:40.705803 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:11:40.705824 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:40.705919 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:40.706114 (+ 195us) server_negotiation.cc:299] Negotiation successful
0809 20:11:40.706412 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":347,"threads_started":1}
I20260809 20:11:40.710781 15060 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 20:11:40.713771 24280 raft_consensus.cc:348] T 00000000000000000000000000000000 P 794a6410ae1d4fd0b18d4b444dfa2f51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "794a6410ae1d4fd0b18d4b444dfa2f51" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 36305 } }
I20260809 20:11:40.714087 24280 raft_consensus.cc:374] T 00000000000000000000000000000000 P 794a6410ae1d4fd0b18d4b444dfa2f51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:40.714190 24280 raft_consensus.cc:729] T 00000000000000000000000000000000 P 794a6410ae1d4fd0b18d4b444dfa2f51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 794a6410ae1d4fd0b18d4b444dfa2f51, State: Initialized, Role: FOLLOWER
I20260809 20:11:40.714748 24280 consensus_queue.cc:260] T 00000000000000000000000000000000 P 794a6410ae1d4fd0b18d4b444dfa2f51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "794a6410ae1d4fd0b18d4b444dfa2f51" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 36305 } }
I20260809 20:11:40.714951 24280 raft_consensus.cc:388] T 00000000000000000000000000000000 P 794a6410ae1d4fd0b18d4b444dfa2f51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:11:40.715072 24280 raft_consensus.cc:482] T 00000000000000000000000000000000 P 794a6410ae1d4fd0b18d4b444dfa2f51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:11:40.715211 24280 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 794a6410ae1d4fd0b18d4b444dfa2f51 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:40.717163 24280 raft_consensus.cc:504] T 00000000000000000000000000000000 P 794a6410ae1d4fd0b18d4b444dfa2f51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "794a6410ae1d4fd0b18d4b444dfa2f51" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 36305 } }
I20260809 20:11:40.717600 24280 leader_election.cc:302] T 00000000000000000000000000000000 P 794a6410ae1d4fd0b18d4b444dfa2f51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 794a6410ae1d4fd0b18d4b444dfa2f51; no voters:
I20260809 20:11:40.718168 24280 leader_election.cc:288] T 00000000000000000000000000000000 P 794a6410ae1d4fd0b18d4b444dfa2f51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:11:40.718277 24287 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 794a6410ae1d4fd0b18d4b444dfa2f51 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:40.719081 24287 raft_consensus.cc:686] T 00000000000000000000000000000000 P 794a6410ae1d4fd0b18d4b444dfa2f51 [term 1 LEADER]: Becoming Leader. State: Replica: 794a6410ae1d4fd0b18d4b444dfa2f51, State: Running, Role: LEADER
I20260809 20:11:40.719587 24287 consensus_queue.cc:237] T 00000000000000000000000000000000 P 794a6410ae1d4fd0b18d4b444dfa2f51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "794a6410ae1d4fd0b18d4b444dfa2f51" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 36305 } }
I20260809 20:11:40.720075 24280 sys_catalog.cc:564] T 00000000000000000000000000000000 P 794a6410ae1d4fd0b18d4b444dfa2f51 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:11:40.722146 24288 sys_catalog.cc:455] T 00000000000000000000000000000000 P 794a6410ae1d4fd0b18d4b444dfa2f51 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "794a6410ae1d4fd0b18d4b444dfa2f51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "794a6410ae1d4fd0b18d4b444dfa2f51" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 36305 } } }
I20260809 20:11:40.722496 24288 sys_catalog.cc:458] T 00000000000000000000000000000000 P 794a6410ae1d4fd0b18d4b444dfa2f51 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:40.728708 24291 sys_catalog.cc:455] T 00000000000000000000000000000000 P 794a6410ae1d4fd0b18d4b444dfa2f51 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 794a6410ae1d4fd0b18d4b444dfa2f51. Latest consensus state: current_term: 1 leader_uuid: "794a6410ae1d4fd0b18d4b444dfa2f51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "794a6410ae1d4fd0b18d4b444dfa2f51" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 36305 } } }
I20260809 20:11:40.729017 24291 sys_catalog.cc:458] T 00000000000000000000000000000000 P 794a6410ae1d4fd0b18d4b444dfa2f51 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:40.741843 24303 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:11:40.747048 24303 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:11:40.755594 24303 catalog_manager.cc:1347] Generated new cluster ID: e1b909e8ade54fb89fa14c33d6e9bb62
I20260809 20:11:40.755705 24303 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:11:40.769594 24303 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:11:40.770805 24303 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:11:40.776260 24303 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 794a6410ae1d4fd0b18d4b444dfa2f51: Generated new TSK 0
I20260809 20:11:40.776942 24303 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:11:40.816453 24284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:40.797868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33054 (local address 127.14.181.62:36305)
0809 20:11:40.798072 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:40.798078 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:40.798457 (+ 379us) server_negotiation.cc:407] Connection header received
0809 20:11:40.798666 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:40.798669 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:40.798737 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:40.798856 (+ 119us) server_negotiation.cc:226] Negotiated authn=JWT
0809 20:11:40.799384 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:40.800075 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:40.802073 (+ 1998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:40.802537 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:40.802629 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:40.803131 (+ 502us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 20:11:40.815982 (+ 12851us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 20:11:40.816227 (+ 245us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:33054: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":62}
W20260809 20:11:40.816567 24284 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:33054: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260809 20:11:40.817086 24327 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:11:40.797764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:36305 (local address 127.0.0.1:33054)
0809 20:11:40.798358 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:40.798378 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:40.798520 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:40.798889 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:40.798894 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:40.798908 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0809 20:11:40.799218 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:40.799232 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:40.800221 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:40.800227 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:40.801944 (+ 1717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:40.801960 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:40.802688 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:40.802696 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:40.802879 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:40.802925 (+ 46us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 20:11:40.816170 (+ 13245us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 20:11:40.816422 (+ 252us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.14.181.62:36305: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":293,"threads_started":1}
I20260809 20:11:40.818259 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 24169
I20260809 20:11:40.819245 24268 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:40.909479 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 24169
2026-08-09T20:11:40Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (673 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (390 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (385 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:11:41 dist-test-slave-6zbq krb5kdc[24356](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:11:41 dist-test-slave-6zbq krb5kdc[24356](info): set up 2 sockets
Aug 09 20:11:41 dist-test-slave-6zbq krb5kdc[24356](info): commencing operation
krb5kdc: starting...
W20260809 20:11:42.864372 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.141s user 0.000s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:11:42 dist-test-slave-6zbq krb5kdc[24356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306302, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:11:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:11:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:11:43.058442 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:44003
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:40277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:44003
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:43.358855 24377 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:43.359100 24377 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:43.359226 24377 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:43.366135 24377 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:11:43.366225 24377 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:43.366297 24377 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:43.366386 24377 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:11:43.366442 24377 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:11:43.375581 24377 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:40277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:44003
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:44003
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:43.376657 24377 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:43.377805 24377 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:43.388464 24389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:43.388542 24386 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:43.388505 24393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:43.389231 24377 server_base.cc:1034] running on GCE node
I20260809 20:11:43.389951 24377 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:43.391202 24377 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:43.392395 24377 hybrid_clock.cc:648] HybridClock initialized: now 1786306303392349 us; error 37 us; skew 500 ppm
I20260809 20:11:43.392696 24377 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:43 dist-test-slave-6zbq krb5kdc[24356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306303, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:43.395519 24377 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:11:43.396811 24377 webserver.cc:460] Webserver started at http://127.14.181.62:46651/ using document root <none> and password file <none>
I20260809 20:11:43.397410 24377 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:43.397521 24377 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:43.397797 24377 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:43.400507 24377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "fd8df6fa345842dba72ce06b321f6720"
format_stamp: "Formatted at 2026-08-09 20:11:43 on dist-test-slave-6zbq"
server_key: "bb896fd733cdbaae904e019d5474bf33"
server_key_iv: "5ac4262c3a3d68c77e6fec29e5c35b3c"
server_key_version: "encryptionkey@0"
I20260809 20:11:43.401232 24377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "fd8df6fa345842dba72ce06b321f6720"
format_stamp: "Formatted at 2026-08-09 20:11:43 on dist-test-slave-6zbq"
server_key: "bb896fd733cdbaae904e019d5474bf33"
server_key_iv: "5ac4262c3a3d68c77e6fec29e5c35b3c"
server_key_version: "encryptionkey@0"
I20260809 20:11:43.405778 24377 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.006s
I20260809 20:11:43.408855 24400 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:43.409984 24377 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 20:11:43.410125 24377 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "fd8df6fa345842dba72ce06b321f6720"
format_stamp: "Formatted at 2026-08-09 20:11:43 on dist-test-slave-6zbq"
server_key: "bb896fd733cdbaae904e019d5474bf33"
server_key_iv: "5ac4262c3a3d68c77e6fec29e5c35b3c"
server_key_version: "encryptionkey@0"
I20260809 20:11:43.410305 24377 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:43.433158 24377 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:43.436625 24377 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:43.436856 24377 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:43.452888 24377 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:44003
I20260809 20:11:43.452970 24477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:44003 every 8 connection(s)
I20260809 20:11:43.454034 24377 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:11:43.457231 24478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:43.463485 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 24377
I20260809 20:11:43.463688 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:11:43.464465 15060 external_mini_cluster.cc:1428] Setting key 91a345fd19e79084ba642bb77e5e9519
I20260809 20:11:43.467404 24478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd8df6fa345842dba72ce06b321f6720: Bootstrap starting.
I20260809 20:11:43.470266 24478 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd8df6fa345842dba72ce06b321f6720: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:43.471235 24478 log.cc:824] T 00000000000000000000000000000000 P fd8df6fa345842dba72ce06b321f6720: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:43.473728 24478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd8df6fa345842dba72ce06b321f6720: No bootstrap required, opened a new log
Aug 09 20:11:43 dist-test-slave-6zbq krb5kdc[24356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306302, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:43.482684 24478 raft_consensus.cc:348] T 00000000000000000000000000000000 P fd8df6fa345842dba72ce06b321f6720 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd8df6fa345842dba72ce06b321f6720" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 44003 } }
I20260809 20:11:43.483043 24478 raft_consensus.cc:374] T 00000000000000000000000000000000 P fd8df6fa345842dba72ce06b321f6720 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:43.483139 24478 raft_consensus.cc:729] T 00000000000000000000000000000000 P fd8df6fa345842dba72ce06b321f6720 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd8df6fa345842dba72ce06b321f6720, State: Initialized, Role: FOLLOWER
I20260809 20:11:43.483749 24478 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd8df6fa345842dba72ce06b321f6720 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd8df6fa345842dba72ce06b321f6720" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 44003 } }
I20260809 20:11:43.484006 24478 raft_consensus.cc:388] T 00000000000000000000000000000000 P fd8df6fa345842dba72ce06b321f6720 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:11:43.484157 24478 raft_consensus.cc:482] T 00000000000000000000000000000000 P fd8df6fa345842dba72ce06b321f6720 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:11:43.484347 24478 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fd8df6fa345842dba72ce06b321f6720 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:43.486884 24486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:43.466422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33900 (local address 127.14.181.62:44003)
0809 20:11:43.467132 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:43.467144 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:43.467180 (+ 36us) server_negotiation.cc:407] Connection header received
0809 20:11:43.468930 (+ 1750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:43.468951 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:43.469300 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:43.469616 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:43.471116 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:43.472740 (+ 1624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:43.473926 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:43.474942 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:43.475141 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:43.478907 (+ 3766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:43.478917 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:43.478935 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:43.478979 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:43.482692 (+ 3713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:43.483367 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:43.483374 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:43.483381 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:43.483581 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:43.483942 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:43.483948 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:43.483951 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:43.484626 (+ 675us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:43.484939 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:43.485221 (+ 282us) server_negotiation.cc:299] Negotiation successful
0809 20:11:43.485634 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":517,"thread_start_us":328,"threads_started":1}
I20260809 20:11:43.487428 24478 raft_consensus.cc:504] T 00000000000000000000000000000000 P fd8df6fa345842dba72ce06b321f6720 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd8df6fa345842dba72ce06b321f6720" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 44003 } }
I20260809 20:11:43.487951 24478 leader_election.cc:302] T 00000000000000000000000000000000 P fd8df6fa345842dba72ce06b321f6720 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fd8df6fa345842dba72ce06b321f6720; no voters:
I20260809 20:11:43.489363 24478 leader_election.cc:288] T 00000000000000000000000000000000 P fd8df6fa345842dba72ce06b321f6720 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:11:43.489485 24492 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fd8df6fa345842dba72ce06b321f6720 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:43.490485 24492 raft_consensus.cc:686] T 00000000000000000000000000000000 P fd8df6fa345842dba72ce06b321f6720 [term 1 LEADER]: Becoming Leader. State: Replica: fd8df6fa345842dba72ce06b321f6720, State: Running, Role: LEADER
I20260809 20:11:43.490948 24492 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd8df6fa345842dba72ce06b321f6720 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd8df6fa345842dba72ce06b321f6720" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 44003 } }
I20260809 20:11:43.491226 24478 sys_catalog.cc:564] T 00000000000000000000000000000000 P fd8df6fa345842dba72ce06b321f6720 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:11:43.493513 24493 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd8df6fa345842dba72ce06b321f6720 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd8df6fa345842dba72ce06b321f6720" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd8df6fa345842dba72ce06b321f6720" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 44003 } } }
I20260809 20:11:43.493501 24494 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd8df6fa345842dba72ce06b321f6720 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd8df6fa345842dba72ce06b321f6720. Latest consensus state: current_term: 1 leader_uuid: "fd8df6fa345842dba72ce06b321f6720" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd8df6fa345842dba72ce06b321f6720" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 44003 } } }
I20260809 20:11:43.494007 24493 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd8df6fa345842dba72ce06b321f6720 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:43.494045 24494 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd8df6fa345842dba72ce06b321f6720 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:43.494943 24505 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:11:43.500723 24505 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:11:43.508226 24505 catalog_manager.cc:1347] Generated new cluster ID: e6d505072c684c6bb15246410d268215
I20260809 20:11:43.508329 24505 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:11:43.523530 24505 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:11:43.524695 24505 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:11:43.533944 24505 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fd8df6fa345842dba72ce06b321f6720: Generated new TSK 0
I20260809 20:11:43.534641 24505 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.181.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
I20260809 20:11:43.586709 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:0
--local_ip_for_outbound_sockets=127.14.181.1
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:44003
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:40277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:43.910183 24527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:43.910480 24527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:43.910630 24527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:43.917536 24527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:43.917622 24527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:43.917732 24527 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:11:43.927071 24527 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:40277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:44003
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:43.928073 24527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:43.929217 24527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:43.941107 24537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:43.941143 24540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:43.941172 24535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:43.942067 24527 server_base.cc:1034] running on GCE node
I20260809 20:11:43.942658 24527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:43.943513 24527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:43.944700 24527 hybrid_clock.cc:648] HybridClock initialized: now 1786306303944646 us; error 44 us; skew 500 ppm
I20260809 20:11:43.944972 24527 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:43 dist-test-slave-6zbq krb5kdc[24356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306303, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:43.947896 24527 init.cc:377] Logged in from keytab as kudu/127.14.181.1@KRBTEST.COM (short username kudu)
I20260809 20:11:43.949144 24527 webserver.cc:460] Webserver started at http://127.14.181.1:46203/ using document root <none> and password file <none>
I20260809 20:11:43.949733 24527 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:43.949844 24527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:43.950109 24527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:43.952817 24527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-0/data/instance:
uuid: "ac5fd99036b44d22aebec2c79371d283"
format_stamp: "Formatted at 2026-08-09 20:11:43 on dist-test-slave-6zbq"
server_key: "044a421ce97c84e3cbdf5b68209287cf"
server_key_iv: "03c6f6f0b55048c955564b512cc28ce1"
server_key_version: "encryptionkey@0"
I20260809 20:11:43.953526 24527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance:
uuid: "ac5fd99036b44d22aebec2c79371d283"
format_stamp: "Formatted at 2026-08-09 20:11:43 on dist-test-slave-6zbq"
server_key: "044a421ce97c84e3cbdf5b68209287cf"
server_key_iv: "03c6f6f0b55048c955564b512cc28ce1"
server_key_version: "encryptionkey@0"
I20260809 20:11:43.958166 24527 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 20:11:43.961287 24553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:43.962565 24527 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 20:11:43.962700 24527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "ac5fd99036b44d22aebec2c79371d283"
format_stamp: "Formatted at 2026-08-09 20:11:43 on dist-test-slave-6zbq"
server_key: "044a421ce97c84e3cbdf5b68209287cf"
server_key_iv: "03c6f6f0b55048c955564b512cc28ce1"
server_key_version: "encryptionkey@0"
I20260809 20:11:43.962869 24527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:43.975041 24527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:43.978884 24527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:43.979156 24527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:43.979980 24527 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:11:43.981186 24527 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:43.981261 24527 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:43.981372 24527 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:43.981424 24527 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:44.010613 24527 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:44403
I20260809 20:11:44.010651 24723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:44403 every 8 connection(s)
I20260809 20:11:44.011854 24527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:11:44.015702 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 24527
I20260809 20:11:44.015920 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance
I20260809 20:11:44.016750 15060 external_mini_cluster.cc:1428] Setting key 2e606836c356aec9e1f571420ab8ade5
Aug 09 20:11:44 dist-test-slave-6zbq krb5kdc[24356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306303, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:44.032236 24727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:44.014287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:36365 (local address 127.14.181.62:44003)
0809 20:11:44.014763 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:44.014769 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:44.018163 (+ 3394us) server_negotiation.cc:407] Connection header received
0809 20:11:44.018222 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:44.018226 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:44.018289 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:44.018407 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:44.019925 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:44.020977 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:44.022917 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:44.023338 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:44.023448 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:44.026653 (+ 3205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:44.026658 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:44.026661 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:44.026691 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:44.029378 (+ 2687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:44.030042 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:44.030046 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:44.030048 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:44.030162 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:44.030602 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:44.030605 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:44.030607 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:44.030880 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:44.031011 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:44.031675 (+ 664us) server_negotiation.cc:299] Negotiation successful
0809 20:11:44.031887 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":240,"threads_started":1}
I20260809 20:11:44.033080 24732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:44.014895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:44003 (local address 127.14.181.1:36365)
0809 20:11:44.015721 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:44.015776 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:44.017911 (+ 2135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:44.018672 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:44.018682 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:44.019225 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:44.019753 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:44.019771 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:44.021191 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:44.021197 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:44.022782 (+ 1585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:44.022795 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:44.023553 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:44.023560 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:44.023780 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:44.024370 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:44.024393 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:44.026459 (+ 2066us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:44.029503 (+ 3044us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:44.029512 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:44.029526 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:44.029924 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:44.030260 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:44.030265 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:44.030269 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:44.030489 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:44.031001 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:44.031009 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:44.031326 (+ 317us) client_negotiation.cc:769] Sending connection context
0809 20:11:44.031542 (+ 216us) client_negotiation.cc:240] Negotiation successful
0809 20:11:44.032021 (+ 479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":306,"threads_started":1}
I20260809 20:11:44.034564 24725 heartbeater.cc:347] Connected to a master server at 127.14.181.62:44003
I20260809 20:11:44.034881 24725 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:44.035745 24725 heartbeater.cc:511] Master 127.14.181.62:44003 requested a full tablet report, sending...
I20260809 20:11:44.037794 24425 ts_manager.cc:194] Registered new tserver with Master: ac5fd99036b44d22aebec2c79371d283 (127.14.181.1:44403)
WARNING: no policy specified for kudu/127.14.181.2@KRBTEST.COM; defaulting to no policy
I20260809 20:11:44.039248 24425 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.1@KRBTEST.COM'} at 127.14.181.1:36365
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
I20260809 20:11:44.062842 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:0
--local_ip_for_outbound_sockets=127.14.181.2
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:44003
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:40277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:44.364746 24736 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:44.364974 24736 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:44.365059 24736 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:44.371999 24736 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:44.372089 24736 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:44.372208 24736 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:11:44.381136 24736 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:40277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:44003
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:44.382143 24736 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:44.383330 24736 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:44.395154 24746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:44.395355 24750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:44.395356 24753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:44.396096 24736 server_base.cc:1034] running on GCE node
I20260809 20:11:44.396617 24736 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:44.397440 24736 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:44.398634 24736 hybrid_clock.cc:648] HybridClock initialized: now 1786306304398579 us; error 40 us; skew 500 ppm
I20260809 20:11:44.398904 24736 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:44 dist-test-slave-6zbq krb5kdc[24356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306304, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:44.405961 24736 init.cc:377] Logged in from keytab as kudu/127.14.181.2@KRBTEST.COM (short username kudu)
I20260809 20:11:44.407236 24736 webserver.cc:460] Webserver started at http://127.14.181.2:38711/ using document root <none> and password file <none>
I20260809 20:11:44.407831 24736 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:44.407944 24736 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:44.408222 24736 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:44.410961 24736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-1/data/instance:
uuid: "c391f73432ba4c1fb52fbb0a3d260ae2"
format_stamp: "Formatted at 2026-08-09 20:11:44 on dist-test-slave-6zbq"
server_key: "06f3ede7ab31496c43fd2a7f39fae39d"
server_key_iv: "8b502ee46893deca9bdf0b1c153d25ba"
server_key_version: "encryptionkey@0"
I20260809 20:11:44.411692 24736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance:
uuid: "c391f73432ba4c1fb52fbb0a3d260ae2"
format_stamp: "Formatted at 2026-08-09 20:11:44 on dist-test-slave-6zbq"
server_key: "06f3ede7ab31496c43fd2a7f39fae39d"
server_key_iv: "8b502ee46893deca9bdf0b1c153d25ba"
server_key_version: "encryptionkey@0"
I20260809 20:11:44.416313 24736 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260809 20:11:44.419410 24761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:44.420526 24736 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:11:44.420671 24736 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "c391f73432ba4c1fb52fbb0a3d260ae2"
format_stamp: "Formatted at 2026-08-09 20:11:44 on dist-test-slave-6zbq"
server_key: "06f3ede7ab31496c43fd2a7f39fae39d"
server_key_iv: "8b502ee46893deca9bdf0b1c153d25ba"
server_key_version: "encryptionkey@0"
I20260809 20:11:44.420840 24736 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:44.443207 24736 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:44.446981 24736 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:44.447219 24736 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:44.448040 24736 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:11:44.449203 24736 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:44.449281 24736 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:44.449393 24736 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:44.449445 24736 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:44.480861 24736 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:38875
I20260809 20:11:44.480907 24944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:38875 every 8 connection(s)
I20260809 20:11:44.482034 24736 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:11:44.490115 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 24736
I20260809 20:11:44.490267 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance
I20260809 20:11:44.490729 15060 external_mini_cluster.cc:1428] Setting key 2cd9c7cd811b634669d7005513d0c9b7
Aug 09 20:11:44 dist-test-slave-6zbq krb5kdc[24356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306304, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:44.500587 24727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:44.484361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:50255 (local address 127.14.181.62:44003)
0809 20:11:44.484554 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:44.484560 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:44.485704 (+ 1144us) server_negotiation.cc:407] Connection header received
0809 20:11:44.487449 (+ 1745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:44.487453 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:44.487522 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:44.487605 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:44.488957 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:44.489664 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:44.491257 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:44.491682 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:44.491803 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:44.495312 (+ 3509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:44.495317 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:44.495321 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:44.495352 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:44.497739 (+ 2387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:44.498552 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:44.498556 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:44.498559 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:44.498693 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:44.499109 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:44.499112 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:44.499114 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:44.499362 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:44.499469 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:44.500183 (+ 714us) server_negotiation.cc:299] Negotiation successful
0809 20:11:44.500359 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 20:11:44.501724 24949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:44.484848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:44003 (local address 127.14.181.2:50255)
0809 20:11:44.485538 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:44.485580 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:44.487217 (+ 1637us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:44.487789 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:44.487797 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:44.488288 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:44.488830 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:44.488847 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:44.489774 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:44.489778 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:44.491126 (+ 1348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:44.491138 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:44.491861 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:44.491867 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:44.492083 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:44.492704 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:44.492726 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:44.495113 (+ 2387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:44.497869 (+ 2756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:44.497878 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:44.497892 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:44.498437 (+ 545us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:44.498791 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:44.498795 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:44.498798 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:44.499020 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:44.499470 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:44.499477 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:44.499859 (+ 382us) client_negotiation.cc:769] Sending connection context
0809 20:11:44.500121 (+ 262us) client_negotiation.cc:240] Negotiation successful
0809 20:11:44.500569 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":273,"threads_started":1}
I20260809 20:11:44.502980 24945 heartbeater.cc:347] Connected to a master server at 127.14.181.62:44003
I20260809 20:11:44.503255 24945 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:44.503882 24945 heartbeater.cc:511] Master 127.14.181.62:44003 requested a full tablet report, sending...
I20260809 20:11:44.505190 24425 ts_manager.cc:194] Registered new tserver with Master: c391f73432ba4c1fb52fbb0a3d260ae2 (127.14.181.2:38875)
I20260809 20:11:44.505952 24425 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.2@KRBTEST.COM'} at 127.14.181.2:50255
WARNING: no policy specified for kudu/127.14.181.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
I20260809 20:11:44.535547 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:0
--local_ip_for_outbound_sockets=127.14.181.3
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:44003
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:40277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:44.840512 24953 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:44.840739 24953 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:44.840826 24953 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:44.847622 24953 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:44.847710 24953 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:44.847820 24953 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:11:44.856958 24953 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:40277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:44003
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:44.857978 24953 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:44.859172 24953 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:44.871179 24958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:44.871206 24959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:44.871237 24961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:44.871918 24953 server_base.cc:1034] running on GCE node
I20260809 20:11:44.872447 24953 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:44.873236 24953 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:44.874419 24953 hybrid_clock.cc:648] HybridClock initialized: now 1786306304874370 us; error 44 us; skew 500 ppm
I20260809 20:11:44.874691 24953 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:44 dist-test-slave-6zbq krb5kdc[24356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306304, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:44.877470 24953 init.cc:377] Logged in from keytab as kudu/127.14.181.3@KRBTEST.COM (short username kudu)
I20260809 20:11:44.878788 24953 webserver.cc:460] Webserver started at http://127.14.181.3:39581/ using document root <none> and password file <none>
I20260809 20:11:44.879367 24953 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:44.879482 24953 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:44.879755 24953 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:44.882460 24953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-2/data/instance:
uuid: "ff25fab58b7d4e68b7c40aee1a264329"
format_stamp: "Formatted at 2026-08-09 20:11:44 on dist-test-slave-6zbq"
server_key: "2cad0e09f4310d8c21054fa42f5ac177"
server_key_iv: "96f077719b52aff02f4009b0f08e3fa0"
server_key_version: "encryptionkey@0"
I20260809 20:11:44.883174 24953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance:
uuid: "ff25fab58b7d4e68b7c40aee1a264329"
format_stamp: "Formatted at 2026-08-09 20:11:44 on dist-test-slave-6zbq"
server_key: "2cad0e09f4310d8c21054fa42f5ac177"
server_key_iv: "96f077719b52aff02f4009b0f08e3fa0"
server_key_version: "encryptionkey@0"
I20260809 20:11:44.887800 24953 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260809 20:11:44.890834 24968 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:44.892113 24953 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 20:11:44.892270 24953 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "ff25fab58b7d4e68b7c40aee1a264329"
format_stamp: "Formatted at 2026-08-09 20:11:44 on dist-test-slave-6zbq"
server_key: "2cad0e09f4310d8c21054fa42f5ac177"
server_key_iv: "96f077719b52aff02f4009b0f08e3fa0"
server_key_version: "encryptionkey@0"
I20260809 20:11:44.892441 24953 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:44.914489 24953 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:44.917889 24953 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:44.918111 24953 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:44.918962 24953 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:11:44.920099 24953 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:44.920176 24953 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:44.920259 24953 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:44.920301 24953 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:44.948556 24953 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:38299
I20260809 20:11:44.948616 25156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:38299 every 8 connection(s)
I20260809 20:11:44.949656 24953 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:11:44.952148 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 24953
I20260809 20:11:44.952293 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance
I20260809 20:11:44.952699 15060 external_mini_cluster.cc:1428] Setting key 06872423de1b27a60b2f658e0570eb5d
Aug 09 20:11:44 dist-test-slave-6zbq krb5kdc[24356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306304, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:11:44.967945 24727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:44.951853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:35939 (local address 127.14.181.62:44003)
0809 20:11:44.952060 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:44.952067 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:44.953300 (+ 1233us) server_negotiation.cc:407] Connection header received
0809 20:11:44.955108 (+ 1808us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:44.955114 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:44.955192 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:44.955275 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:44.956644 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:44.957396 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:44.958892 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:44.959289 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:44.959396 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:44.962599 (+ 3203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:44.962606 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:44.962609 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:44.962642 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:44.964951 (+ 2309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:44.965664 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:44.965668 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:44.965670 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:44.965808 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:44.966226 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:44.966230 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:44.966233 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:44.966603 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:44.966752 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:44.967548 (+ 796us) server_negotiation.cc:299] Negotiation successful
0809 20:11:44.967711 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 20:11:44.968777 25160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:44.952360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:44003 (local address 127.14.181.3:35939)
0809 20:11:44.953147 (+ 787us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:44.953190 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:44.954855 (+ 1665us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:44.955500 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:44.955507 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:44.955981 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:44.956487 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:44.956503 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:44.957533 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:44.957538 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:44.958758 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:44.958771 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:44.959491 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:44.959499 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:44.959732 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:44.960300 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:44.960321 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:44.962336 (+ 2015us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:44.965076 (+ 2740us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:44.965083 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:44.965093 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:44.965535 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:44.965914 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:44.965919 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:44.965922 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:44.966134 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:44.966723 (+ 589us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:44.966731 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:44.967139 (+ 408us) client_negotiation.cc:769] Sending connection context
0809 20:11:44.967418 (+ 279us) client_negotiation.cc:240] Negotiation successful
0809 20:11:44.967820 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":317,"threads_started":1}
I20260809 20:11:44.969866 25158 heartbeater.cc:347] Connected to a master server at 127.14.181.62:44003
I20260809 20:11:44.970120 25158 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:44.970839 25158 heartbeater.cc:511] Master 127.14.181.62:44003 requested a full tablet report, sending...
I20260809 20:11:44.972036 24425 ts_manager.cc:194] Registered new tserver with Master: ff25fab58b7d4e68b7c40aee1a264329 (127.14.181.3:38299)
I20260809 20:11:44.972776 24425 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.3@KRBTEST.COM'} at 127.14.181.3:35939
I20260809 20:11:44.979286 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/test-admin.keytab.
Aug 09 20:11:45 dist-test-slave-6zbq krb5kdc[24356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306305, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:45.006554 15060 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260809 20:11:45.011441 25169 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:11:45.008909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57364 (local address 127.14.181.1:44403)
0809 20:11:45.009493 (+ 584us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:45.009501 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:45.009581 (+ 80us) server_negotiation.cc:407] Connection header received
0809 20:11:45.009665 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:45.009672 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:45.009910 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:45.010061 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:45.011033 (+ 972us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57364: BlockingRecv error: recv got EOF from 127.0.0.1:57364 (error 108)
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":276,"threads_started":1}
W20260809 20:11:45.011538 15060 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/krb5cc' of type FILE
Aug 09 20:11:45 dist-test-slave-6zbq krb5kdc[24356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306305, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:45.013057 15060 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 20:11:45 dist-test-slave-6zbq krb5kdc[24356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306305, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:45.014467 15060 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 20:11:45 dist-test-slave-6zbq krb5kdc[24356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306305, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.1@KRBTEST.COM
I20260809 20:11:45.028267 25169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:45.015943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57366 (local address 127.14.181.1:44403)
0809 20:11:45.016108 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:45.016113 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:45.016328 (+ 215us) server_negotiation.cc:407] Connection header received
0809 20:11:45.016496 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:45.016500 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:45.016554 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:45.016628 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:45.017583 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:45.018563 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:45.019751 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:45.020243 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:45.020361 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:45.023598 (+ 3237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:45.023609 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:45.023620 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:45.023649 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:45.026078 (+ 2429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:45.026695 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:45.026701 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:45.026703 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:45.026820 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:45.027126 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:45.027129 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:45.027131 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:45.027434 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:45.027638 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:45.027871 (+ 233us) server_negotiation.cc:299] Negotiation successful
0809 20:11:45.028043 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260809 20:11:45.033144 25169 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:11:45.031535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57368 (local address 127.14.181.1:44403)
0809 20:11:45.031709 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:45.031715 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:45.031966 (+ 251us) server_negotiation.cc:407] Connection header received
0809 20:11:45.032101 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:45.032106 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:45.032173 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:45.032246 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:45.032955 (+ 709us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57368: BlockingRecv error: recv got EOF from 127.0.0.1:57368 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260809 20:11:45.033309 15060 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/krb5cc' of type FILE
Aug 09 20:11:45 dist-test-slave-6zbq krb5kdc[24356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306305, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:45.034628 15060 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 20:11:45 dist-test-slave-6zbq krb5kdc[24356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306305, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:45.035758 15060 init.cc:295] Successfully reacquired a new kerberos TGT
I20260809 20:11:45.042100 24725 heartbeater.cc:503] Master 127.14.181.62:44003 was elected leader, sending a full tablet report...
Aug 09 20:11:45 dist-test-slave-6zbq krb5kdc[24356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306305, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.1@KRBTEST.COM
I20260809 20:11:45.048408 25169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:45.036805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57384 (local address 127.14.181.1:44403)
0809 20:11:45.036946 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:45.036951 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:45.037234 (+ 283us) server_negotiation.cc:407] Connection header received
0809 20:11:45.037355 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:45.037359 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:45.037410 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:45.037486 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:45.038408 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:45.039052 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:45.040192 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:45.040583 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:45.040691 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:45.044005 (+ 3314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:45.044010 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:45.044013 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:45.044039 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:45.046146 (+ 2107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:45.046783 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:45.046787 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:45.046789 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:45.046900 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:45.047240 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:45.047245 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:45.047259 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:45.047503 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:45.047733 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:45.048009 (+ 276us) server_negotiation.cc:299] Negotiation successful
0809 20:11:45.048185 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260809 20:11:45.051950 25169 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:11:45.050583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57398 (local address 127.14.181.1:44403)
0809 20:11:45.050733 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:45.050738 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:45.050894 (+ 156us) server_negotiation.cc:407] Connection header received
0809 20:11:45.051022 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:45.051027 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:45.051094 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:45.051170 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:45.051768 (+ 598us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57398: BlockingRecv error: recv got EOF from 127.0.0.1:57398 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260809 20:11:45.052098 15060 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786306256699363-15060-0/krb5kdc/krb5cc' of type FILE
Aug 09 20:11:45 dist-test-slave-6zbq krb5kdc[24356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306305, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:45.053359 15060 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 20:11:45 dist-test-slave-6zbq krb5kdc[24356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306305, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:45.054479 15060 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 20:11:45 dist-test-slave-6zbq krb5kdc[24356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306305, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.1@KRBTEST.COM
I20260809 20:11:45.066095 25169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:45.055504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57414 (local address 127.14.181.1:44403)
0809 20:11:45.055661 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:45.055666 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:45.055903 (+ 237us) server_negotiation.cc:407] Connection header received
0809 20:11:45.055990 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:45.055993 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:45.056038 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:45.056111 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:45.056873 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:45.057510 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:45.058630 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:45.059004 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:45.059084 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:45.062007 (+ 2923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:45.062011 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:45.062014 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:45.062040 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:45.064134 (+ 2094us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:45.064631 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:45.064634 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:45.064636 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:45.064745 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:45.064999 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:45.065001 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:45.065003 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:45.065228 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:45.065424 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:45.065633 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 20:11:45.065782 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 20:11:45.067476 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 24527
I20260809 20:11:45.077133 25169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:45.068070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57418 (local address 127.14.181.1:44403)
0809 20:11:45.068217 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:45.068222 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:45.068482 (+ 260us) server_negotiation.cc:407] Connection header received
0809 20:11:45.068570 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:45.068573 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:45.068621 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:45.068688 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:45.069444 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:45.070039 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:45.071154 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:45.071515 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:45.071605 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:45.073217 (+ 1612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:45.073222 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:45.073225 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:45.073250 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:45.075289 (+ 2039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:45.075791 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:45.075794 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:45.075796 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:45.075900 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:45.076169 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:45.076172 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:45.076174 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:45.076370 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:45.076539 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:45.076736 (+ 197us) server_negotiation.cc:299] Negotiation successful
0809 20:11:45.076867 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 20:11:45.077582 24717 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:45.158453 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 24527
I20260809 20:11:45.182078 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 24736
Aug 09 20:11:45 dist-test-slave-6zbq krb5kdc[24356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306305, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.2@KRBTEST.COM
I20260809 20:11:45.196580 25190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:45.182880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48460 (local address 127.14.181.2:38875)
0809 20:11:45.183418 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:45.183425 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:45.183451 (+ 26us) server_negotiation.cc:407] Connection header received
0809 20:11:45.183511 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:45.183518 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:45.183712 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:45.183837 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:45.184741 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:45.185745 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:45.187212 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:45.187741 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:45.187836 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:45.191322 (+ 3486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:45.191334 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:45.191347 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:45.191386 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:45.194016 (+ 2630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:45.194713 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:45.194719 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:45.194722 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:45.194856 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:45.195194 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:45.195197 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:45.195199 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:45.195557 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:45.195780 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:45.196053 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 20:11:45.196302 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":260,"threads_started":1}
I20260809 20:11:45.197788 24936 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:45.276515 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 24736
I20260809 20:11:45.293459 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 24953
Aug 09 20:11:45 dist-test-slave-6zbq krb5kdc[24356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306305, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.3@KRBTEST.COM
I20260809 20:11:45.307930 25192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:45.294431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58416 (local address 127.14.181.3:38299)
0809 20:11:45.295123 (+ 692us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:45.295132 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:45.295168 (+ 36us) server_negotiation.cc:407] Connection header received
0809 20:11:45.295228 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:45.295234 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:45.295456 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:45.295593 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:45.296696 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:45.297700 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:45.298950 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:45.299490 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:45.299584 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:45.303158 (+ 3574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:45.303169 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:45.303181 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:45.303217 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:45.305719 (+ 2502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:45.306256 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:45.306262 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:45.306264 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:45.306416 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:45.306720 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:45.306723 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:45.306725 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:45.307051 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:45.307279 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:45.307454 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 20:11:45.307644 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":529,"thread_start_us":364,"threads_started":1}
I20260809 20:11:45.309070 25146 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:45.388433 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 24953
I20260809 20:11:45.405185 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 24377
I20260809 20:11:45.406296 24471 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:45.504937 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 24377
2026-08-09T20:11:45Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (3822 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:11:45 dist-test-slave-6zbq krb5kdc[25201](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:11:45 dist-test-slave-6zbq krb5kdc[25201](info): set up 2 sockets
Aug 09 20:11:45 dist-test-slave-6zbq krb5kdc[25201](info): commencing operation
krb5kdc: starting...
W20260809 20:11:46.689008 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.143s user 0.003s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:11:46 dist-test-slave-6zbq krb5kdc[25201](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306306, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:11:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:11:46Z Disabled control of system clock
WARNING: no policy specified for oryx/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.62.keytab.
Entry for principal oryx/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.62.keytab.
I20260809 20:11:46.871336 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:39865
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.62.keytab
--principal=oryx/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:44749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:39865
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:47.177819 25221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:47.178085 25221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:47.178213 25221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:47.185226 25221 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:11:47.185326 25221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:47.185400 25221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:47.185470 25221 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:11:47.185530 25221 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:11:47.194809 25221 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:44749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:39865
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.62.keytab
--principal=oryx/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:39865
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:47.195956 25221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:47.197134 25221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:47.209523 25232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:47.209578 25227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:47.209975 25235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:47.210865 25221 server_base.cc:1034] running on GCE node
I20260809 20:11:47.211741 25221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:47.213335 25221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:47.214563 25221 hybrid_clock.cc:648] HybridClock initialized: now 1786306307214476 us; error 68 us; skew 500 ppm
I20260809 20:11:47.214944 25221 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:47 dist-test-slave-6zbq krb5kdc[25201](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306307, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:47.218600 25221 init.cc:377] Logged in from keytab as oryx/127.14.181.62@KRBTEST.COM (short username oryx)
I20260809 20:11:47.220229 25221 webserver.cc:460] Webserver started at http://127.14.181.62:40217/ using document root <none> and password file <none>
I20260809 20:11:47.221004 25221 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:47.221149 25221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:47.221473 25221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:47.225328 25221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "405a23adfdbb45138c47bfee654cc5a8"
format_stamp: "Formatted at 2026-08-09 20:11:47 on dist-test-slave-6zbq"
server_key: "6c13b9d07ac81600b7efd736ed314502"
server_key_iv: "ebc60a01da22b9ab206ac18b35a220b6"
server_key_version: "encryptionkey@0"
I20260809 20:11:47.226280 25221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "405a23adfdbb45138c47bfee654cc5a8"
format_stamp: "Formatted at 2026-08-09 20:11:47 on dist-test-slave-6zbq"
server_key: "6c13b9d07ac81600b7efd736ed314502"
server_key_iv: "ebc60a01da22b9ab206ac18b35a220b6"
server_key_version: "encryptionkey@0"
I20260809 20:11:47.232537 25221 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260809 20:11:47.235913 25246 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:47.237289 25221 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 20:11:47.237444 25221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "405a23adfdbb45138c47bfee654cc5a8"
format_stamp: "Formatted at 2026-08-09 20:11:47 on dist-test-slave-6zbq"
server_key: "6c13b9d07ac81600b7efd736ed314502"
server_key_iv: "ebc60a01da22b9ab206ac18b35a220b6"
server_key_version: "encryptionkey@0"
I20260809 20:11:47.237607 25221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:47.269997 25221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:47.273841 25221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:47.274097 25221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:47.290324 25221 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:39865
I20260809 20:11:47.290396 25324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:39865 every 8 connection(s)
I20260809 20:11:47.291558 25221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:11:47.292341 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 25221
I20260809 20:11:47.292536 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:11:47.293256 15060 external_mini_cluster.cc:1428] Setting key 463993fa50e23c2a9dc5fd1cc71b6f28
I20260809 20:11:47.295686 25326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:47.305500 25326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8: Bootstrap starting.
Aug 09 20:11:47 dist-test-slave-6zbq krb5kdc[25201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306306, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM
I20260809 20:11:47.308647 25326 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:47.309654 25326 log.cc:824] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:47.312741 25326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8: No bootstrap required, opened a new log
I20260809 20:11:47.313604 25334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:47.295114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46066 (local address 127.14.181.62:39865)
0809 20:11:47.295841 (+ 727us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:47.295855 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:47.295894 (+ 39us) server_negotiation.cc:407] Connection header received
0809 20:11:47.297448 (+ 1554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:47.297468 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:47.297817 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:47.298160 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:47.299598 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:47.300897 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:47.302147 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:47.302869 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:47.303051 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:47.306802 (+ 3751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:47.306809 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:47.306822 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:47.306863 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:47.309723 (+ 2860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:47.310540 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:47.310548 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:47.310555 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:47.310771 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:47.311135 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:47.311138 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:47.311140 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:47.311612 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:47.311844 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:47.312267 (+ 423us) server_negotiation.cc:299] Negotiation successful
0809 20:11:47.312600 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":514,"thread_start_us":300,"threads_started":1}
I20260809 20:11:47.320568 25326 raft_consensus.cc:348] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } }
I20260809 20:11:47.320891 25326 raft_consensus.cc:374] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:47.320978 25326 raft_consensus.cc:729] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 405a23adfdbb45138c47bfee654cc5a8, State: Initialized, Role: FOLLOWER
I20260809 20:11:47.321492 25326 consensus_queue.cc:260] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } }
I20260809 20:11:47.321705 25326 raft_consensus.cc:388] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:11:47.321825 25326 raft_consensus.cc:482] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:11:47.321973 25326 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:47.323989 25326 raft_consensus.cc:504] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } }
I20260809 20:11:47.324477 25326 leader_election.cc:302] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 405a23adfdbb45138c47bfee654cc5a8; no voters:
I20260809 20:11:47.325042 25326 leader_election.cc:288] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:11:47.325155 25337 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:47.325745 25337 raft_consensus.cc:686] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [term 1 LEADER]: Becoming Leader. State: Replica: 405a23adfdbb45138c47bfee654cc5a8, State: Running, Role: LEADER
I20260809 20:11:47.326225 25337 consensus_queue.cc:237] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } }
I20260809 20:11:47.326937 25326 sys_catalog.cc:564] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:11:47.328655 25339 sys_catalog.cc:455] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 405a23adfdbb45138c47bfee654cc5a8. Latest consensus state: current_term: 1 leader_uuid: "405a23adfdbb45138c47bfee654cc5a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } }
I20260809 20:11:47.328684 25338 sys_catalog.cc:455] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "405a23adfdbb45138c47bfee654cc5a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } }
I20260809 20:11:47.329032 25338 sys_catalog.cc:458] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:47.329032 25339 sys_catalog.cc:458] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:47.336525 25342 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:11:47.341151 25342 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:11:47.349191 25342 catalog_manager.cc:1347] Generated new cluster ID: 2139cd6844304a8690178ebf4e4486c9
I20260809 20:11:47.349295 25342 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:11:47.362774 25342 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:11:47.363956 25342 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:11:47.377518 25342 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8: Generated new TSK 0
I20260809 20:11:47.378132 25342 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.14.181.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.181.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.181.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.1.keytab.
Entry for principal oryx/127.14.181.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.1.keytab.
I20260809 20:11:47.439064 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:0
--local_ip_for_outbound_sockets=127.14.181.1
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39865
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.1.keytab
--principal=oryx/127.14.181.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:44749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:47.769678 25369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:47.769923 25369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:47.770048 25369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:47.776980 25369 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:47.777091 25369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:47.777238 25369 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:11:47.786113 25369 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:44749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.1.keytab
--principal=oryx/127.14.181.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39865
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:47.787179 25369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:47.788367 25369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:47.800170 25383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:47.800243 25380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:47.800213 25379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:47.800886 25369 server_base.cc:1034] running on GCE node
I20260809 20:11:47.801436 25369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:47.802230 25369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:47.803416 25369 hybrid_clock.cc:648] HybridClock initialized: now 1786306307803382 us; error 46 us; skew 500 ppm
I20260809 20:11:47.803683 25369 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:47 dist-test-slave-6zbq krb5kdc[25201](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306307, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:47.806542 25369 init.cc:377] Logged in from keytab as oryx/127.14.181.1@KRBTEST.COM (short username oryx)
I20260809 20:11:47.807821 25369 webserver.cc:460] Webserver started at http://127.14.181.1:38529/ using document root <none> and password file <none>
I20260809 20:11:47.808418 25369 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:47.808530 25369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:47.808802 25369 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:47.811578 25369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/data/instance:
uuid: "788f6af08e2c478d8143aaabe2fd7cf6"
format_stamp: "Formatted at 2026-08-09 20:11:47 on dist-test-slave-6zbq"
server_key: "539c30774482c99f125418f95147fb56"
server_key_iv: "3315bbb87fa115ce6409fe346ab2e7e9"
server_key_version: "encryptionkey@0"
I20260809 20:11:47.812307 25369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance:
uuid: "788f6af08e2c478d8143aaabe2fd7cf6"
format_stamp: "Formatted at 2026-08-09 20:11:47 on dist-test-slave-6zbq"
server_key: "539c30774482c99f125418f95147fb56"
server_key_iv: "3315bbb87fa115ce6409fe346ab2e7e9"
server_key_version: "encryptionkey@0"
I20260809 20:11:47.817014 25369 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 20:11:47.820165 25394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:47.821349 25369 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 20:11:47.821484 25369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "788f6af08e2c478d8143aaabe2fd7cf6"
format_stamp: "Formatted at 2026-08-09 20:11:47 on dist-test-slave-6zbq"
server_key: "539c30774482c99f125418f95147fb56"
server_key_iv: "3315bbb87fa115ce6409fe346ab2e7e9"
server_key_version: "encryptionkey@0"
I20260809 20:11:47.821655 25369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:47.847834 25369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:47.851301 25369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:47.851542 25369 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:47.852366 25369 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:11:47.853547 25369 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:47.853623 25369 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:47.853735 25369 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:47.853796 25369 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:47.882849 25369 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:45009
I20260809 20:11:47.882894 25574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:45009 every 8 connection(s)
I20260809 20:11:47.884032 25369 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:11:47.890487 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 25369
I20260809 20:11:47.890667 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance
I20260809 20:11:47.891307 15060 external_mini_cluster.cc:1428] Setting key 79b61a5d6ea8e3b5387e32d37b6dd17c
Aug 09 20:11:47 dist-test-slave-6zbq krb5kdc[25201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306307, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM
I20260809 20:11:47.903985 25578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:47.886385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:60061 (local address 127.14.181.62:39865)
0809 20:11:47.886770 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:47.886774 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:47.887725 (+ 951us) server_negotiation.cc:407] Connection header received
0809 20:11:47.889806 (+ 2081us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:47.889813 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:47.889898 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:47.889992 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:47.891523 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:47.892444 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:47.894201 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:47.894836 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:47.894962 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:47.898203 (+ 3241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:47.898217 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:47.898221 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:47.898260 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:47.901226 (+ 2966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:47.901864 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:47.901870 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:47.901873 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:47.901989 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:47.902397 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:47.902402 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:47.902405 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:47.902653 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:47.902784 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:47.903422 (+ 638us) server_negotiation.cc:299] Negotiation successful
0809 20:11:47.903634 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":186,"threads_started":1}
I20260809 20:11:47.904762 25579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:47.886901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.14.181.1:60061)
0809 20:11:47.887579 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:47.887621 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:47.889541 (+ 1920us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:47.890223 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:47.890231 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:47.890805 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:47.891348 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:47.891365 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:47.892608 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:47.892613 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:47.894043 (+ 1430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:47.894061 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:47.895016 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:47.895021 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:47.895208 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:47.895794 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:47.895815 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:47.897996 (+ 2181us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:47.901348 (+ 3352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:47.901354 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:47.901364 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:47.901743 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:47.902089 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:47.902094 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:47.902098 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:47.902275 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:47.902787 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:47.902794 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:47.903075 (+ 281us) client_negotiation.cc:769] Sending connection context
0809 20:11:47.903294 (+ 219us) client_negotiation.cc:240] Negotiation successful
0809 20:11:47.903757 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":269,"threads_started":1}
I20260809 20:11:47.906062 25576 heartbeater.cc:347] Connected to a master server at 127.14.181.62:39865
I20260809 20:11:47.906397 25576 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:47.907238 25576 heartbeater.cc:511] Master 127.14.181.62:39865 requested a full tablet report, sending...
I20260809 20:11:47.909273 25273 ts_manager.cc:194] Registered new tserver with Master: 788f6af08e2c478d8143aaabe2fd7cf6 (127.14.181.1:45009)
I20260809 20:11:47.910674 25273 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.181.1@KRBTEST.COM'} at 127.14.181.1:60061
WARNING: no policy specified for oryx/127.14.181.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.181.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.181.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.2.keytab.
Entry for principal oryx/127.14.181.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.2.keytab.
I20260809 20:11:47.938664 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:0
--local_ip_for_outbound_sockets=127.14.181.2
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39865
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.2.keytab
--principal=oryx/127.14.181.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:44749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:48.237787 25586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:48.238025 25586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:48.238161 25586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:48.245087 25586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:48.245191 25586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:48.245345 25586 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:11:48.254228 25586 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:44749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.2.keytab
--principal=oryx/127.14.181.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39865
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:48.255262 25586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:48.256386 25586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:48.267935 25596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:48.267899 25594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:48.267974 25598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:48.268632 25586 server_base.cc:1034] running on GCE node
I20260809 20:11:48.269173 25586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:48.269991 25586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:48.271173 25586 hybrid_clock.cc:648] HybridClock initialized: now 1786306308271130 us; error 32 us; skew 500 ppm
I20260809 20:11:48.271435 25586 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:48 dist-test-slave-6zbq krb5kdc[25201](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306308, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:48.274250 25586 init.cc:377] Logged in from keytab as oryx/127.14.181.2@KRBTEST.COM (short username oryx)
I20260809 20:11:48.275489 25586 webserver.cc:460] Webserver started at http://127.14.181.2:44639/ using document root <none> and password file <none>
I20260809 20:11:48.276051 25586 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:48.276165 25586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:48.276437 25586 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:48.279237 25586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/data/instance:
uuid: "29f2635fb37e415382cbf8dece012472"
format_stamp: "Formatted at 2026-08-09 20:11:48 on dist-test-slave-6zbq"
server_key: "dfdb155b7364891909e254ac79e48b66"
server_key_iv: "8e125510eb0bb8809b0f44c7112e8077"
server_key_version: "encryptionkey@0"
I20260809 20:11:48.279943 25586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance:
uuid: "29f2635fb37e415382cbf8dece012472"
format_stamp: "Formatted at 2026-08-09 20:11:48 on dist-test-slave-6zbq"
server_key: "dfdb155b7364891909e254ac79e48b66"
server_key_iv: "8e125510eb0bb8809b0f44c7112e8077"
server_key_version: "encryptionkey@0"
I20260809 20:11:48.284564 25586 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 20:11:48.287608 25607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:48.288698 25586 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 20:11:48.288843 25586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "29f2635fb37e415382cbf8dece012472"
format_stamp: "Formatted at 2026-08-09 20:11:48 on dist-test-slave-6zbq"
server_key: "dfdb155b7364891909e254ac79e48b66"
server_key_iv: "8e125510eb0bb8809b0f44c7112e8077"
server_key_version: "encryptionkey@0"
I20260809 20:11:48.289005 25586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:48.306581 25586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:48.309872 25586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:48.310123 25586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:48.310992 25586 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:11:48.312220 25586 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:48.312296 25586 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:48.312412 25586 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:48.312463 25586 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:48.341830 25586 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:42403
I20260809 20:11:48.341900 25786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:42403 every 8 connection(s)
I20260809 20:11:48.343053 25586 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:11:48.343664 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 25586
I20260809 20:11:48.343838 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance
I20260809 20:11:48.344408 15060 external_mini_cluster.cc:1428] Setting key f5f13f71594ea33323c87e8653cea14c
Aug 09 20:11:48 dist-test-slave-6zbq krb5kdc[25201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306308, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM
I20260809 20:11:48.363694 25578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:48.345568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:59315 (local address 127.14.181.62:39865)
0809 20:11:48.345723 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:48.345727 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:48.347183 (+ 1456us) server_negotiation.cc:407] Connection header received
0809 20:11:48.349477 (+ 2294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:48.349480 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:48.349546 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:48.349628 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:48.351428 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:48.352146 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:48.354127 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:48.354580 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:48.354681 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:48.358367 (+ 3686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:48.358375 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:48.358380 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:48.358420 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:48.360789 (+ 2369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:48.361628 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:48.361631 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:48.361633 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:48.361746 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:48.362170 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:48.362173 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:48.362175 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:48.362462 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:48.362578 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:48.363291 (+ 713us) server_negotiation.cc:299] Negotiation successful
0809 20:11:48.363456 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 20:11:48.364985 25791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:48.346232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.14.181.2:59315)
0809 20:11:48.347022 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:48.347070 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:48.349186 (+ 2116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:48.349865 (+ 679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:48.349875 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:48.350542 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:48.351259 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:48.351294 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:48.352311 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:48.352316 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:48.354011 (+ 1695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:48.354025 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:48.354792 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:48.354799 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:48.355063 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:48.355708 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:48.355734 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:48.358060 (+ 2326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:48.360925 (+ 2865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:48.360933 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:48.360949 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:48.361531 (+ 582us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:48.361841 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:48.361845 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:48.361848 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:48.362070 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:48.362593 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:48.362601 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:48.362962 (+ 361us) client_negotiation.cc:769] Sending connection context
0809 20:11:48.363242 (+ 280us) client_negotiation.cc:240] Negotiation successful
0809 20:11:48.363731 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":285,"threads_started":1}
I20260809 20:11:48.366370 25787 heartbeater.cc:347] Connected to a master server at 127.14.181.62:39865
I20260809 20:11:48.366647 25787 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:48.367321 25787 heartbeater.cc:511] Master 127.14.181.62:39865 requested a full tablet report, sending...
I20260809 20:11:48.368670 25273 ts_manager.cc:194] Registered new tserver with Master: 29f2635fb37e415382cbf8dece012472 (127.14.181.2:42403)
WARNING: no policy specified for oryx/127.14.181.3@KRBTEST.COM; defaulting to no policy
I20260809 20:11:48.369442 25273 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.181.2@KRBTEST.COM'} at 127.14.181.2:59315
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.181.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.181.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.3.keytab.
Entry for principal oryx/127.14.181.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.3.keytab.
I20260809 20:11:48.394286 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:0
--local_ip_for_outbound_sockets=127.14.181.3
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39865
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.3.keytab
--principal=oryx/127.14.181.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:44749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:48.700012 25794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:48.700248 25794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:48.700335 25794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:48.707088 25794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:48.707185 25794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:48.707294 25794 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:11:48.716178 25794 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:44749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.3.keytab
--principal=oryx/127.14.181.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39865
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:48.717163 25794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:48.718284 25794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:48.730449 25803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:48.730487 25801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:48.730525 25805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:48.731181 25794 server_base.cc:1034] running on GCE node
I20260809 20:11:48.731753 25794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:48.732568 25794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:48.733765 25794 hybrid_clock.cc:648] HybridClock initialized: now 1786306308733715 us; error 46 us; skew 500 ppm
I20260809 20:11:48.734035 25794 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:48 dist-test-slave-6zbq krb5kdc[25201](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306308, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:48.736985 25794 init.cc:377] Logged in from keytab as oryx/127.14.181.3@KRBTEST.COM (short username oryx)
I20260809 20:11:48.738240 25794 webserver.cc:460] Webserver started at http://127.14.181.3:35549/ using document root <none> and password file <none>
I20260809 20:11:48.738842 25794 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:48.738953 25794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:48.739224 25794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:48.741894 25794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/data/instance:
uuid: "e03dd651846c4fedbe380653aad87fca"
format_stamp: "Formatted at 2026-08-09 20:11:48 on dist-test-slave-6zbq"
server_key: "4d1a0acd39fc2eb431fb18e50549f37c"
server_key_iv: "83647c8648ce5dc216e54c17c428bb3f"
server_key_version: "encryptionkey@0"
I20260809 20:11:48.742717 25794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance:
uuid: "e03dd651846c4fedbe380653aad87fca"
format_stamp: "Formatted at 2026-08-09 20:11:48 on dist-test-slave-6zbq"
server_key: "4d1a0acd39fc2eb431fb18e50549f37c"
server_key_iv: "83647c8648ce5dc216e54c17c428bb3f"
server_key_version: "encryptionkey@0"
I20260809 20:11:48.747359 25794 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 20:11:48.750434 25814 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:48.751591 25794 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 20:11:48.751744 25794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "e03dd651846c4fedbe380653aad87fca"
format_stamp: "Formatted at 2026-08-09 20:11:48 on dist-test-slave-6zbq"
server_key: "4d1a0acd39fc2eb431fb18e50549f37c"
server_key_iv: "83647c8648ce5dc216e54c17c428bb3f"
server_key_version: "encryptionkey@0"
I20260809 20:11:48.751916 25794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:48.767588 25794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:48.770977 25794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:48.771215 25794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:48.772033 25794 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:11:48.773228 25794 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:48.773303 25794 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:48.773454 25794 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:48.773516 25794 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:48.802601 25794 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:39471
I20260809 20:11:48.802654 26002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:39471 every 8 connection(s)
I20260809 20:11:48.803659 25794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:11:48.811492 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 25794
I20260809 20:11:48.811664 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance
I20260809 20:11:48.812235 15060 external_mini_cluster.cc:1428] Setting key 673020e713d6049e1bd132cf2f63d956
Aug 09 20:11:48 dist-test-slave-6zbq krb5kdc[25201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306308, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM
I20260809 20:11:48.821589 25578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:48.805816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:57143 (local address 127.14.181.62:39865)
0809 20:11:48.806005 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:48.806012 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:48.807122 (+ 1110us) server_negotiation.cc:407] Connection header received
0809 20:11:48.808761 (+ 1639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:48.808766 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:48.808834 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:48.808912 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:48.810191 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:48.810956 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:48.813098 (+ 2142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:48.813532 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:48.813620 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:48.817027 (+ 3407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:48.817032 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:48.817035 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:48.817068 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:48.819277 (+ 2209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:48.819879 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:48.819882 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:48.819884 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:48.819989 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:48.820311 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:48.820313 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:48.820315 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:48.820545 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:48.820651 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:48.821182 (+ 531us) server_negotiation.cc:299] Negotiation successful
0809 20:11:48.821351 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 20:11:48.822419 26006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:48.806283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.14.181.3:57143)
0809 20:11:48.806985 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:48.807019 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:48.808539 (+ 1520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:48.809092 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:48.809099 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:48.809557 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:48.810062 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:48.810079 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:48.811142 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:48.811148 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:48.812957 (+ 1809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:48.812975 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:48.813734 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:48.813742 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:48.814016 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:48.814694 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:48.814720 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:48.816858 (+ 2138us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:48.819401 (+ 2543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:48.819407 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:48.819417 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:48.819794 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:48.820058 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:48.820061 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:48.820064 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:48.820231 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:48.820633 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:48.820638 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:48.820899 (+ 261us) client_negotiation.cc:769] Sending connection context
0809 20:11:48.821121 (+ 222us) client_negotiation.cc:240] Negotiation successful
0809 20:11:48.821456 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":261,"threads_started":1}
I20260809 20:11:48.823591 26003 heartbeater.cc:347] Connected to a master server at 127.14.181.62:39865
I20260809 20:11:48.823843 26003 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:48.824518 26003 heartbeater.cc:511] Master 127.14.181.62:39865 requested a full tablet report, sending...
I20260809 20:11:48.825873 25273 ts_manager.cc:194] Registered new tserver with Master: e03dd651846c4fedbe380653aad87fca (127.14.181.3:39471)
I20260809 20:11:48.826864 25273 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.181.3@KRBTEST.COM'} at 127.14.181.3:57143
I20260809 20:11:48.827386 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.14.181.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.181.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.181.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.61.keytab.
Entry for principal oryx/127.14.181.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.61.keytab.
I20260809 20:11:48.872829 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.61:37669
--webserver_interface=127.14.181.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.61.keytab
--principal=oryx/127.14.181.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:44749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:39865,127.14.181.61:37669
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 20:11:48.913767 25576 heartbeater.cc:503] Master 127.14.181.62:39865 was elected leader, sending a full tablet report...
W20260809 20:11:49.193907 26011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:49.194165 26011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:49.194300 26011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:49.201135 26011 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:11:49.201246 26011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:49.201323 26011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:49.201401 26011 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:11:49.201467 26011 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:11:49.210886 26011 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:44749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:39865,127.14.181.61:37669
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.61.keytab
--principal=oryx/127.14.181.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.61:37669
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.14.181.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
W20260809 20:11:49.211192 26011 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.14.181.62:39865,127.14.181.61:37669'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260809 20:11:49.212077 26011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:49.213258 26011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:49.223820 26025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:49.223874 26022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:49.223922 26021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:49.225134 26011 server_base.cc:1034] running on GCE node
I20260809 20:11:49.225883 26011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:49.227178 26011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:49.228390 26011 hybrid_clock.cc:648] HybridClock initialized: now 1786306309228329 us; error 35 us; skew 500 ppm
I20260809 20:11:49.228685 26011 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:49 dist-test-slave-6zbq krb5kdc[25201](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306309, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:49.231573 26011 init.cc:377] Logged in from keytab as oryx/127.14.181.61@KRBTEST.COM (short username oryx)
I20260809 20:11:49.232820 26011 webserver.cc:460] Webserver started at http://127.14.181.61:38517/ using document root <none> and password file <none>
I20260809 20:11:49.233441 26011 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:49.233533 26011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:49.233826 26011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:49.236604 26011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-1/data/instance:
uuid: "ae4c504732ae4c32bc8e160ec9d1ac14"
format_stamp: "Formatted at 2026-08-09 20:11:49 on dist-test-slave-6zbq"
server_key: "16897effd43320b78e942b3f95291e6e"
server_key_iv: "248cabb3a89db6ec97fecfe117647805"
server_key_version: "encryptionkey@0"
I20260809 20:11:49.237311 26011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-1/wal/instance:
uuid: "ae4c504732ae4c32bc8e160ec9d1ac14"
format_stamp: "Formatted at 2026-08-09 20:11:49 on dist-test-slave-6zbq"
server_key: "16897effd43320b78e942b3f95291e6e"
server_key_iv: "248cabb3a89db6ec97fecfe117647805"
server_key_version: "encryptionkey@0"
I20260809 20:11:49.241916 26011 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260809 20:11:49.245328 26036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:49.246594 26011 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 20:11:49.246752 26011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-1/wal
uuid: "ae4c504732ae4c32bc8e160ec9d1ac14"
format_stamp: "Formatted at 2026-08-09 20:11:49 on dist-test-slave-6zbq"
server_key: "16897effd43320b78e942b3f95291e6e"
server_key_iv: "248cabb3a89db6ec97fecfe117647805"
server_key_version: "encryptionkey@0"
I20260809 20:11:49.246938 26011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:49.259406 26011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:49.262852 26011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:49.263067 26011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:49.278914 26011 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.61:37669
I20260809 20:11:49.278945 26117 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.61:37669 every 8 connection(s)
I20260809 20:11:49.280122 26011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-1/data/info.pb
I20260809 20:11:49.280594 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 26011
I20260809 20:11:49.284111 26118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:49.292223 26118 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 20:11:49 dist-test-slave-6zbq krb5kdc[25201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306306, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.181.61@KRBTEST.COM
Aug 09 20:11:49 dist-test-slave-6zbq krb5kdc[25201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306309, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.61@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM
I20260809 20:11:49.304337 26122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.282875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51474 (local address 127.14.181.61:37669)
0809 20:11:49.283627 (+ 752us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:49.283638 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:49.283676 (+ 38us) server_negotiation.cc:407] Connection header received
0809 20:11:49.285257 (+ 1581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:49.285278 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:49.285607 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:49.285897 (+ 290us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:49.287689 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.288978 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.290737 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.291716 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.291900 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:49.296801 (+ 4901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:49.296811 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:49.296823 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:49.296873 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:49.300385 (+ 3512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:49.301146 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:49.301152 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:49.301157 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:49.301345 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:49.301745 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:49.301748 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:49.301750 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:49.302272 (+ 522us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:49.302591 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:49.302914 (+ 323us) server_negotiation.cc:299] Negotiation successful
0809 20:11:49.303328 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":551,"thread_start_us":332,"threads_started":1}
I20260809 20:11:49.308861 25578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.294764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46076 (local address 127.14.181.62:39865)
0809 20:11:49.294939 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:49.294945 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:49.295578 (+ 633us) server_negotiation.cc:407] Connection header received
0809 20:11:49.295893 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:49.295899 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:49.295979 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:49.296092 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:49.297290 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.298184 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.299699 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.300123 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.300230 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:49.303770 (+ 3540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:49.303775 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:49.303778 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:49.303809 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:49.306590 (+ 2781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:49.307304 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:49.307308 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:49.307311 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:49.307441 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:49.307737 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:49.307739 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:49.307741 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:49.308028 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:49.308132 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:49.308508 (+ 376us) server_negotiation.cc:299] Negotiation successful
0809 20:11:49.308653 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 20:11:49.308913 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.294754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.0.0.1:46076)
0809 20:11:49.295459 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:49.295497 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:49.295693 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:49.296161 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:49.296168 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:49.296852 (+ 684us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:49.297139 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:49.297148 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.298326 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.298329 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:49.299560 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:49.299573 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.300302 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.300309 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:49.300459 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:49.300996 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:49.301018 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:49.303604 (+ 2586us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:49.306710 (+ 3106us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:49.306720 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:49.306726 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:49.307171 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:49.307523 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:49.307526 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:49.307528 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:49.307648 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:49.308145 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:49.308151 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:49.308301 (+ 150us) client_negotiation.cc:769] Sending connection context
0809 20:11:49.308441 (+ 140us) client_negotiation.cc:240] Negotiation successful
0809 20:11:49.308646 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":349,"threads_started":1}
I20260809 20:11:49.310546 26118 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 20:11:49 dist-test-slave-6zbq krb5kdc[25201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306309, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.61@KRBTEST.COM for oryx/127.14.181.61@KRBTEST.COM
I20260809 20:11:49.320919 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.311302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:37669 (local address 127.0.0.1:51486)
0809 20:11:49.311453 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:49.311468 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:49.311546 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:49.311778 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:49.311781 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:49.312065 (+ 284us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:49.312184 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:49.312191 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.313041 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.313045 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:49.313874 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:49.313884 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.314525 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.314530 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:49.314646 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:49.315058 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:49.315073 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:49.316771 (+ 1698us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:49.319136 (+ 2365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:49.319140 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:49.319143 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:49.319487 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:49.319790 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:49.319793 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:49.319796 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:49.319908 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:49.320304 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:49.320307 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:49.320419 (+ 112us) client_negotiation.cc:769] Sending connection context
0809 20:11:49.320517 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 20:11:49.320689 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 20:11:49.321117 26122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.311279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51486 (local address 127.14.181.61:37669)
0809 20:11:49.311432 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:49.311437 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:49.311517 (+ 80us) server_negotiation.cc:407] Connection header received
0809 20:11:49.311630 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:49.311633 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:49.311682 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:49.311748 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:49.312289 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.312928 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.313982 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.314403 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.314486 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:49.316919 (+ 2433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:49.316924 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:49.316927 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:49.316954 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:49.319030 (+ 2076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:49.319576 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:49.319579 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:49.319581 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:49.319690 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:49.319988 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:49.319991 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:49.319993 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:49.320218 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:49.320316 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:49.320602 (+ 286us) server_negotiation.cc:299] Negotiation successful
0809 20:11:49.320801 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":46}
I20260809 20:11:49.325348 26118 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14: Bootstrap starting.
I20260809 20:11:49.328246 26118 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:49.329171 26118 log.cc:824] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:49.331462 26118 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14: No bootstrap required, opened a new log
I20260809 20:11:49.338070 26118 raft_consensus.cc:348] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } }
I20260809 20:11:49.338367 26118 raft_consensus.cc:374] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:49.338472 26118 raft_consensus.cc:729] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae4c504732ae4c32bc8e160ec9d1ac14, State: Initialized, Role: FOLLOWER
I20260809 20:11:49.338963 26118 consensus_queue.cc:260] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } }
I20260809 20:11:49.339716 26128 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } } }
I20260809 20:11:49.340009 26128 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 20:11:49.340539 26118 sys_catalog.cc:564] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 20:11:49.349228 26142 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 20:11:49.349360 26142 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 20:11:49.352561 26011 master_runner.cc:428] Detected that this master ae4c504732ae4c32bc8e160ec9d1ac14 is joining an existing cluster
I20260809 20:11:49.352638 26011 master_runner.cc:432] Initiating AddMaster RPC to add 127.14.181.61:37669
I20260809 20:11:49.371675 25578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.356134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46088 (local address 127.14.181.62:39865)
0809 20:11:49.356310 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:49.356316 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:49.357052 (+ 736us) server_negotiation.cc:407] Connection header received
0809 20:11:49.357342 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:49.357347 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:49.357423 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:49.357482 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:49.359045 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.360075 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.361999 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.362554 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.362640 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:49.365205 (+ 2565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:49.365211 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:49.365215 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:49.365261 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:49.368743 (+ 3482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:49.369590 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:49.369595 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:49.369599 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:49.369755 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:49.370178 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:49.370183 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:49.370187 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:49.370511 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:49.370640 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:49.371116 (+ 476us) server_negotiation.cc:299] Negotiation successful
0809 20:11:49.371317 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 20:11:49.371731 25787 heartbeater.cc:503] Master 127.14.181.62:39865 was elected leader, sending a full tablet report...
I20260809 20:11:49.372044 26122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.356285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51502 (local address 127.14.181.61:37669)
0809 20:11:49.356454 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:49.356462 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:49.357877 (+ 1415us) server_negotiation.cc:407] Connection header received
0809 20:11:49.358096 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:49.358102 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:49.358171 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:49.358233 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:49.359607 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.360667 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.362664 (+ 1997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.363357 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.363453 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:49.365831 (+ 2378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:49.365837 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:49.365842 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:49.365874 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:49.369349 (+ 3475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:49.370125 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:49.370131 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:49.370134 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:49.370277 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:49.370668 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:49.370672 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:49.370675 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:49.371002 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:49.371127 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:49.371557 (+ 430us) server_negotiation.cc:299] Negotiation successful
0809 20:11:49.371755 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 20:11:49.372556 26151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.356206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.0.0.1:46088)
0809 20:11:49.356942 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:49.356965 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:49.357170 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:49.357682 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:49.357686 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:49.358404 (+ 718us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:49.358864 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:49.358887 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.360256 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.360262 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:49.361845 (+ 1583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:49.361860 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.362882 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.362887 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:49.363052 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:49.363677 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:49.363701 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:49.365009 (+ 1308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:49.368918 (+ 3909us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:49.368922 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:49.368925 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:49.369449 (+ 524us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:49.369907 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:49.369911 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:49.369915 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:49.370084 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:49.370619 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:49.370624 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:49.370814 (+ 190us) client_negotiation.cc:769] Sending connection context
0809 20:11:49.370977 (+ 163us) client_negotiation.cc:240] Negotiation successful
0809 20:11:49.371267 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":591,"mutex_wait_us":26,"spinlock_wait_cycles":13184,"thread_start_us":370,"threads_started":1}
I20260809 20:11:49.373075 26155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.356825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:37669 (local address 127.0.0.1:51502)
0809 20:11:49.357784 (+ 959us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:49.357807 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:49.357964 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:49.358435 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:49.358439 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:49.359136 (+ 697us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:49.359455 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:49.359468 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.360873 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.360881 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:49.362520 (+ 1639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:49.362540 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.363762 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.363769 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:49.363930 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:49.364509 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:49.364531 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:49.365650 (+ 1119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:49.369488 (+ 3838us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:49.369496 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:49.369500 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:49.370007 (+ 507us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:49.370429 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:49.370433 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:49.370436 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:49.370574 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:49.371199 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:49.371204 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:49.371337 (+ 133us) client_negotiation.cc:769] Sending connection context
0809 20:11:49.372437 (+ 1100us) client_negotiation.cc:240] Negotiation successful
0809 20:11:49.372723 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":821,"mutex_wait_us":29,"thread_start_us":364,"threads_started":1}
WARNING: no policy specified for oryx/127.14.181.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.181.60@KRBTEST.COM" created.
Aug 09 20:11:49 dist-test-slave-6zbq krb5kdc[25201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306307, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.62@KRBTEST.COM for oryx/127.14.181.61@KRBTEST.COM
I20260809 20:11:49.393115 26122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.378137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51504 (local address 127.14.181.61:37669)
0809 20:11:49.378277 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:49.378281 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:49.378825 (+ 544us) server_negotiation.cc:407] Connection header received
0809 20:11:49.379060 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:49.379065 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:49.379156 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:49.379232 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:49.380377 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.381049 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.382410 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.382936 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.383053 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:49.386850 (+ 3797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:49.386860 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:49.386865 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:49.386902 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:49.390092 (+ 3190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:49.390968 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:49.390973 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:49.390976 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:49.391127 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:49.391564 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:49.391568 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:49.391571 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:49.391885 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:49.392023 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:49.392578 (+ 555us) server_negotiation.cc:299] Negotiation successful
0809 20:11:49.392779 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 20:11:49.393198 26164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.378172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:37669 (local address 127.0.0.1:51504)
0809 20:11:49.378708 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:49.378743 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:49.378898 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:49.379320 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:49.379328 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:49.379961 (+ 633us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:49.380220 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:49.380232 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.381190 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.381195 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:49.382231 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:49.382245 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.383097 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.383103 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:49.383306 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:49.383887 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:49.383903 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:49.386654 (+ 2751us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:49.390234 (+ 3580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:49.390247 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:49.390255 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:49.390842 (+ 587us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:49.391247 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:49.391252 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:49.391255 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:49.391434 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:49.392032 (+ 598us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:49.392041 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:49.392244 (+ 203us) client_negotiation.cc:769] Sending connection context
0809 20:11:49.392446 (+ 202us) client_negotiation.cc:240] Negotiation successful
0809 20:11:49.392769 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":252,"threads_started":1}
I20260809 20:11:49.395273 25273 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.14.181.61:37669: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14"
member_type: NON_VOTER
last_known_addr {
host: "127.14.181.61"
port: 37669
}
attrs {
promote: true
}
}
dest_uuid: "405a23adfdbb45138c47bfee654cc5a8"
cas_config_opid_index: -1
I20260809 20:11:49.396667 25273 consensus_queue.cc:237] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: NON_VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: true } }
I20260809 20:11:49.404491 26071 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:49.404098 26176 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER ae4c504732ae4c32bc8e160ec9d1ac14 (127.14.181.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: NON_VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: true } } }
I20260809 20:11:49.408450 26071 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 1 FOLLOWER]: Refusing update from remote peer 405a23adfdbb45138c47bfee654cc5a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260809 20:11:49.408345 26176 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.14.181.61:37669
I20260809 20:11:49.409994 26176 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: NON_VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:11:49.410254 26011 master.cc:537] Master@127.14.181.61:37669 shutting down...
I20260809 20:11:49.415485 26174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "405a23adfdbb45138c47bfee654cc5a8" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: NON_VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: true } } }
I20260809 20:11:49.415910 26174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:49.424429 26011 raft_consensus.cc:2229] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:11:49.424824 26011 raft_consensus.cc:2258] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:49.425058 26011 tablet_replica.cc:330] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14: stopping tablet replica
W20260809 20:11:49.429170 25248 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from unknown peer (error 108)
I20260809 20:11:49.430894 26164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.430415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:37669 (local address 127.0.0.1:51512)
0809 20:11:49.430617 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:49.430744 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:37669: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260809 20:11:49.431124 25248 consensus_peers.cc:487] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 -> Peer ae4c504732ae4c32bc8e160ec9d1ac14 (127.14.181.61:37669): Couldn't send request to peer ae4c504732ae4c32bc8e160ec9d1ac14. Status: Network error: Client connection negotiation failed: client connection to 127.14.181.61:37669: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 20:11:49.431420 26011 master.cc:552] Master@127.14.181.61:37669 shutdown complete.
I20260809 20:11:49.431555 26011 master_runner.cc:305] Clearing existing system tablet
I20260809 20:11:49.432026 26011 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:49.432125 26011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.181.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.60.keytab.
Entry for principal oryx/127.14.181.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.60.keytab.
I20260809 20:11:49.433583 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.60:41321
--webserver_interface=127.14.181.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.60.keytab
--principal=oryx/127.14.181.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:44749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:39865,127.14.181.61:37669,127.14.181.60:41321
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 20:11:49.435216 26011 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:11:49.436794 26183 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:49.437170 26011 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:49.437556 26011 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 20:11:49.437695 26011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-1/wal
uuid: "ae4c504732ae4c32bc8e160ec9d1ac14"
format_stamp: "Formatted at 2026-08-09 20:11:49 on dist-test-slave-6zbq"
server_key: "16897effd43320b78e942b3f95291e6e"
server_key_iv: "248cabb3a89db6ec97fecfe117647805"
server_key_version: "encryptionkey@0"
I20260809 20:11:49.443174 26011 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:49.450064 26011 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 20:11:49.450237 26011 log.cc:1196] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260809 20:11:49.450728 26011 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14: Deleting consensus metadata
I20260809 20:11:49.451002 26011 master_runner.cc:315] Copying system tablet from 127.14.181.62:39865
I20260809 20:11:49.460258 26011 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14: tablet copy: Beginning tablet copy session from remote peer at address 127.14.181.62:39865
I20260809 20:11:49.484957 25578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.461506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46098 (local address 127.14.181.62:39865)
0809 20:11:49.461713 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:49.461719 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:49.466962 (+ 5243us) server_negotiation.cc:407] Connection header received
0809 20:11:49.467136 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:49.467142 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:49.467248 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:49.467356 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:49.468431 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.469495 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.471350 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.471932 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.472056 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:49.478560 (+ 6504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:49.478567 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:49.478572 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:49.478615 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:49.482003 (+ 3388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:49.482824 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:49.482830 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:49.482834 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:49.482988 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:49.483415 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:49.483420 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:49.483423 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:49.483778 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:49.483939 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:49.484372 (+ 433us) server_negotiation.cc:299] Negotiation successful
0809 20:11:49.484607 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 20:11:49.485025 26194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.461352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.0.0.1:46098)
0809 20:11:49.466825 (+ 5473us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:49.466846 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:49.467006 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:49.467407 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:49.467411 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:49.467957 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:49.468234 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:49.468248 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.469643 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.469650 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:49.471190 (+ 1540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:49.471206 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.472093 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.472099 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:49.472284 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:49.477240 (+ 4956us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:49.477266 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:49.478315 (+ 1049us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:49.482141 (+ 3826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:49.482147 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:49.482151 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:49.482676 (+ 525us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:49.483106 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:49.483111 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:49.483115 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:49.483289 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:49.483899 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:49.483905 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:49.484082 (+ 177us) client_negotiation.cc:769] Sending connection context
0809 20:11:49.484240 (+ 158us) client_negotiation.cc:240] Negotiation successful
0809 20:11:49.484568 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5311,"thread_start_us":5190,"threads_started":1}
I20260809 20:11:49.486310 25301 tablet_copy_service.cc:140] P 405a23adfdbb45138c47bfee654cc5a8: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer ae4c504732ae4c32bc8e160ec9d1ac14 ({username='oryx', principal='oryx/127.14.181.61@KRBTEST.COM'} at 127.0.0.1:46098)
I20260809 20:11:49.486801 25301 tablet_copy_service.cc:161] P 405a23adfdbb45138c47bfee654cc5a8: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer ae4c504732ae4c32bc8e160ec9d1ac14 at {username='oryx', principal='oryx/127.14.181.61@KRBTEST.COM'} at 127.0.0.1:46098: session id = ae4c504732ae4c32bc8e160ec9d1ac14-00000000000000000000000000000000
I20260809 20:11:49.491714 25301 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 20:11:49.494433 26011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 20:11:49.501288 26011 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14: tablet copy: Starting download of 0 data blocks...
I20260809 20:11:49.501667 26011 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14: tablet copy: Starting download of 1 WAL segments...
I20260809 20:11:49.505234 26011 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 20:11:49.509562 25301 tablet_copy_service.cc:342] P 405a23adfdbb45138c47bfee654cc5a8: Request end of tablet copy session ae4c504732ae4c32bc8e160ec9d1ac14-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.14.181.61@KRBTEST.COM'} at 127.0.0.1:46098
I20260809 20:11:49.509822 25301 tablet_copy_service.cc:433] P 405a23adfdbb45138c47bfee654cc5a8: ending tablet copy session ae4c504732ae4c32bc8e160ec9d1ac14-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer ae4c504732ae4c32bc8e160ec9d1ac14
I20260809 20:11:49.522441 26011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:49.525003 26195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:49.530997 26197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:49.547761 26011 server_base.cc:1034] running on GCE node
W20260809 20:11:49.550622 26199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:49.551115 26011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:49.551777 26011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:49.552982 26011 hybrid_clock.cc:648] HybridClock initialized: now 1786306309552915 us; error 34 us; skew 500 ppm
I20260809 20:11:49.553205 26011 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:49 dist-test-slave-6zbq krb5kdc[25201](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306309, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:49.555335 26011 init.cc:377] Logged in from keytab as oryx/127.14.181.61@KRBTEST.COM (short username oryx)
I20260809 20:11:49.556646 26011 webserver.cc:460] Webserver started at http://127.14.181.61:41103/ using document root <none> and password file <none>
I20260809 20:11:49.557030 26011 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:49.557111 26011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:49.560124 26011 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260809 20:11:49.562153 26211 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:49.562654 26011 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260809 20:11:49.562798 26011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-1/wal
uuid: "ae4c504732ae4c32bc8e160ec9d1ac14"
format_stamp: "Formatted at 2026-08-09 20:11:49 on dist-test-slave-6zbq"
server_key: "16897effd43320b78e942b3f95291e6e"
server_key_iv: "248cabb3a89db6ec97fecfe117647805"
server_key_version: "encryptionkey@0"
I20260809 20:11:49.562964 26011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:49.594717 26011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:49.599589 26011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:49.630949 26011 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.61:37669
I20260809 20:11:49.630988 26304 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.61:37669 every 8 connection(s)
I20260809 20:11:49.631906 26011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-1/data/info.pb
I20260809 20:11:49.637257 26306 sys_catalog.cc:263] Verifying existing consensus state
I20260809 20:11:49.641073 26306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14: Bootstrap starting.
I20260809 20:11:49.661311 26306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 20:11:49.661952 26306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14: Bootstrap complete.
I20260809 20:11:49.663235 26306 raft_consensus.cc:348] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: NON_VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: true } }
I20260809 20:11:49.663599 26306 raft_consensus.cc:729] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ae4c504732ae4c32bc8e160ec9d1ac14, State: Initialized, Role: LEARNER
I20260809 20:11:49.663875 26306 consensus_queue.cc:260] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: NON_VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: true } }
I20260809 20:11:49.664968 26306 sys_catalog.cc:564] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:11:49.665160 26309 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: NON_VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: true } } }
I20260809 20:11:49.665606 26309 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [sys.catalog]: This master's current role is: LEARNER
I20260809 20:11:49.675688 26334 catalog_manager.cc:1259] Loaded cluster ID: 2139cd6844304a8690178ebf4e4486c9
I20260809 20:11:49.675786 26334 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14: loading cluster ID for follower catalog manager: success
I20260809 20:11:49.679214 26334 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14: acquiring CA information for follower catalog manager: success
I20260809 20:11:49.681635 26334 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 20:11:49.794708 26185 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:49.794970 26185 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:49.795096 26185 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:49.802232 26185 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:11:49.802357 26185 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:49.802433 26185 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:49.802512 26185 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:11:49.802572 26185 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:11:49.812147 26185 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:44749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:39865,127.14.181.61:37669,127.14.181.60:41321
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.60.keytab
--principal=oryx/127.14.181.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.60:41321
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.14.181.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:49.813233 26185 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:49.814376 26185 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:49.825021 26340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:49.825050 26341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:49.825080 26344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:49.826022 26185 server_base.cc:1034] running on GCE node
I20260809 20:11:49.826740 26185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:49.828029 26185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:49.829108 26003 heartbeater.cc:503] Master 127.14.181.62:39865 was elected leader, sending a full tablet report...
I20260809 20:11:49.829227 26185 hybrid_clock.cc:648] HybridClock initialized: now 1786306309829173 us; error 40 us; skew 500 ppm
I20260809 20:11:49.829607 26185 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:49 dist-test-slave-6zbq krb5kdc[25201](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306309, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:49.832720 26185 init.cc:377] Logged in from keytab as oryx/127.14.181.60@KRBTEST.COM (short username oryx)
I20260809 20:11:49.833976 26185 webserver.cc:460] Webserver started at http://127.14.181.60:40287/ using document root <none> and password file <none>
I20260809 20:11:49.834625 26185 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:49.834743 26185 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:49.835022 26185 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:49.837724 26185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-2/data/instance:
uuid: "e73d6d5b3a52489995316da66349e3b9"
format_stamp: "Formatted at 2026-08-09 20:11:49 on dist-test-slave-6zbq"
server_key: "fc5d51ac8703d71b3e28316c20014983"
server_key_iv: "0d0a602c4feadd41691ddc0c9fc1e13d"
server_key_version: "encryptionkey@0"
I20260809 20:11:49.838485 26185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-2/wal/instance:
uuid: "e73d6d5b3a52489995316da66349e3b9"
format_stamp: "Formatted at 2026-08-09 20:11:49 on dist-test-slave-6zbq"
server_key: "fc5d51ac8703d71b3e28316c20014983"
server_key_iv: "0d0a602c4feadd41691ddc0c9fc1e13d"
server_key_version: "encryptionkey@0"
I20260809 20:11:49.843098 26185 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 20:11:49.846171 26357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:49.847383 26185 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260809 20:11:49.847527 26185 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-2/wal
uuid: "e73d6d5b3a52489995316da66349e3b9"
format_stamp: "Formatted at 2026-08-09 20:11:49 on dist-test-slave-6zbq"
server_key: "fc5d51ac8703d71b3e28316c20014983"
server_key_iv: "0d0a602c4feadd41691ddc0c9fc1e13d"
server_key_version: "encryptionkey@0"
I20260809 20:11:49.847692 26185 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:49.878502 26185 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:49.882308 26185 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:49.882572 26185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:49.898007 26164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.891082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:37669 (local address 127.0.0.1:51520)
0809 20:11:49.891354 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:49.891374 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:49.891506 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:49.892322 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:49.892328 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:49.892359 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:49.892524 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:49.892534 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.894248 (+ 1714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.894254 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:49.895651 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:49.895667 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.897106 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.897113 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:49.897366 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:49.897435 (+ 69us) client_negotiation.cc:769] Sending connection context
0809 20:11:49.897542 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 20:11:49.897709 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143}
I20260809 20:11:49.898072 26401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.891245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51520 (local address 127.14.181.61:37669)
0809 20:11:49.892004 (+ 759us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:49.892009 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:49.892028 (+ 19us) server_negotiation.cc:407] Connection header received
0809 20:11:49.892086 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:49.892089 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:49.892154 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:49.892252 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:49.892716 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.894111 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.895835 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.896931 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.897058 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:49.897306 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:49.897599 (+ 293us) server_negotiation.cc:299] Negotiation successful
0809 20:11:49.897736 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":648,"thread_start_us":520,"threads_started":1}
I20260809 20:11:49.899189 26258 raft_consensus.cc:1203] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260809 20:11:49.899791 26309 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 405a23adfdbb45138c47bfee654cc5a8. Latest consensus state: current_term: 1 leader_uuid: "405a23adfdbb45138c47bfee654cc5a8" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: NON_VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: true } } }
I20260809 20:11:49.900060 26309 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [sys.catalog]: This master's current role is: LEARNER
I20260809 20:11:49.900715 26185 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.60:41321
I20260809 20:11:49.900777 26443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.60:41321 every 8 connection(s)
I20260809 20:11:49.901868 26185 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-2/data/info.pb
I20260809 20:11:49.905189 26444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:49.906206 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 26185
I20260809 20:11:49.913138 26444 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 20:11:49 dist-test-slave-6zbq krb5kdc[25201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306306, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.181.60@KRBTEST.COM
Aug 09 20:11:49 dist-test-slave-6zbq krb5kdc[25201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306309, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.60@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM
I20260809 20:11:49.928704 26448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.908135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41230 (local address 127.14.181.60:41321)
0809 20:11:49.908840 (+ 705us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:49.908854 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:49.908891 (+ 37us) server_negotiation.cc:407] Connection header received
0809 20:11:49.910951 (+ 2060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:49.910973 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:49.911326 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:49.911669 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:49.913057 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.914319 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.915959 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.916902 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.917081 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:49.921742 (+ 4661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:49.921752 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:49.921765 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:49.921823 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:49.924955 (+ 3132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:49.925601 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:49.925609 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:49.925618 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:49.925767 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:49.926127 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:49.926132 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:49.926136 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:49.926683 (+ 547us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:49.926964 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:49.927375 (+ 411us) server_negotiation.cc:299] Negotiation successful
0809 20:11:49.927765 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":509,"thread_start_us":292,"threads_started":1}
I20260809 20:11:49.930320 26450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.915426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.0.0.1:46112)
0809 20:11:49.916179 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:49.916221 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:49.916432 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:49.916842 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:49.916849 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:49.917647 (+ 798us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:49.917968 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:49.917982 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.919194 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.919200 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:49.920512 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:49.920525 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.921521 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.921526 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:49.921698 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:49.922298 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:49.922325 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:49.925044 (+ 2719us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:49.927892 (+ 2848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:49.927904 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:49.927910 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:49.928370 (+ 460us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:49.928733 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:49.928737 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:49.928741 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:49.928900 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:49.929383 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:49.929390 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:49.929578 (+ 188us) client_negotiation.cc:769] Sending connection context
0809 20:11:49.929810 (+ 232us) client_negotiation.cc:240] Negotiation successful
0809 20:11:49.930028 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":377,"threads_started":1}
I20260809 20:11:49.930579 25578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.915412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46112 (local address 127.14.181.62:39865)
0809 20:11:49.915547 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:49.915551 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:49.916318 (+ 767us) server_negotiation.cc:407] Connection header received
0809 20:11:49.916601 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:49.916607 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:49.916668 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:49.916747 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:49.918142 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.919034 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.920650 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.921321 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.921451 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:49.925205 (+ 3754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:49.925209 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:49.925212 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:49.925241 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:49.927769 (+ 2528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:49.928477 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:49.928483 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:49.928487 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:49.928623 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:49.929018 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:49.929022 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:49.929024 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:49.929267 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:49.929376 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:49.929897 (+ 521us) server_negotiation.cc:299] Negotiation successful
0809 20:11:49.930119 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 20:11:49.931658 26444 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 20:11:49 dist-test-slave-6zbq krb5kdc[25201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306309, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.60@KRBTEST.COM for oryx/127.14.181.61@KRBTEST.COM
I20260809 20:11:49.942116 26450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.932286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:37669 (local address 127.0.0.1:51532)
0809 20:11:49.932430 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:49.932444 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:49.932511 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:49.932741 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:49.932744 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:49.933017 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:49.933136 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:49.933143 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.933984 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.933988 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:49.934893 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:49.934905 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.935489 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.935494 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:49.935618 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:49.936011 (+ 393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:49.936025 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:49.937812 (+ 1787us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:49.940356 (+ 2544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:49.940360 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:49.940362 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:49.940709 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:49.940984 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:49.940986 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:49.940989 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:49.941121 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:49.941507 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:49.941510 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:49.941628 (+ 118us) client_negotiation.cc:769] Sending connection context
0809 20:11:49.941726 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 20:11:49.941902 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260809 20:11:49.942198 26401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.932388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51532 (local address 127.14.181.61:37669)
0809 20:11:49.932544 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:49.932548 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:49.932562 (+ 14us) server_negotiation.cc:407] Connection header received
0809 20:11:49.932604 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:49.932607 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:49.932662 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:49.932733 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:49.933234 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.933892 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.934995 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.935382 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.935471 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:49.937983 (+ 2512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:49.937987 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:49.937990 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:49.938020 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:49.940250 (+ 2230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:49.940793 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:49.940796 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:49.940798 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:49.940911 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:49.941193 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:49.941196 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:49.941198 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:49.941430 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:49.941529 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:49.941800 (+ 271us) server_negotiation.cc:299] Negotiation successful
0809 20:11:49.941956 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 20:11:49.943037 26444 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41321 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 20:11:49 dist-test-slave-6zbq krb5kdc[25201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306309, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.60@KRBTEST.COM for oryx/127.14.181.60@KRBTEST.COM
I20260809 20:11:49.953357 26450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.943537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41321 (local address 127.0.0.1:41234)
0809 20:11:49.943698 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:49.943714 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:49.943795 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:49.944030 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:49.944032 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:49.944313 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:49.944435 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:49.944442 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.945296 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.945299 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:49.946073 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:49.946083 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.946751 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.946755 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:49.946910 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:49.947354 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:49.947369 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:49.949037 (+ 1668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:49.951514 (+ 2477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:49.951518 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:49.951520 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:49.951882 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:49.952187 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:49.952190 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:49.952192 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:49.952332 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:49.952723 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:49.952726 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:49.952854 (+ 128us) client_negotiation.cc:769] Sending connection context
0809 20:11:49.952951 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 20:11:49.953104 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260809 20:11:49.953436 26448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.943713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41234 (local address 127.14.181.60:41321)
0809 20:11:49.943840 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:49.943843 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:49.943856 (+ 13us) server_negotiation.cc:407] Connection header received
0809 20:11:49.943891 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:49.943894 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:49.943940 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:49.944008 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:49.944548 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.945197 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.946182 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.946638 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.946729 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:49.949187 (+ 2458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:49.949191 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:49.949194 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:49.949220 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:49.951409 (+ 2189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:49.951975 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:49.951979 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:49.951981 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:49.952099 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:49.952404 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:49.952407 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:49.952409 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:49.952636 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:49.952732 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:49.953022 (+ 290us) server_negotiation.cc:299] Negotiation successful
0809 20:11:49.953204 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":47}
I20260809 20:11:49.957475 26444 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9: Bootstrap starting.
I20260809 20:11:49.960258 26444 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:49.961210 26444 log.cc:824] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:49.963479 26444 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9: No bootstrap required, opened a new log
I20260809 20:11:49.970067 26444 raft_consensus.cc:348] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41321 } }
I20260809 20:11:49.970358 26444 raft_consensus.cc:374] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:49.970464 26444 raft_consensus.cc:729] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e73d6d5b3a52489995316da66349e3b9, State: Initialized, Role: FOLLOWER
I20260809 20:11:49.970937 26444 consensus_queue.cc:260] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41321 } }
I20260809 20:11:49.971685 26454 sys_catalog.cc:455] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41321 } } }
I20260809 20:11:49.972004 26454 sys_catalog.cc:458] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 20:11:49.972504 26444 sys_catalog.cc:564] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 20:11:49.980108 26475 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 20:11:49.980230 26475 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 20:11:49.983209 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 25369
I20260809 20:11:49.985015 26185 master_runner.cc:428] Detected that this master e73d6d5b3a52489995316da66349e3b9 is joining an existing cluster
I20260809 20:11:49.985133 26185 master_runner.cc:432] Initiating AddMaster RPC to add 127.14.181.60:41321
Aug 09 20:11:49 dist-test-slave-6zbq krb5kdc[25201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306306, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.181.1@KRBTEST.COM
I20260809 20:11:50.004671 26401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.989021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51534 (local address 127.14.181.61:37669)
0809 20:11:49.989187 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:49.989192 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:49.989401 (+ 209us) server_negotiation.cc:407] Connection header received
0809 20:11:49.989639 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:49.989645 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:49.989718 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:49.989788 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:49.991278 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.992407 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.994685 (+ 2278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.995336 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.995428 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:49.997943 (+ 2515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:49.997950 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:49.997955 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:49.997992 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:50.001485 (+ 3493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:50.002243 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:50.002249 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:50.002252 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:50.002437 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:50.002906 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:50.002912 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:50.002915 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:50.003257 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:50.003384 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:50.004074 (+ 690us) server_negotiation.cc:299] Negotiation successful
0809 20:11:50.004319 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 20:11:50.005445 26477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.984121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54742 (local address 127.14.181.1:45009)
0809 20:11:49.984838 (+ 717us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:49.984844 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:49.984865 (+ 21us) server_negotiation.cc:407] Connection header received
0809 20:11:49.984934 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:49.984941 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:49.985156 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:49.985336 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:49.986928 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.988457 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.990326 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.991226 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.991349 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:49.997141 (+ 5792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:49.997156 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:49.997171 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:49.997218 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:50.001442 (+ 4224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:50.002300 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:50.002308 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:50.002312 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:50.002488 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:50.002982 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:50.002987 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:50.002991 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:50.003402 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:50.003686 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:50.004794 (+ 1108us) server_negotiation.cc:299] Negotiation successful
0809 20:11:50.005043 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":425,"threads_started":1}
I20260809 20:11:50.006172 26484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.988742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:37669 (local address 127.0.0.1:51534)
0809 20:11:49.989306 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:49.989325 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:49.989495 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:49.989987 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:49.989990 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:49.990699 (+ 709us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:49.991091 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:49.991106 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.992669 (+ 1563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.992674 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:49.994515 (+ 1841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:49.994532 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:49.995707 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:49.995716 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:49.995895 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:49.996590 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:49.996613 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:49.997744 (+ 1131us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:50.001644 (+ 3900us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:50.001649 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:50.001653 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:50.002112 (+ 459us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:50.002584 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:50.002589 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:50.002593 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:50.002779 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:50.003486 (+ 707us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:50.003491 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:50.003742 (+ 251us) client_negotiation.cc:769] Sending connection context
0809 20:11:50.005114 (+ 1372us) client_negotiation.cc:240] Negotiation successful
0809 20:11:50.005426 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":454,"threads_started":1}
I20260809 20:11:50.006752 25570 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:50.021507 25578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.995299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46128 (local address 127.14.181.62:39865)
0809 20:11:49.995471 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:49.995476 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:50.005863 (+ 10387us) server_negotiation.cc:407] Connection header received
0809 20:11:50.006353 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:50.006359 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:50.006438 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:50.006510 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:50.008118 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.009149 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.011045 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.011672 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.011761 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:50.014108 (+ 2347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:50.014115 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:50.014119 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:50.014155 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:50.017349 (+ 3194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:50.018074 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:50.018080 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:50.018083 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:50.018248 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:50.018771 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:50.018776 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:50.018779 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:50.019095 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:50.020452 (+ 1357us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:50.020960 (+ 508us) server_negotiation.cc:299] Negotiation successful
0809 20:11:50.021175 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 20:11:50.021557 26448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.989943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41238 (local address 127.14.181.60:41321)
0809 20:11:49.990109 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:49.990114 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:50.005187 (+ 15073us) server_negotiation.cc:407] Connection header received
0809 20:11:50.006691 (+ 1504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:50.006696 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:50.006772 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:50.006841 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:50.009216 (+ 2375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.010336 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.012163 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.012856 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.012975 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:50.015226 (+ 2251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:50.015233 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:50.015237 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:50.015269 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:50.018685 (+ 3416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:50.019386 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:50.019391 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:50.019393 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:50.019545 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:50.019973 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:50.019978 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:50.019980 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:50.020289 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:50.020422 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:50.020948 (+ 526us) server_negotiation.cc:299] Negotiation successful
0809 20:11:50.021168 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":50,"spinlock_wait_cycles":20224}
I20260809 20:11:50.022593 26486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.989620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41321 (local address 127.0.0.1:41238)
0809 20:11:50.005106 (+ 15486us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:50.005124 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:50.006062 (+ 938us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:50.008154 (+ 2092us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:50.008158 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:50.008740 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:50.009075 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:50.009086 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.010572 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.010577 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:50.012033 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:50.012044 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.013227 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.013234 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:50.013414 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:50.013931 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:50.013972 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:50.015047 (+ 1075us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:50.018820 (+ 3773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:50.018824 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:50.018827 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:50.019260 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:50.019697 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:50.019701 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:50.019705 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:50.019855 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:50.020510 (+ 655us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:50.020514 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:50.020652 (+ 138us) client_negotiation.cc:769] Sending connection context
0809 20:11:50.021748 (+ 1096us) client_negotiation.cc:240] Negotiation successful
0809 20:11:50.022091 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15343,"thread_start_us":16248,"threads_started":1}
I20260809 20:11:50.022938 26485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:49.995835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.0.0.1:46128)
0809 20:11:50.005751 (+ 9916us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:50.005783 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:50.006192 (+ 409us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:50.007008 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:50.007016 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:50.007680 (+ 664us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:50.007978 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:50.007990 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.009327 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.009332 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:50.010891 (+ 1559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:50.010905 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.012038 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.012044 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:50.012233 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:50.012812 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:50.012834 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:50.013890 (+ 1056us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:50.017499 (+ 3609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:50.017504 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:50.017507 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:50.017937 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:50.018429 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:50.018433 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:50.018436 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:50.018632 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:50.020536 (+ 1904us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:50.020539 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:50.020697 (+ 158us) client_negotiation.cc:769] Sending connection context
0809 20:11:50.021991 (+ 1294us) client_negotiation.cc:240] Negotiation successful
0809 20:11:50.022275 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9806,"mutex_wait_us":4,"thread_start_us":9357,"threads_started":1}
Aug 09 20:11:50 dist-test-slave-6zbq krb5kdc[25201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306307, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.62@KRBTEST.COM for oryx/127.14.181.60@KRBTEST.COM
I20260809 20:11:50.043205 26448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:50.027759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41244 (local address 127.14.181.60:41321)
0809 20:11:50.027934 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:50.027940 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:50.028189 (+ 249us) server_negotiation.cc:407] Connection header received
0809 20:11:50.028277 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:50.028282 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:50.028402 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:50.028496 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:50.029284 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.030474 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.032199 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.032910 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.033031 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:50.036883 (+ 3852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:50.036890 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:50.036895 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:50.036931 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:50.040361 (+ 3430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:50.041135 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:50.041140 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:50.041144 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:50.041282 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:50.041758 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:50.041763 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:50.041766 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:50.042093 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:50.042231 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:50.042699 (+ 468us) server_negotiation.cc:299] Negotiation successful
0809 20:11:50.042908 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 20:11:50.043540 26164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:50.027708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41321 (local address 127.0.0.1:41244)
0809 20:11:50.027960 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:50.027978 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:50.028085 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:50.028536 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:50.028540 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:50.028928 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:50.029105 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:50.029116 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.030626 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.030631 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:50.032004 (+ 1373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:50.032020 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.033230 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.033236 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:50.033404 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:50.034022 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:50.034044 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:50.036687 (+ 2643us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:50.040511 (+ 3824us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:50.040516 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:50.040520 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:50.040998 (+ 478us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:50.041394 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:50.041399 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:50.041403 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:50.041590 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:50.042255 (+ 665us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:50.042267 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:50.042440 (+ 173us) client_negotiation.cc:769] Sending connection context
0809 20:11:50.042583 (+ 143us) client_negotiation.cc:240] Negotiation successful
0809 20:11:50.042908 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122}
I20260809 20:11:50.045112 25273 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.14.181.60:41321: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "e73d6d5b3a52489995316da66349e3b9"
member_type: NON_VOTER
last_known_addr {
host: "127.14.181.60"
port: 41321
}
attrs {
promote: true
}
}
dest_uuid: "405a23adfdbb45138c47bfee654cc5a8"
cas_config_opid_index: 5
I20260809 20:11:50.046126 25273 consensus_queue.cc:237] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: NON_VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: true } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: NON_VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: true } }
I20260809 20:11:50.047757 26176 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER e73d6d5b3a52489995316da66349e3b9 (127.14.181.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: NON_VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: true } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: NON_VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: true } } }
I20260809 20:11:50.050165 26176 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.14.181.60:41321
I20260809 20:11:50.051123 26185 master.cc:537] Master@127.14.181.60:41321 shutting down...
I20260809 20:11:50.051385 26258 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 1 LEARNER]: Refusing update from remote peer 405a23adfdbb45138c47bfee654cc5a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 20:11:50.052614 26176 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: NON_VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260809 20:11:50.055027 26258 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER e73d6d5b3a52489995316da66349e3b9 (127.14.181.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: NON_VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: true } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: NON_VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: true } } }
I20260809 20:11:50.055678 26491 sys_catalog.cc:455] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "405a23adfdbb45138c47bfee654cc5a8" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: NON_VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: true } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: NON_VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: true } } }
I20260809 20:11:50.056005 26491 sys_catalog.cc:458] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:50.059305 26309 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "405a23adfdbb45138c47bfee654cc5a8" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: NON_VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: true } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: NON_VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: true } } }
I20260809 20:11:50.059580 26309 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [sys.catalog]: This master's current role is: LEARNER
I20260809 20:11:50.060441 26491 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8: attempting to promote NON_VOTER ae4c504732ae4c32bc8e160ec9d1ac14 to VOTER
I20260809 20:11:50.061128 26491 consensus_queue.cc:237] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: NON_VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: true } }
I20260809 20:11:50.063457 26258 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 1 LEARNER]: Refusing update from remote peer 405a23adfdbb45138c47bfee654cc5a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260809 20:11:50.064126 26176 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260809 20:11:50.066715 26176 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, ae4c504732ae4c32bc8e160ec9d1ac14 (127.14.181.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: NON_VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: true } } }
I20260809 20:11:50.070983 26257 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, ae4c504732ae4c32bc8e160ec9d1ac14 (127.14.181.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: NON_VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: true } } }
I20260809 20:11:50.074844 26309 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "405a23adfdbb45138c47bfee654cc5a8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: NON_VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: true } } }
I20260809 20:11:50.075078 26309 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 20:11:50.075346 26176 sys_catalog.cc:455] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "405a23adfdbb45138c47bfee654cc5a8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: NON_VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: true } } }
I20260809 20:11:50.075536 26491 sys_catalog.cc:455] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "405a23adfdbb45138c47bfee654cc5a8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: NON_VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: true } } }
I20260809 20:11:50.075806 26491 sys_catalog.cc:458] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:50.075850 26176 sys_catalog.cc:458] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:50.078827 26404 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:50.082422 26404 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [term 1 FOLLOWER]: Refusing update from remote peer 405a23adfdbb45138c47bfee654cc5a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
W20260809 20:11:50.087446 25248 consensus_peers.cc:487] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 -> Peer e73d6d5b3a52489995316da66349e3b9 (127.14.181.60:41321): Couldn't send request to peer e73d6d5b3a52489995316da66349e3b9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 20:11:50.093758 26185 raft_consensus.cc:2229] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:11:50.094099 26185 raft_consensus.cc:2258] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:50.094281 26185 tablet_replica.cc:330] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9: stopping tablet replica
I20260809 20:11:50.100417 26185 master.cc:552] Master@127.14.181.60:41321 shutdown complete.
I20260809 20:11:50.100493 26185 master_runner.cc:305] Clearing existing system tablet
I20260809 20:11:50.100857 26185 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:50.100960 26185 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:50.103793 26185 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260809 20:11:50.105397 26501 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:50.105738 26185 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:50.106137 26185 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 20:11:50.106284 26185 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-2/wal
uuid: "e73d6d5b3a52489995316da66349e3b9"
format_stamp: "Formatted at 2026-08-09 20:11:49 on dist-test-slave-6zbq"
server_key: "fc5d51ac8703d71b3e28316c20014983"
server_key_iv: "0d0a602c4feadd41691ddc0c9fc1e13d"
server_key_version: "encryptionkey@0"
I20260809 20:11:50.111179 26185 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:50.117755 26185 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 20:11:50.117981 26185 log.cc:1196] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260809 20:11:50.118608 26185 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9: Deleting consensus metadata
I20260809 20:11:50.118880 26185 master_runner.cc:315] Copying system tablet from 127.14.181.62:39865
I20260809 20:11:50.121281 26185 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9: tablet copy: Beginning tablet copy session from remote peer at address 127.14.181.62:39865
I20260809 20:11:50.140689 25578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:50.122028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46144 (local address 127.14.181.62:39865)
0809 20:11:50.122232 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:50.122238 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:50.126895 (+ 4657us) server_negotiation.cc:407] Connection header received
0809 20:11:50.127111 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:50.127117 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:50.127220 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:50.127318 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:50.128525 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.129655 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.131477 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.132111 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.132227 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:50.134462 (+ 2235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:50.134469 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:50.134474 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:50.134513 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:50.137818 (+ 3305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:50.138612 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:50.138618 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:50.138622 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:50.138779 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:50.139203 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:50.139208 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:50.139211 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:50.139535 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:50.139687 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:50.140125 (+ 438us) server_negotiation.cc:299] Negotiation successful
0809 20:11:50.140326 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260809 20:11:50.140702 26508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:50.122016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.0.0.1:46144)
0809 20:11:50.126778 (+ 4762us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:50.126797 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:50.126939 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:50.127508 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:50.127514 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:50.128088 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:50.128367 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:50.128381 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.129818 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.129824 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:50.131341 (+ 1517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:50.131356 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.132266 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.132273 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:50.132448 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:50.133155 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:50.133179 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:50.134208 (+ 1029us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:50.137950 (+ 3742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:50.137955 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:50.137960 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:50.138491 (+ 531us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:50.138889 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:50.138895 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:50.138898 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:50.139083 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:50.139652 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:50.139657 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:50.139843 (+ 186us) client_negotiation.cc:769] Sending connection context
0809 20:11:50.139985 (+ 142us) client_negotiation.cc:240] Negotiation successful
0809 20:11:50.140278 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4619,"thread_start_us":4486,"threads_started":1}
I20260809 20:11:50.141578 25301 tablet_copy_service.cc:140] P 405a23adfdbb45138c47bfee654cc5a8: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer e73d6d5b3a52489995316da66349e3b9 ({username='oryx', principal='oryx/127.14.181.60@KRBTEST.COM'} at 127.0.0.1:46144)
I20260809 20:11:50.141750 25301 tablet_copy_service.cc:161] P 405a23adfdbb45138c47bfee654cc5a8: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer e73d6d5b3a52489995316da66349e3b9 at {username='oryx', principal='oryx/127.14.181.60@KRBTEST.COM'} at 127.0.0.1:46144: session id = e73d6d5b3a52489995316da66349e3b9-00000000000000000000000000000000
I20260809 20:11:50.145300 25301 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 20:11:50.147058 26185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 20:11:50.150058 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 25369
I20260809 20:11:50.153523 26185 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9: tablet copy: Starting download of 0 data blocks...
I20260809 20:11:50.153790 26185 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9: tablet copy: Starting download of 1 WAL segments...
I20260809 20:11:50.158445 26185 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 20:11:50.162357 25301 tablet_copy_service.cc:342] P 405a23adfdbb45138c47bfee654cc5a8: Request end of tablet copy session e73d6d5b3a52489995316da66349e3b9-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.14.181.60@KRBTEST.COM'} at 127.0.0.1:46144
I20260809 20:11:50.162489 25301 tablet_copy_service.cc:433] P 405a23adfdbb45138c47bfee654cc5a8: ending tablet copy session e73d6d5b3a52489995316da66349e3b9-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer e73d6d5b3a52489995316da66349e3b9
I20260809 20:11:50.174386 26185 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:50.177452 26509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:50.178052 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:45009
--local_ip_for_outbound_sockets=127.14.181.1
--tserver_master_addrs=127.14.181.62:39865
--webserver_port=38529
--webserver_interface=127.14.181.1
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.1.keytab
--principal=oryx/127.14.181.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:44749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.14.181.62:39865,127.14.181.61:37669
--tserver_master_addrs=127.14.181.62:39865,127.14.181.61:37669,127.14.181.60:41321 with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:50.178728 26510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:50.180119 26185 server_base.cc:1034] running on GCE node
W20260809 20:11:50.182732 26514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:50.183187 26185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:50.183810 26185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:50.184995 26185 hybrid_clock.cc:648] HybridClock initialized: now 1786306310184934 us; error 48 us; skew 500 ppm
I20260809 20:11:50.185240 26185 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:50 dist-test-slave-6zbq krb5kdc[25201](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306310, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:50.187322 26185 init.cc:377] Logged in from keytab as oryx/127.14.181.60@KRBTEST.COM (short username oryx)
I20260809 20:11:50.191283 26185 webserver.cc:460] Webserver started at http://127.14.181.60:40943/ using document root <none> and password file <none>
I20260809 20:11:50.191605 26185 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:50.191710 26185 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:50.195003 26185 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:11:50.196897 26523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:50.197329 26185 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260809 20:11:50.197448 26185 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-2/wal
uuid: "e73d6d5b3a52489995316da66349e3b9"
format_stamp: "Formatted at 2026-08-09 20:11:49 on dist-test-slave-6zbq"
server_key: "fc5d51ac8703d71b3e28316c20014983"
server_key_iv: "0d0a602c4feadd41691ddc0c9fc1e13d"
server_key_version: "encryptionkey@0"
I20260809 20:11:50.197625 26185 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:50.239066 26185 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:50.243019 26185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:50.286566 26185 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.60:41321
I20260809 20:11:50.286732 26604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.60:41321 every 8 connection(s)
I20260809 20:11:50.287595 26185 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/master-2/data/info.pb
I20260809 20:11:50.293054 26605 sys_catalog.cc:263] Verifying existing consensus state
I20260809 20:11:50.297003 26605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9: Bootstrap starting.
I20260809 20:11:50.319248 26605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 20:11:50.319661 26605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9: Bootstrap complete.
I20260809 20:11:50.320488 26605 raft_consensus.cc:348] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: NON_VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: true } }
I20260809 20:11:50.320726 26605 raft_consensus.cc:729] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e73d6d5b3a52489995316da66349e3b9, State: Initialized, Role: LEARNER
I20260809 20:11:50.320950 26605 consensus_queue.cc:260] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: NON_VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: true } }
I20260809 20:11:50.322003 26605 sys_catalog.cc:564] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:11:50.321692 26609 sys_catalog.cc:455] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: NON_VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: true } } }
I20260809 20:11:50.322248 26609 sys_catalog.cc:458] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [sys.catalog]: This master's current role is: LEARNER
I20260809 20:11:50.328775 26625 catalog_manager.cc:1259] Loaded cluster ID: 2139cd6844304a8690178ebf4e4486c9
I20260809 20:11:50.329561 26625 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9: loading cluster ID for follower catalog manager: success
I20260809 20:11:50.333031 26625 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9: acquiring CA information for follower catalog manager: success
I20260809 20:11:50.335386 26625 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 20:11:50.523046 26517 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:50.523312 26517 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:50.523449 26517 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:50.530550 26517 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:50.530668 26517 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:50.530812 26517 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:11:50.540402 26517 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:44749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.1.keytab
--principal=oryx/127.14.181.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:45009
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=38529
--tserver_master_addrs=127.14.181.62:39865,127.14.181.61:37669,127.14.181.60:41321
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:50.541611 26517 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:50.542956 26517 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:50.555469 26635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:50.555313 26637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:50.555415 26641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:50.556360 26517 server_base.cc:1034] running on GCE node
I20260809 20:11:50.556903 26517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:50.557746 26517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:50.558936 26517 hybrid_clock.cc:648] HybridClock initialized: now 1786306310558888 us; error 41 us; skew 500 ppm
I20260809 20:11:50.559237 26517 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:50 dist-test-slave-6zbq krb5kdc[25201](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306310, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:50.562071 26517 init.cc:377] Logged in from keytab as oryx/127.14.181.1@KRBTEST.COM (short username oryx)
I20260809 20:11:50.563485 26517 webserver.cc:460] Webserver started at http://127.14.181.1:38529/ using document root <none> and password file <none>
I20260809 20:11:50.564108 26517 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:50.564220 26517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:50.569144 26517 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 20:11:50.571759 26653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:50.572945 26517 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 20:11:50.573076 26517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "788f6af08e2c478d8143aaabe2fd7cf6"
format_stamp: "Formatted at 2026-08-09 20:11:47 on dist-test-slave-6zbq"
server_key: "539c30774482c99f125418f95147fb56"
server_key_iv: "3315bbb87fa115ce6409fe346ab2e7e9"
server_key_version: "encryptionkey@0"
I20260809 20:11:50.573956 26517 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:50.584676 26658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:50.578651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41252 (local address 127.14.181.60:41321)
0809 20:11:50.579175 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:50.579182 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:50.579200 (+ 18us) server_negotiation.cc:407] Connection header received
0809 20:11:50.579262 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:50.579266 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:50.579348 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:50.579463 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:50.579988 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.580969 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.583089 (+ 2120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.583867 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.583971 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:50.584102 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:50.584325 (+ 223us) server_negotiation.cc:299] Negotiation successful
0809 20:11:50.584418 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":272,"threads_started":1}
I20260809 20:11:50.584740 26657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:50.578496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41321 (local address 127.0.0.1:41252)
0809 20:11:50.578903 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:50.578923 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:50.579064 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:50.579565 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:50.579570 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:50.579605 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:50.579805 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:50.579817 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.581130 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.581136 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:50.582953 (+ 1817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:50.582968 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.584007 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.584013 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:50.584188 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:50.584221 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 20:11:50.584308 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 20:11:50.584446 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":193,"threads_started":1}
I20260809 20:11:50.585490 26568 raft_consensus.cc:1203] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260809 20:11:50.586027 26609 sys_catalog.cc:455] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 405a23adfdbb45138c47bfee654cc5a8. Latest consensus state: current_term: 1 leader_uuid: "405a23adfdbb45138c47bfee654cc5a8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: NON_VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: true } } }
I20260809 20:11:50.586308 26609 sys_catalog.cc:458] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [sys.catalog]: This master's current role is: LEARNER
I20260809 20:11:50.596769 26517 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:50.600447 26517 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:50.600695 26517 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:50.601574 26517 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:11:50.602843 26517 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:50.602941 26517 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:50.603039 26517 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:50.603107 26517 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:50.640834 26517 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:45009
I20260809 20:11:50.640904 26839 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:45009 every 8 connection(s)
I20260809 20:11:50.642059 26517 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:11:50.650887 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 26517
I20260809 20:11:50.651242 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 25586
Aug 09 20:11:50 dist-test-slave-6zbq krb5kdc[25201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306310, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.60@KRBTEST.COM
Aug 09 20:11:50 dist-test-slave-6zbq krb5kdc[25201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306310, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM
I20260809 20:11:50.665143 26658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:50.644530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:50813 (local address 127.14.181.60:41321)
0809 20:11:50.644712 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:50.644717 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:50.646327 (+ 1610us) server_negotiation.cc:407] Connection header received
0809 20:11:50.648189 (+ 1862us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:50.648195 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:50.648275 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:50.648361 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:50.649777 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.650564 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.652529 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.653147 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.653245 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:50.657837 (+ 4592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:50.657845 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:50.657850 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:50.657892 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:50.661477 (+ 3585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:50.662328 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:50.662333 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:50.662365 (+ 32us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:50.662528 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:50.663122 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:50.663127 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:50.663131 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:50.663486 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:50.663634 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:50.664572 (+ 938us) server_negotiation.cc:299] Negotiation successful
0809 20:11:50.664812 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 20:11:50.667270 26848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:50.644924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41321 (local address 127.14.181.1:50813)
0809 20:11:50.646185 (+ 1261us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:50.646225 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:50.647938 (+ 1713us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:50.648589 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:50.648597 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:50.649077 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:50.649618 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:50.649636 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.650697 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.650701 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:50.652356 (+ 1655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:50.652372 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.653591 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.653598 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:50.653896 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:50.654651 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:50.654680 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:50.657582 (+ 2902us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:50.661637 (+ 4055us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:50.661645 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:50.661658 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:50.662183 (+ 525us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:50.662697 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:50.662701 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:50.662705 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:50.662991 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:50.663776 (+ 785us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:50.663783 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:50.664191 (+ 408us) client_negotiation.cc:769] Sending connection context
0809 20:11:50.665409 (+ 1218us) client_negotiation.cc:240] Negotiation successful
0809 20:11:50.665887 (+ 478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1036,"thread_start_us":6749,"threads_started":1}
Aug 09 20:11:50 dist-test-slave-6zbq krb5kdc[25201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306310, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.61@KRBTEST.COM
I20260809 20:11:50.668903 26840 heartbeater.cc:347] Connected to a master server at 127.14.181.60:41321
I20260809 20:11:50.669198 26840 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:50.669767 26846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:50.644857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:49885 (local address 127.14.181.62:39865)
0809 20:11:50.645317 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:50.645323 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:50.652339 (+ 7016us) server_negotiation.cc:407] Connection header received
0809 20:11:50.652399 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:50.652404 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:50.652478 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:50.652580 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:50.653907 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.655189 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.657285 (+ 2096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.657951 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.658075 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:50.662969 (+ 4894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:50.662976 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:50.662980 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:50.663020 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:50.666303 (+ 3283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:50.667613 (+ 1310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:50.667619 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:50.667623 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:50.667776 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:50.668185 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:50.668190 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:50.668194 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:50.668515 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:50.668650 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:50.669183 (+ 533us) server_negotiation.cc:299] Negotiation successful
0809 20:11:50.669397 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":231,"threads_started":1}
I20260809 20:11:50.669780 26847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:50.645546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.14.181.1:49885)
0809 20:11:50.652096 (+ 6550us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:50.652122 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:50.652237 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:50.652803 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:50.652809 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:50.653401 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:50.653719 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:50.653731 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.655381 (+ 1650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.655387 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:50.657103 (+ 1716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:50.657126 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.658317 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.658324 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:50.658508 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:50.659946 (+ 1438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:50.659969 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:50.662747 (+ 2778us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:50.666506 (+ 3759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:50.666511 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:50.666515 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:50.667472 (+ 957us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:50.667916 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:50.667920 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:50.667924 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:50.668069 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:50.668747 (+ 678us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:50.668752 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:50.668902 (+ 150us) client_negotiation.cc:769] Sending connection context
0809 20:11:50.669068 (+ 166us) client_negotiation.cc:240] Negotiation successful
0809 20:11:50.669334 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6434,"thread_start_us":299,"threads_started":1}
I20260809 20:11:50.670056 26840 heartbeater.cc:511] Master 127.14.181.60:41321 requested a full tablet report, sending...
I20260809 20:11:50.671424 26843 heartbeater.cc:347] Connected to a master server at 127.14.181.62:39865
I20260809 20:11:50.671568 26843 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:50.671967 26843 heartbeater.cc:511] Master 127.14.181.62:39865 requested a full tablet report, sending...
I20260809 20:11:50.672348 26551 ts_manager.cc:194] Registered new tserver with Master: 788f6af08e2c478d8143aaabe2fd7cf6 (127.14.181.1:45009)
I20260809 20:11:50.673123 25273 ts_manager.cc:194] Re-registered known tserver with Master: 788f6af08e2c478d8143aaabe2fd7cf6 (127.14.181.1:45009)
I20260809 20:11:50.674177 25273 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.181.1@KRBTEST.COM'} at 127.14.181.1:49885
I20260809 20:11:50.678821 26856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:50.652366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:34645 (local address 127.14.181.61:37669)
0809 20:11:50.659645 (+ 7279us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:50.659649 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:50.659668 (+ 19us) server_negotiation.cc:407] Connection header received
0809 20:11:50.659709 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:50.659712 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:50.659772 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:50.659873 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:50.661265 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.662310 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.664121 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.664788 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.664895 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:50.672860 (+ 7965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:50.672867 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:50.672871 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:50.672909 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:50.676449 (+ 3540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:50.677123 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:50.677128 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:50.677131 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:50.677276 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:50.677647 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:50.677650 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:50.677653 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:50.677896 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:50.678007 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:50.678438 (+ 431us) server_negotiation.cc:299] Negotiation successful
0809 20:11:50.678577 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7182,"thread_start_us":7080,"threads_started":1}
I20260809 20:11:50.678998 26860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:50.657694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:37669 (local address 127.14.181.1:34645)
0809 20:11:50.659121 (+ 1427us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:50.659139 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:50.659261 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:50.660081 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:50.660085 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:50.660703 (+ 618us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:50.661057 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:50.661069 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.662471 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.662475 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:50.663957 (+ 1482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:50.663969 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.665150 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.665156 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:50.665394 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:50.665956 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:50.665976 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:50.671025 (+ 5049us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:50.676581 (+ 5556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:50.676584 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:50.676586 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:50.676976 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:50.677367 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:50.677370 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:50.677372 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:50.677549 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:50.678005 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:50.678010 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:50.678198 (+ 188us) client_negotiation.cc:769] Sending connection context
0809 20:11:50.678363 (+ 165us) client_negotiation.cc:240] Negotiation successful
0809 20:11:50.678643 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1305,"thread_start_us":1187,"threads_started":1}
I20260809 20:11:50.679888 26844 heartbeater.cc:347] Connected to a master server at 127.14.181.61:37669
I20260809 20:11:50.680001 26844 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:50.680328 26844 heartbeater.cc:511] Master 127.14.181.61:37669 requested a full tablet report, sending...
I20260809 20:11:50.681836 26245 ts_manager.cc:194] Registered new tserver with Master: 788f6af08e2c478d8143aaabe2fd7cf6 (127.14.181.1:45009)
Aug 09 20:11:50 dist-test-slave-6zbq krb5kdc[25201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306306, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.181.2@KRBTEST.COM
I20260809 20:11:50.690109 26857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:50.652604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47116 (local address 127.14.181.2:42403)
0809 20:11:50.674334 (+ 21730us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:50.674365 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:50.674927 (+ 562us) server_negotiation.cc:407] Connection header received
0809 20:11:50.675267 (+ 340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:50.675276 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:50.675502 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:50.675652 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:50.677504 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.678900 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.680443 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:50.681101 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:50.681196 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:50.685606 (+ 4410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:50.685616 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:50.685626 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:50.685659 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:50.688053 (+ 2394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:50.688609 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:50.688614 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:50.688616 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:50.688729 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:50.688969 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:50.688972 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:50.688974 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:50.689276 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:50.689491 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:50.689663 (+ 172us) server_negotiation.cc:299] Negotiation successful
0809 20:11:50.689834 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21569,"thread_start_us":21374,"threads_started":1}
I20260809 20:11:50.691166 25777 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:50.770920 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 25586
I20260809 20:11:50.795521 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:42403
--local_ip_for_outbound_sockets=127.14.181.2
--tserver_master_addrs=127.14.181.62:39865
--webserver_port=44639
--webserver_interface=127.14.181.2
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.2.keytab
--principal=oryx/127.14.181.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:44749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.14.181.62:39865,127.14.181.61:37669
--tserver_master_addrs=127.14.181.62:39865,127.14.181.61:37669,127.14.181.60:41321 with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 20:11:51.093463 26655 sys_catalog.cc:455] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "405a23adfdbb45138c47bfee654cc5a8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: NON_VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: true } } }
I20260809 20:11:51.093806 26655 sys_catalog.cc:458] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:51.095275 26865 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8: attempting to promote NON_VOTER e73d6d5b3a52489995316da66349e3b9 to VOTER
I20260809 20:11:51.095815 26865 consensus_queue.cc:237] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: false } }
I20260809 20:11:51.097826 26568 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [term 1 LEARNER]: Refusing update from remote peer 405a23adfdbb45138c47bfee654cc5a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260809 20:11:51.097982 26258 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 1 FOLLOWER]: Refusing update from remote peer 405a23adfdbb45138c47bfee654cc5a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260809 20:11:51.098778 26655 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260809 20:11:51.099152 26867 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260809 20:11:51.102023 26655 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, e73d6d5b3a52489995316da66349e3b9 (127.14.181.60) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: false } } }
I20260809 20:11:51.102640 26258 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, e73d6d5b3a52489995316da66349e3b9 (127.14.181.60) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: false } } }
I20260809 20:11:51.105602 26867 sys_catalog.cc:455] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "405a23adfdbb45138c47bfee654cc5a8" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: false } } }
I20260809 20:11:51.105867 26867 sys_catalog.cc:458] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:51.106174 26867 sys_catalog.cc:455] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "405a23adfdbb45138c47bfee654cc5a8" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: false } } }
I20260809 20:11:51.106431 26867 sys_catalog.cc:458] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:51.107349 26865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "405a23adfdbb45138c47bfee654cc5a8" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: false } } }
I20260809 20:11:51.107581 26865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:51.107944 26886 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "405a23adfdbb45138c47bfee654cc5a8" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: false } } }
I20260809 20:11:51.108337 26886 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 20:11:51.107932 26568 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, e73d6d5b3a52489995316da66349e3b9 (127.14.181.60) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: false } } }
I20260809 20:11:51.111043 26890 sys_catalog.cc:455] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "405a23adfdbb45138c47bfee654cc5a8" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: false } } }
I20260809 20:11:51.111335 26890 sys_catalog.cc:458] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [sys.catalog]: This master's current role is: FOLLOWER
W20260809 20:11:51.114216 26864 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:51.114477 26864 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:51.114611 26864 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:51.121481 26864 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:51.121572 26864 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:51.121727 26864 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:11:51.130925 26864 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:44749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.2.keytab
--principal=oryx/127.14.181.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:42403
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=44639
--tserver_master_addrs=127.14.181.62:39865,127.14.181.61:37669,127.14.181.60:41321
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:51.131958 26864 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:51.133100 26864 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:51.145124 26892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:51.145267 26893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:51.145267 26895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:51.146322 26864 server_base.cc:1034] running on GCE node
I20260809 20:11:51.146898 26864 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:51.147687 26864 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:51.148887 26864 hybrid_clock.cc:648] HybridClock initialized: now 1786306311148840 us; error 45 us; skew 500 ppm
I20260809 20:11:51.149170 26864 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:51 dist-test-slave-6zbq krb5kdc[25201](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306311, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:51.152212 26864 init.cc:377] Logged in from keytab as oryx/127.14.181.2@KRBTEST.COM (short username oryx)
I20260809 20:11:51.153537 26864 webserver.cc:460] Webserver started at http://127.14.181.2:44639/ using document root <none> and password file <none>
I20260809 20:11:51.154189 26864 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:51.154317 26864 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:51.159525 26864 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 20:11:51.161929 26907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:51.163162 26864 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 20:11:51.163305 26864 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "29f2635fb37e415382cbf8dece012472"
format_stamp: "Formatted at 2026-08-09 20:11:48 on dist-test-slave-6zbq"
server_key: "dfdb155b7364891909e254ac79e48b66"
server_key_iv: "8e125510eb0bb8809b0f44c7112e8077"
server_key_version: "encryptionkey@0"
I20260809 20:11:51.164240 26864 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:51.182559 26864 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:51.186249 26864 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:51.186509 26864 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:51.187319 26864 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:11:51.188597 26864 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:51.188702 26864 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:51.188787 26864 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:51.188841 26864 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:51.218326 26864 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:42403
I20260809 20:11:51.218420 27078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:42403 every 8 connection(s)
I20260809 20:11:51.219638 26864 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:11:51.225217 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 26864
I20260809 20:11:51.225517 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 25794
Aug 09 20:11:51 dist-test-slave-6zbq krb5kdc[25201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306311, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.60@KRBTEST.COM
Aug 09 20:11:51 dist-test-slave-6zbq krb5kdc[25201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306311, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.61@KRBTEST.COM
Aug 09 20:11:51 dist-test-slave-6zbq krb5kdc[25201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306311, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM
Aug 09 20:11:51 dist-test-slave-6zbq krb5kdc[25201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306306, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.181.3@KRBTEST.COM
I20260809 20:11:51.246202 27086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:51.222289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:51197 (local address 127.14.181.62:39865)
0809 20:11:51.223445 (+ 1156us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:51.223450 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:51.224826 (+ 1376us) server_negotiation.cc:407] Connection header received
0809 20:11:51.227207 (+ 2381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:51.227214 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:51.227314 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:51.227419 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:51.229984 (+ 2565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.230766 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.233235 (+ 2469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.233673 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.233749 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:51.239240 (+ 5491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:51.239245 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:51.239248 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:51.239293 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:51.242582 (+ 3289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:51.243596 (+ 1014us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:51.243601 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:51.243605 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:51.243759 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:51.244225 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:51.244230 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:51.244234 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:51.244560 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:51.244675 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:51.245648 (+ 973us) server_negotiation.cc:299] Negotiation successful
0809 20:11:51.245853 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1048,"thread_start_us":905,"threads_started":1}
I20260809 20:11:51.246512 27093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:51.224941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:34461 (local address 127.14.181.61:37669)
0809 20:11:51.225467 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:51.225472 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:51.226023 (+ 551us) server_negotiation.cc:407] Connection header received
0809 20:11:51.227363 (+ 1340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:51.227368 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:51.227447 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:51.227534 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:51.229929 (+ 2395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.231102 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.233195 (+ 2093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.233802 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.233925 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:51.238712 (+ 4787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:51.238717 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:51.238722 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:51.238756 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:51.242826 (+ 4070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:51.243645 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:51.243650 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:51.243653 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:51.243793 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:51.244225 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:51.244230 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:51.244234 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:51.244570 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:51.244683 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:51.245651 (+ 968us) server_negotiation.cc:299] Negotiation successful
0809 20:11:51.245857 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":253,"threads_started":1}
I20260809 20:11:51.246529 27087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:51.222302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:42307 (local address 127.14.181.60:41321)
0809 20:11:51.224150 (+ 1848us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:51.224155 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:51.224584 (+ 429us) server_negotiation.cc:407] Connection header received
0809 20:11:51.227326 (+ 2742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:51.227331 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:51.227411 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:51.227513 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:51.229945 (+ 2432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.231087 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.233252 (+ 2165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.233841 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.233924 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:51.238625 (+ 4701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:51.238632 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:51.238636 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:51.238675 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:51.242315 (+ 3640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:51.243394 (+ 1079us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:51.243400 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:51.243404 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:51.243568 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:51.244186 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:51.244192 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:51.244196 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:51.244539 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:51.244657 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:51.245671 (+ 1014us) server_negotiation.cc:299] Negotiation successful
0809 20:11:51.245897 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1748,"thread_start_us":1637,"threads_started":1}
I20260809 20:11:51.248246 27092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:51.224663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:37669 (local address 127.14.181.2:34461)
0809 20:11:51.225837 (+ 1174us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:51.225853 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:51.227103 (+ 1250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:51.227836 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:51.227847 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:51.228740 (+ 893us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:51.229743 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:51.229770 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.231233 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.231241 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:51.233083 (+ 1842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:51.233094 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.234052 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.234059 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:51.234457 (+ 398us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:51.235187 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:51.235217 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:51.238550 (+ 3333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:51.243000 (+ 4450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:51.243005 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:51.243009 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:51.243529 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:51.243918 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:51.243922 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:51.243925 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:51.244106 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:51.244773 (+ 667us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:51.244795 (+ 22us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:51.245196 (+ 401us) client_negotiation.cc:769] Sending connection context
0809 20:11:51.246737 (+ 1541us) client_negotiation.cc:240] Negotiation successful
0809 20:11:51.247045 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1043,"mutex_wait_us":444,"spinlock_wait_cycles":14848,"thread_start_us":1235,"threads_started":1}
I20260809 20:11:51.248351 27091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:51.223058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.14.181.2:51197)
0809 20:11:51.224732 (+ 1674us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:51.224749 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:51.226869 (+ 2120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:51.227838 (+ 969us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:51.227848 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:51.228800 (+ 952us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:51.229744 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:51.229770 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.230931 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.230937 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:51.233070 (+ 2133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:51.233085 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.234042 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.234050 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:51.234454 (+ 404us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:51.235228 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:51.235246 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:51.239069 (+ 3823us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:51.242769 (+ 3700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:51.242773 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:51.242782 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:51.243451 (+ 669us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:51.243912 (+ 461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:51.243916 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:51.243919 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:51.244099 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:51.244773 (+ 674us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:51.244784 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:51.245196 (+ 412us) client_negotiation.cc:769] Sending connection context
0809 20:11:51.246496 (+ 1300us) client_negotiation.cc:240] Negotiation successful
0809 20:11:51.246934 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1553,"mutex_wait_us":623,"spinlock_wait_cycles":11008,"thread_start_us":669,"threads_started":1}
I20260809 20:11:51.248764 27088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:51.223021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41321 (local address 127.14.181.2:42307)
0809 20:11:51.224420 (+ 1399us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:51.224465 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:51.226869 (+ 2404us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:51.227836 (+ 967us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:51.227847 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:51.228665 (+ 818us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:51.229744 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:51.229769 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.231297 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.231302 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:51.233085 (+ 1783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:51.233106 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.234258 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.234264 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:51.234525 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:51.235355 (+ 830us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:51.235378 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:51.238330 (+ 2952us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:51.242560 (+ 4230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:51.242569 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:51.242582 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:51.243248 (+ 666us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:51.243766 (+ 518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:51.243771 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:51.243775 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:51.244039 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:51.244808 (+ 769us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:51.244816 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:51.245244 (+ 428us) client_negotiation.cc:769] Sending connection context
0809 20:11:51.247169 (+ 1925us) client_negotiation.cc:240] Negotiation successful
0809 20:11:51.247424 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":737,"mutex_wait_us":206,"spinlock_wait_cycles":76288,"thread_start_us":487,"threads_started":1}
I20260809 20:11:51.249663 27080 heartbeater.cc:347] Connected to a master server at 127.14.181.62:39865
I20260809 20:11:51.249758 27082 heartbeater.cc:347] Connected to a master server at 127.14.181.61:37669
I20260809 20:11:51.249980 27082 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:51.249980 27080 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:51.250545 27079 heartbeater.cc:347] Connected to a master server at 127.14.181.60:41321
I20260809 20:11:51.250692 27079 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:51.250949 27080 heartbeater.cc:511] Master 127.14.181.62:39865 requested a full tablet report, sending...
I20260809 20:11:51.251111 27079 heartbeater.cc:511] Master 127.14.181.60:41321 requested a full tablet report, sending...
I20260809 20:11:51.251748 27082 heartbeater.cc:511] Master 127.14.181.61:37669 requested a full tablet report, sending...
I20260809 20:11:51.252466 25273 ts_manager.cc:194] Re-registered known tserver with Master: 29f2635fb37e415382cbf8dece012472 (127.14.181.2:42403)
I20260809 20:11:51.252592 26551 ts_manager.cc:194] Registered new tserver with Master: 29f2635fb37e415382cbf8dece012472 (127.14.181.2:42403)
I20260809 20:11:51.252844 26245 ts_manager.cc:194] Registered new tserver with Master: 29f2635fb37e415382cbf8dece012472 (127.14.181.2:42403)
I20260809 20:11:51.253615 25273 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.181.2@KRBTEST.COM'} at 127.14.181.2:51197
I20260809 20:11:51.254259 27096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:51.226335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36358 (local address 127.14.181.3:39471)
0809 20:11:51.229460 (+ 3125us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:51.229467 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:51.229495 (+ 28us) server_negotiation.cc:407] Connection header received
0809 20:11:51.229559 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:51.229567 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:51.229795 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:51.231358 (+ 1563us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:51.234502 (+ 3144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.236582 (+ 2080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.238272 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.240227 (+ 1955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.240344 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:51.246190 (+ 5846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:51.246203 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:51.246217 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:51.246254 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:51.249796 (+ 3542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:51.251335 (+ 1539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:51.251344 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:51.251348 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:51.251501 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:51.251963 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:51.251968 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:51.251971 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:51.252387 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:51.252657 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:51.253700 (+ 1043us) server_negotiation.cc:299] Negotiation successful
0809 20:11:51.253913 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2940,"thread_start_us":2784,"threads_started":1}
I20260809 20:11:51.256431 25998 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:51.345564 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 25794
I20260809 20:11:51.365020 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:39471
--local_ip_for_outbound_sockets=127.14.181.3
--tserver_master_addrs=127.14.181.62:39865
--webserver_port=35549
--webserver_interface=127.14.181.3
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.3.keytab
--principal=oryx/127.14.181.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:44749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.14.181.62:39865,127.14.181.61:37669
--tserver_master_addrs=127.14.181.62:39865,127.14.181.61:37669,127.14.181.60:41321 with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 20:11:51.676469 26843 heartbeater.cc:503] Master 127.14.181.62:39865 was elected leader, sending a full tablet report...
W20260809 20:11:51.682535 27099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:51.682845 27099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:51.682991 27099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:51.689999 27099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:51.690088 27099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:51.690199 27099 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:11:51.699481 27099 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:44749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.3.keytab
--principal=oryx/127.14.181.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:39471
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=35549
--tserver_master_addrs=127.14.181.62:39865,127.14.181.61:37669,127.14.181.60:41321
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:51.700587 27099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:51.701824 27099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:51.714138 27108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:51.714169 27111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:51.714764 27099 server_base.cc:1034] running on GCE node
W20260809 20:11:51.714828 27106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:51.715420 27099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:51.716245 27099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:51.717437 27099 hybrid_clock.cc:648] HybridClock initialized: now 1786306311717389 us; error 44 us; skew 500 ppm
I20260809 20:11:51.717734 27099 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:51 dist-test-slave-6zbq krb5kdc[25201](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306311, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:51.720732 27099 init.cc:377] Logged in from keytab as oryx/127.14.181.3@KRBTEST.COM (short username oryx)
I20260809 20:11:51.722110 27099 webserver.cc:460] Webserver started at http://127.14.181.3:35549/ using document root <none> and password file <none>
I20260809 20:11:51.722887 27099 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:51.723014 27099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:51.728334 27099 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 20:11:51.730764 27119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:51.731954 27099 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260809 20:11:51.732091 27099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "e03dd651846c4fedbe380653aad87fca"
format_stamp: "Formatted at 2026-08-09 20:11:48 on dist-test-slave-6zbq"
server_key: "4d1a0acd39fc2eb431fb18e50549f37c"
server_key_iv: "83647c8648ce5dc216e54c17c428bb3f"
server_key_version: "encryptionkey@0"
I20260809 20:11:51.733018 27099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:51.746619 27099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:51.750209 27099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:51.750486 27099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:51.751400 27099 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:11:51.752617 27099 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:51.752713 27099 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:51.752805 27099 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:51.752882 27099 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:51.782387 27099 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:39471
I20260809 20:11:51.782497 27307 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:39471 every 8 connection(s)
I20260809 20:11:51.783749 27099 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:11:51.786019 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 27099
Aug 09 20:11:51 dist-test-slave-6zbq krb5kdc[25201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306311, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.60@KRBTEST.COM
Aug 09 20:11:51 dist-test-slave-6zbq krb5kdc[25201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306311, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.61@KRBTEST.COM
I20260809 20:11:51.815658 27323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:51.786627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:51119 (local address 127.14.181.60:41321)
0809 20:11:51.788592 (+ 1965us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:51.788599 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:51.793974 (+ 5375us) server_negotiation.cc:407] Connection header received
0809 20:11:51.794053 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:51.794059 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:51.794159 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:51.794260 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:51.797021 (+ 2761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.798302 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.800877 (+ 2575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.801493 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.801598 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:51.807087 (+ 5489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:51.807094 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:51.807099 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:51.807139 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:51.810649 (+ 3510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:51.811741 (+ 1092us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:51.811747 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:51.811752 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:51.811933 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:51.812471 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:51.812477 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:51.812481 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:51.812865 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:51.814819 (+ 1954us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:51.814993 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 20:11:51.815240 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1829,"thread_start_us":1725,"threads_started":1}
I20260809 20:11:51.817138 27330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:51.794203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:43711 (local address 127.14.181.61:37669)
0809 20:11:51.799689 (+ 5486us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:51.799695 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:51.800341 (+ 646us) server_negotiation.cc:407] Connection header received
0809 20:11:51.800417 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:51.800422 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:51.800505 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:51.800603 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:51.801820 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.803329 (+ 1509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.805051 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.805693 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.805823 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:51.810469 (+ 4646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:51.810476 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:51.810481 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:51.810531 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:51.813717 (+ 3186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:51.814616 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:51.814621 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:51.814624 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:51.814799 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:51.815207 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:51.815211 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:51.815214 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:51.815546 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:51.815683 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:51.816280 (+ 597us) server_negotiation.cc:299] Negotiation successful
0809 20:11:51.816746 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5364,"thread_start_us":5248,"threads_started":1}
Aug 09 20:11:51 dist-test-slave-6zbq krb5kdc[25201](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306311, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM
I20260809 20:11:51.819440 27329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:51.787588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41321 (local address 127.14.181.3:51119)
0809 20:11:51.793720 (+ 6132us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:51.793739 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:51.793866 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:51.794726 (+ 860us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:51.794738 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:51.795670 (+ 932us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:51.796486 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:51.796513 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.798563 (+ 2050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.798569 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:51.800709 (+ 2140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:51.800729 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.801925 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.801933 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:51.802178 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:51.802937 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:51.802967 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:51.806838 (+ 3871us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:51.810906 (+ 4068us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:51.810916 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:51.810934 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:51.811568 (+ 634us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:51.812060 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:51.812065 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:51.812069 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:51.812317 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:51.813021 (+ 704us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:51.813030 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:51.813489 (+ 459us) client_negotiation.cc:769] Sending connection context
0809 20:11:51.813797 (+ 308us) client_negotiation.cc:240] Negotiation successful
0809 20:11:51.817419 (+ 3622us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5958,"mutex_wait_us":28,"spinlock_wait_cycles":50432,"thread_start_us":5830,"threads_started":1}
I20260809 20:11:51.821141 27309 heartbeater.cc:347] Connected to a master server at 127.14.181.60:41321
I20260809 20:11:51.821729 27309 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:51.823776 27309 heartbeater.cc:511] Master 127.14.181.60:41321 requested a full tablet report, sending...
I20260809 20:11:51.825745 26551 ts_manager.cc:194] Registered new tserver with Master: e03dd651846c4fedbe380653aad87fca (127.14.181.3:39471)
I20260809 20:11:51.828660 27334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:51.797784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:37669 (local address 127.14.181.3:43711)
0809 20:11:51.800082 (+ 2298us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:51.800099 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:51.800221 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:51.800780 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:51.800784 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:51.801365 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:51.801661 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:51.801674 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.803455 (+ 1781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.803460 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:51.804917 (+ 1457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:51.804930 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.805853 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.805859 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:51.806028 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:51.806664 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:51.806688 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:51.810219 (+ 3531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:51.813874 (+ 3655us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:51.813878 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:51.813882 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:51.814481 (+ 599us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:51.814928 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:51.814933 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:51.814936 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:51.815088 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:51.815743 (+ 655us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:51.815749 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:51.815888 (+ 139us) client_negotiation.cc:769] Sending connection context
0809 20:11:51.816004 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 20:11:51.818397 (+ 2393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2184,"mutex_wait_us":2169,"thread_start_us":2032,"threads_started":1}
I20260809 20:11:51.829671 27311 heartbeater.cc:347] Connected to a master server at 127.14.181.61:37669
I20260809 20:11:51.829800 27311 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:51.830219 27311 heartbeater.cc:511] Master 127.14.181.61:37669 requested a full tablet report, sending...
I20260809 20:11:51.831596 26245 ts_manager.cc:194] Registered new tserver with Master: e03dd651846c4fedbe380653aad87fca (127.14.181.3:39471)
I20260809 20:11:51.834306 27328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:51.787588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.14.181.3:40645)
0809 20:11:51.789402 (+ 1814us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:51.789453 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:51.792041 (+ 2588us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:51.800104 (+ 8063us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:51.800109 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:51.800626 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:51.800948 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:51.800964 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.803528 (+ 2564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.803534 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:51.805309 (+ 1775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:51.805326 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.807934 (+ 2608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.807941 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:51.816119 (+ 8178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:51.816848 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:51.816869 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:51.820342 (+ 3473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:51.828217 (+ 7875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:51.828222 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:51.828226 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:51.828700 (+ 474us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:51.831964 (+ 3264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:51.831969 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:51.831973 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:51.832160 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:51.833292 (+ 1132us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:51.833297 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:51.833462 (+ 165us) client_negotiation.cc:769] Sending connection context
0809 20:11:51.833624 (+ 162us) client_negotiation.cc:240] Negotiation successful
0809 20:11:51.833903 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1542,"mutex_wait_us":2,"thread_start_us":1309,"threads_started":1}
I20260809 20:11:51.834393 27318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:51.786518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:40645 (local address 127.14.181.62:39865)
0809 20:11:51.798897 (+ 12379us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:51.798904 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:51.798924 (+ 20us) server_negotiation.cc:407] Connection header received
0809 20:11:51.798985 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:51.798990 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:51.799073 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:51.799187 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:51.801858 (+ 2671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.802889 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.805520 (+ 2631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.806188 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.806622 (+ 434us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:51.820521 (+ 13899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:51.820528 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:51.820532 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:51.820572 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:51.827807 (+ 7235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:51.831325 (+ 3518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:51.831331 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:51.831335 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:51.831482 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:51.832290 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:51.832296 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:51.832299 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:51.832673 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:51.832812 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:51.833749 (+ 937us) server_negotiation.cc:299] Negotiation successful
0809 20:11:51.833968 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12247,"thread_start_us":12756,"threads_started":1}
I20260809 20:11:51.835129 27310 heartbeater.cc:347] Connected to a master server at 127.14.181.62:39865
I20260809 20:11:51.835258 27310 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:51.835690 27310 heartbeater.cc:511] Master 127.14.181.62:39865 requested a full tablet report, sending...
I20260809 20:11:51.836772 25273 ts_manager.cc:194] Re-registered known tserver with Master: e03dd651846c4fedbe380653aad87fca (127.14.181.3:39471)
I20260809 20:11:51.837881 25273 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.181.3@KRBTEST.COM'} at 127.14.181.3:40645
I20260809 20:11:51.838335 27340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:51.808893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51536 (local address 127.14.181.61:37669)
0809 20:11:51.816404 (+ 7511us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:51.816411 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:51.816430 (+ 19us) server_negotiation.cc:407] Connection header received
0809 20:11:51.816480 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:51.816485 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:51.816556 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:51.817598 (+ 1042us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:51.822869 (+ 5271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.824456 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.826522 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.827148 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.827983 (+ 835us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:51.831420 (+ 3437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:51.831431 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:51.831436 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:51.831471 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:51.834859 (+ 3388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:51.835627 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:51.835630 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:51.835632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:51.835782 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:51.836308 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:51.836313 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:51.836316 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:51.836655 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:51.837660 (+ 1005us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:51.837774 (+ 114us) server_negotiation.cc:299] Negotiation successful
0809 20:11:51.837967 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7382,"thread_start_us":7262,"threads_started":1}
I20260809 20:11:51.841199 27342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:51.809128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46160 (local address 127.14.181.62:39865)
0809 20:11:51.817000 (+ 7872us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:51.817006 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:51.817023 (+ 17us) server_negotiation.cc:407] Connection header received
0809 20:11:51.817070 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:51.817074 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:51.817161 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:51.817262 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:51.826468 (+ 9206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.827951 (+ 1483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.829785 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.830410 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.830521 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:51.833983 (+ 3462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:51.833990 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:51.833995 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:51.834033 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:51.838063 (+ 4030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:51.839224 (+ 1161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:51.839229 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:51.839232 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:51.839376 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:51.839815 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:51.839820 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:51.839823 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:51.840165 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:51.840383 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:51.840694 (+ 311us) server_negotiation.cc:299] Negotiation successful
0809 20:11:51.840889 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7730,"thread_start_us":7629,"threads_started":1}
I20260809 20:11:51.844169 27323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:51.810941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41266 (local address 127.14.181.60:41321)
0809 20:11:51.815962 (+ 5021us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:51.815967 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:51.825652 (+ 9685us) server_negotiation.cc:407] Connection header received
0809 20:11:51.825882 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:51.825887 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:51.825975 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:51.826042 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:51.829112 (+ 3070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.830111 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.832345 (+ 2234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.832990 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.833102 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:51.838558 (+ 5456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:51.838564 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:51.838568 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:51.838618 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:51.841534 (+ 2916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:51.842192 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:51.842197 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:51.842200 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:51.842395 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:51.842785 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:51.842790 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:51.842793 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:51.843125 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:51.843340 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:51.843701 (+ 361us) server_negotiation.cc:299] Negotiation successful
0809 20:11:51.843857 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4921,"thread_start_us":14791,"threads_started":1}
I20260809 20:11:51.845216 25273 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46160:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 20:11:51.851955 25273 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 20:11:51.889216 27359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:51.868635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:39471 (local address 127.0.0.1:36366)
0809 20:11:51.869493 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:51.869514 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:51.869643 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:51.882491 (+ 12848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:51.882497 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:51.882526 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:51.882942 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:51.882956 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.885000 (+ 2044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.885006 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:51.886946 (+ 1940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:51.886963 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.888427 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.888433 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:51.888606 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:51.888633 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 20:11:51.888718 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 20:11:51.888841 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":716,"thread_start_us":349,"threads_started":1}
I20260809 20:11:51.889243 27360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:51.868905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36366 (local address 127.14.181.3:39471)
0809 20:11:51.881821 (+ 12916us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:51.881831 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:51.881867 (+ 36us) server_negotiation.cc:407] Connection header received
0809 20:11:51.881968 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:51.881976 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:51.882250 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:51.883164 (+ 914us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:51.883427 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.884845 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.887102 (+ 2257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.888216 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.888331 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:51.888548 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:51.888778 (+ 230us) server_negotiation.cc:299] Negotiation successful
0809 20:11:51.888935 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12722,"thread_start_us":12546,"threads_started":1}
I20260809 20:11:51.890755 27361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:51.868972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:45009 (local address 127.0.0.1:54756)
0809 20:11:51.880881 (+ 11909us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:51.880902 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:51.881023 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:51.883840 (+ 2817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:51.883845 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:51.883869 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:51.884325 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:51.884338 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.886182 (+ 1844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.886187 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:51.888249 (+ 2062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:51.888264 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.890063 (+ 1799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.890070 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:51.890248 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:51.890273 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 20:11:51.890385 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 20:11:51.890481 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11763,"mutex_wait_us":1,"thread_start_us":12142,"threads_started":1}
I20260809 20:11:51.890879 27362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:51.869396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54756 (local address 127.14.181.1:45009)
0809 20:11:51.883243 (+ 13847us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:51.883252 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:51.883281 (+ 29us) server_negotiation.cc:407] Connection header received
0809 20:11:51.883378 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:51.883386 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:51.883610 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:51.883827 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:51.884592 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.886047 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.888440 (+ 2393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.889836 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.889960 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:51.890160 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:51.890423 (+ 263us) server_negotiation.cc:299] Negotiation successful
0809 20:11:51.890573 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13663,"thread_start_us":13549,"threads_started":1}
I20260809 20:11:51.893432 27363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:51.870940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:42403 (local address 127.0.0.1:47132)
0809 20:11:51.884477 (+ 13537us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:51.884493 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:51.884678 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:51.885159 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:51.885164 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:51.885191 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:51.885553 (+ 362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:51.885561 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.887523 (+ 1962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.887528 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:51.891315 (+ 3787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:51.891329 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.892780 (+ 1451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.892784 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:51.892900 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:51.892919 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 20:11:51.892994 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 20:11:51.893103 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13412,"thread_start_us":13271,"threads_started":1}
I20260809 20:11:51.893458 27364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:51.871184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47132 (local address 127.14.181.2:42403)
0809 20:11:51.882801 (+ 11617us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:51.882809 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:51.884576 (+ 1767us) server_negotiation.cc:407] Connection header received
0809 20:11:51.884829 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:51.884835 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:51.884990 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:51.885142 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:51.885718 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.887058 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.891475 (+ 4417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:51.892438 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:51.892519 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:51.892637 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:51.893057 (+ 420us) server_negotiation.cc:299] Negotiation successful
0809 20:11:51.893205 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11438,"thread_start_us":11320,"threads_started":1}
I20260809 20:11:51.893831 27198 tablet_service.cc:1467] Processing CreateTablet for tablet ebaa8dffa52d4cd2a7a9bfeb428a677d (DEFAULT_TABLE table=test-table [id=39144987b64c42388092d6a2f461bb0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:51.894191 26731 tablet_service.cc:1467] Processing CreateTablet for tablet ebaa8dffa52d4cd2a7a9bfeb428a677d (DEFAULT_TABLE table=test-table [id=39144987b64c42388092d6a2f461bb0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:51.895534 27198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebaa8dffa52d4cd2a7a9bfeb428a677d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:51.895563 26731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebaa8dffa52d4cd2a7a9bfeb428a677d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:51.896226 26980 tablet_service.cc:1467] Processing CreateTablet for tablet ebaa8dffa52d4cd2a7a9bfeb428a677d (DEFAULT_TABLE table=test-table [id=39144987b64c42388092d6a2f461bb0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:51.897194 26980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebaa8dffa52d4cd2a7a9bfeb428a677d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:51.907792 27366 tablet_bootstrap.cc:492] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472: Bootstrap starting.
I20260809 20:11:51.910440 27369 tablet_bootstrap.cc:492] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 788f6af08e2c478d8143aaabe2fd7cf6: Bootstrap starting.
I20260809 20:11:51.912796 27366 tablet_bootstrap.cc:654] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:51.913753 27369 tablet_bootstrap.cc:654] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 788f6af08e2c478d8143aaabe2fd7cf6: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:51.914008 27366 log.cc:824] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:51.915010 27369 log.cc:824] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 788f6af08e2c478d8143aaabe2fd7cf6: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:51.915076 27370 tablet_bootstrap.cc:492] T ebaa8dffa52d4cd2a7a9bfeb428a677d P e03dd651846c4fedbe380653aad87fca: Bootstrap starting.
I20260809 20:11:51.917981 27370 tablet_bootstrap.cc:654] T ebaa8dffa52d4cd2a7a9bfeb428a677d P e03dd651846c4fedbe380653aad87fca: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:51.918951 27370 log.cc:824] T ebaa8dffa52d4cd2a7a9bfeb428a677d P e03dd651846c4fedbe380653aad87fca: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:51.921165 27369 tablet_bootstrap.cc:492] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 788f6af08e2c478d8143aaabe2fd7cf6: No bootstrap required, opened a new log
I20260809 20:11:51.921164 27366 tablet_bootstrap.cc:492] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472: No bootstrap required, opened a new log
I20260809 20:11:51.921257 27370 tablet_bootstrap.cc:492] T ebaa8dffa52d4cd2a7a9bfeb428a677d P e03dd651846c4fedbe380653aad87fca: No bootstrap required, opened a new log
I20260809 20:11:51.921429 27369 ts_tablet_manager.cc:1397] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 788f6af08e2c478d8143aaabe2fd7cf6: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.003s
I20260809 20:11:51.921429 27366 ts_tablet_manager.cc:1397] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.003s
I20260809 20:11:51.921485 27370 ts_tablet_manager.cc:1397] T ebaa8dffa52d4cd2a7a9bfeb428a677d P e03dd651846c4fedbe380653aad87fca: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260809 20:11:51.929116 27370 raft_consensus.cc:348] T ebaa8dffa52d4cd2a7a9bfeb428a677d P e03dd651846c4fedbe380653aad87fca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e03dd651846c4fedbe380653aad87fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 39471 } } peers { permanent_uuid: "788f6af08e2c478d8143aaabe2fd7cf6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45009 } } peers { permanent_uuid: "29f2635fb37e415382cbf8dece012472" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42403 } }
I20260809 20:11:51.929489 27370 raft_consensus.cc:374] T ebaa8dffa52d4cd2a7a9bfeb428a677d P e03dd651846c4fedbe380653aad87fca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:51.929589 27370 raft_consensus.cc:729] T ebaa8dffa52d4cd2a7a9bfeb428a677d P e03dd651846c4fedbe380653aad87fca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e03dd651846c4fedbe380653aad87fca, State: Initialized, Role: FOLLOWER
I20260809 20:11:51.930120 27370 consensus_queue.cc:260] T ebaa8dffa52d4cd2a7a9bfeb428a677d P e03dd651846c4fedbe380653aad87fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e03dd651846c4fedbe380653aad87fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 39471 } } peers { permanent_uuid: "788f6af08e2c478d8143aaabe2fd7cf6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45009 } } peers { permanent_uuid: "29f2635fb37e415382cbf8dece012472" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42403 } }
I20260809 20:11:51.931206 27310 heartbeater.cc:503] Master 127.14.181.62:39865 was elected leader, sending a full tablet report...
I20260809 20:11:51.931564 27366 raft_consensus.cc:348] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e03dd651846c4fedbe380653aad87fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 39471 } } peers { permanent_uuid: "788f6af08e2c478d8143aaabe2fd7cf6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45009 } } peers { permanent_uuid: "29f2635fb37e415382cbf8dece012472" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42403 } }
I20260809 20:11:51.931888 27370 ts_tablet_manager.cc:1428] T ebaa8dffa52d4cd2a7a9bfeb428a677d P e03dd651846c4fedbe380653aad87fca: Time spent starting tablet: real 0.010s user 0.011s sys 0.000s
I20260809 20:11:51.931991 27366 raft_consensus.cc:374] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:51.932075 27366 raft_consensus.cc:729] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29f2635fb37e415382cbf8dece012472, State: Initialized, Role: FOLLOWER
I20260809 20:11:51.931888 27369 raft_consensus.cc:348] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 788f6af08e2c478d8143aaabe2fd7cf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e03dd651846c4fedbe380653aad87fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 39471 } } peers { permanent_uuid: "788f6af08e2c478d8143aaabe2fd7cf6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45009 } } peers { permanent_uuid: "29f2635fb37e415382cbf8dece012472" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42403 } }
I20260809 20:11:51.932284 27369 raft_consensus.cc:374] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 788f6af08e2c478d8143aaabe2fd7cf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:51.932476 27369 raft_consensus.cc:729] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 788f6af08e2c478d8143aaabe2fd7cf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 788f6af08e2c478d8143aaabe2fd7cf6, State: Initialized, Role: FOLLOWER
I20260809 20:11:51.932641 27366 consensus_queue.cc:260] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e03dd651846c4fedbe380653aad87fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 39471 } } peers { permanent_uuid: "788f6af08e2c478d8143aaabe2fd7cf6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45009 } } peers { permanent_uuid: "29f2635fb37e415382cbf8dece012472" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42403 } }
I20260809 20:11:51.935495 27369 consensus_queue.cc:260] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 788f6af08e2c478d8143aaabe2fd7cf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e03dd651846c4fedbe380653aad87fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 39471 } } peers { permanent_uuid: "788f6af08e2c478d8143aaabe2fd7cf6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45009 } } peers { permanent_uuid: "29f2635fb37e415382cbf8dece012472" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42403 } }
I20260809 20:11:51.939462 27080 heartbeater.cc:503] Master 127.14.181.62:39865 was elected leader, sending a full tablet report...
I20260809 20:11:51.939992 27366 ts_tablet_manager.cc:1428] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472: Time spent starting tablet: real 0.018s user 0.019s sys 0.000s
I20260809 20:11:51.941077 27369 ts_tablet_manager.cc:1428] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 788f6af08e2c478d8143aaabe2fd7cf6: Time spent starting tablet: real 0.020s user 0.016s sys 0.001s
W20260809 20:11:51.972610 27083 tablet.cc:2369] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 20:11:52.043923 27317 tablet.cc:2369] T ebaa8dffa52d4cd2a7a9bfeb428a677d P e03dd651846c4fedbe380653aad87fca: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:11:52.084635 27375 raft_consensus.cc:482] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:11:52.084925 27375 raft_consensus.cc:504] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e03dd651846c4fedbe380653aad87fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 39471 } } peers { permanent_uuid: "788f6af08e2c478d8143aaabe2fd7cf6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45009 } } peers { permanent_uuid: "29f2635fb37e415382cbf8dece012472" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42403 } }
I20260809 20:11:52.086690 27375 leader_election.cc:288] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e03dd651846c4fedbe380653aad87fca (127.14.181.3:39471), 788f6af08e2c478d8143aaabe2fd7cf6 (127.14.181.1:45009)
I20260809 20:11:52.095167 27362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:52.087079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:38605 (local address 127.14.181.1:45009)
0809 20:11:52.087270 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:52.087274 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:52.087986 (+ 712us) server_negotiation.cc:407] Connection header received
0809 20:11:52.088172 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:52.088178 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:52.088258 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:52.088360 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:52.089026 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:52.090120 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:52.092856 (+ 2736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:52.094056 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:52.094202 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:52.094276 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:52.094788 (+ 512us) server_negotiation.cc:299] Negotiation successful
0809 20:11:52.094914 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 20:11:52.095167 27360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:52.087031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:48905 (local address 127.14.181.3:39471)
0809 20:11:52.087249 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:52.087255 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:52.087985 (+ 730us) server_negotiation.cc:407] Connection header received
0809 20:11:52.088195 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:52.088199 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:52.088283 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:52.088366 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:52.089026 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:52.090119 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:52.092855 (+ 2736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:52.094052 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:52.094207 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:52.094279 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:52.094788 (+ 509us) server_negotiation.cc:299] Negotiation successful
0809 20:11:52.094914 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 20:11:52.095423 27382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:52.086908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:39471 (local address 127.14.181.2:48905)
0809 20:11:52.087861 (+ 953us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:52.087886 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:52.088039 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:52.088381 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:52.088386 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:52.088422 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:52.088889 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:52.088898 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:52.090258 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:52.090263 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:52.092672 (+ 2409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:52.092689 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:52.094317 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:52.094322 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:52.094587 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:52.094669 (+ 82us) client_negotiation.cc:769] Sending connection context
0809 20:11:52.094764 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 20:11:52.094946 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":838,"mutex_wait_us":280,"spinlock_wait_cycles":16896,"thread_start_us":506,"threads_started":1}
I20260809 20:11:52.095443 27379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:52.086905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:45009 (local address 127.14.181.2:38605)
0809 20:11:52.087869 (+ 964us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:52.087882 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:52.088039 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:52.088381 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:52.088386 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:52.088422 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:52.088860 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:52.088879 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:52.090258 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:52.090263 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:52.092672 (+ 2409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:52.092689 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:52.094284 (+ 1595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:52.094291 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:52.094591 (+ 300us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:52.094673 (+ 82us) client_negotiation.cc:769] Sending connection context
0809 20:11:52.094764 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 20:11:52.094946 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":807,"mutex_wait_us":218,"spinlock_wait_cycles":16256,"thread_start_us":541,"threads_started":1}
I20260809 20:11:52.096360 27237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebaa8dffa52d4cd2a7a9bfeb428a677d" candidate_uuid: "29f2635fb37e415382cbf8dece012472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03dd651846c4fedbe380653aad87fca" is_pre_election: true
I20260809 20:11:52.096480 26757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebaa8dffa52d4cd2a7a9bfeb428a677d" candidate_uuid: "29f2635fb37e415382cbf8dece012472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "788f6af08e2c478d8143aaabe2fd7cf6" is_pre_election: true
I20260809 20:11:52.096832 27237 raft_consensus.cc:2454] T ebaa8dffa52d4cd2a7a9bfeb428a677d P e03dd651846c4fedbe380653aad87fca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29f2635fb37e415382cbf8dece012472 in term 0.
I20260809 20:11:52.096904 26757 raft_consensus.cc:2454] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 788f6af08e2c478d8143aaabe2fd7cf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29f2635fb37e415382cbf8dece012472 in term 0.
I20260809 20:11:52.097462 26913 leader_election.cc:302] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29f2635fb37e415382cbf8dece012472, e03dd651846c4fedbe380653aad87fca; no voters:
I20260809 20:11:52.097847 27375 raft_consensus.cc:2781] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:11:52.098004 27375 raft_consensus.cc:482] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:11:52.098102 27375 raft_consensus.cc:3037] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:52.100390 27375 raft_consensus.cc:504] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e03dd651846c4fedbe380653aad87fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 39471 } } peers { permanent_uuid: "788f6af08e2c478d8143aaabe2fd7cf6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45009 } } peers { permanent_uuid: "29f2635fb37e415382cbf8dece012472" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42403 } }
I20260809 20:11:52.100912 27375 leader_election.cc:288] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472 [CANDIDATE]: Term 1 election: Requested vote from peers e03dd651846c4fedbe380653aad87fca (127.14.181.3:39471), 788f6af08e2c478d8143aaabe2fd7cf6 (127.14.181.1:45009)
I20260809 20:11:52.101302 27237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebaa8dffa52d4cd2a7a9bfeb428a677d" candidate_uuid: "29f2635fb37e415382cbf8dece012472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03dd651846c4fedbe380653aad87fca"
I20260809 20:11:52.101320 26757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebaa8dffa52d4cd2a7a9bfeb428a677d" candidate_uuid: "29f2635fb37e415382cbf8dece012472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "788f6af08e2c478d8143aaabe2fd7cf6"
I20260809 20:11:52.101473 26757 raft_consensus.cc:3037] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 788f6af08e2c478d8143aaabe2fd7cf6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:52.101464 27237 raft_consensus.cc:3037] T ebaa8dffa52d4cd2a7a9bfeb428a677d P e03dd651846c4fedbe380653aad87fca [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:52.103700 26757 raft_consensus.cc:2454] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 788f6af08e2c478d8143aaabe2fd7cf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29f2635fb37e415382cbf8dece012472 in term 1.
I20260809 20:11:52.103761 27237 raft_consensus.cc:2454] T ebaa8dffa52d4cd2a7a9bfeb428a677d P e03dd651846c4fedbe380653aad87fca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29f2635fb37e415382cbf8dece012472 in term 1.
I20260809 20:11:52.104066 26915 leader_election.cc:302] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29f2635fb37e415382cbf8dece012472, 788f6af08e2c478d8143aaabe2fd7cf6; no voters:
I20260809 20:11:52.104362 27375 raft_consensus.cc:2781] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:52.104797 27375 raft_consensus.cc:686] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472 [term 1 LEADER]: Becoming Leader. State: Replica: 29f2635fb37e415382cbf8dece012472, State: Running, Role: LEADER
I20260809 20:11:52.105273 27375 consensus_queue.cc:237] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e03dd651846c4fedbe380653aad87fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 39471 } } peers { permanent_uuid: "788f6af08e2c478d8143aaabe2fd7cf6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45009 } } peers { permanent_uuid: "29f2635fb37e415382cbf8dece012472" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42403 } }
I20260809 20:11:52.109982 25273 catalog_manager.cc:5495] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29f2635fb37e415382cbf8dece012472 (127.14.181.2). New cstate: current_term: 1 leader_uuid: "29f2635fb37e415382cbf8dece012472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e03dd651846c4fedbe380653aad87fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 39471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "788f6af08e2c478d8143aaabe2fd7cf6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29f2635fb37e415382cbf8dece012472" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42403 } health_report { overall_health: HEALTHY } } }
I20260809 20:11:52.140403 27364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:52.135508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47140 (local address 127.14.181.2:42403)
0809 20:11:52.135693 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:52.135698 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:52.135789 (+ 91us) server_negotiation.cc:407] Connection header received
0809 20:11:52.135986 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:52.135991 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:52.136084 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:52.136234 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:11:52.136504 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:52.137373 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:52.138679 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:52.139079 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:52.139168 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:52.139528 (+ 360us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:11:52.139986 (+ 458us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:11:52.140087 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:52.140127 (+ 40us) server_negotiation.cc:299] Negotiation successful
0809 20:11:52.140186 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 20:11:52.147918 27237 raft_consensus.cc:1261] T ebaa8dffa52d4cd2a7a9bfeb428a677d P e03dd651846c4fedbe380653aad87fca [term 1 FOLLOWER]: Refusing update from remote peer 29f2635fb37e415382cbf8dece012472: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260809 20:11:52.148048 26845 tablet.cc:2369] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 788f6af08e2c478d8143aaabe2fd7cf6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:11:52.148809 26757 raft_consensus.cc:1261] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 788f6af08e2c478d8143aaabe2fd7cf6 [term 1 FOLLOWER]: Refusing update from remote peer 29f2635fb37e415382cbf8dece012472: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:11:52.148914 27383 consensus_queue.cc:1035] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e03dd651846c4fedbe380653aad87fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 39471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:11:52.149587 27375 consensus_queue.cc:1035] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "788f6af08e2c478d8143aaabe2fd7cf6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:11:52.159492 27389 mvcc.cc:205] Tried to move back new op lower bound from 7316710654548590592 to 7316710654386335744. Current Snapshot: MvccSnapshot[applied={T|T < 7316710654548590592}]
I20260809 20:11:52.160929 27391 mvcc.cc:205] Tried to move back new op lower bound from 7316710654548590592 to 7316710654386335744. Current Snapshot: MvccSnapshot[applied={T|T < 7316710654548590592}]
I20260809 20:11:52.174662 25273 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46160:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:11:52.174927 25273 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46160:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:11:52.181136 25273 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 405a23adfdbb45138c47bfee654cc5a8: Sending DeleteTablet for 3 replicas of tablet ebaa8dffa52d4cd2a7a9bfeb428a677d
I20260809 20:11:52.182497 26731 tablet_service.cc:1514] Processing DeleteTablet for tablet ebaa8dffa52d4cd2a7a9bfeb428a677d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:52 UTC) from {username='oryx', principal='oryx/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:54756
I20260809 20:11:52.182498 27198 tablet_service.cc:1514] Processing DeleteTablet for tablet ebaa8dffa52d4cd2a7a9bfeb428a677d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:52 UTC) from {username='oryx', principal='oryx/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:36366
I20260809 20:11:52.183351 27405 tablet_replica.cc:330] T ebaa8dffa52d4cd2a7a9bfeb428a677d P e03dd651846c4fedbe380653aad87fca: stopping tablet replica
I20260809 20:11:52.183563 26980 tablet_service.cc:1514] Processing DeleteTablet for tablet ebaa8dffa52d4cd2a7a9bfeb428a677d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:52 UTC) from {username='oryx', principal='oryx/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:47132
I20260809 20:11:52.183861 27404 tablet_replica.cc:330] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 788f6af08e2c478d8143aaabe2fd7cf6: stopping tablet replica
I20260809 20:11:52.184266 27404 raft_consensus.cc:2229] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 788f6af08e2c478d8143aaabe2fd7cf6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:11:52.184720 27404 raft_consensus.cc:2258] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 788f6af08e2c478d8143aaabe2fd7cf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:52.185326 27405 raft_consensus.cc:2229] T ebaa8dffa52d4cd2a7a9bfeb428a677d P e03dd651846c4fedbe380653aad87fca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:11:52.185740 27405 raft_consensus.cc:2258] T ebaa8dffa52d4cd2a7a9bfeb428a677d P e03dd651846c4fedbe380653aad87fca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:52.188328 27405 ts_tablet_manager.cc:1905] T ebaa8dffa52d4cd2a7a9bfeb428a677d P e03dd651846c4fedbe380653aad87fca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:52.192268 27404 ts_tablet_manager.cc:1905] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 788f6af08e2c478d8143aaabe2fd7cf6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:52.195135 27408 tablet_replica.cc:330] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472: stopping tablet replica
I20260809 20:11:52.195652 27408 raft_consensus.cc:2229] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472 [term 1 LEADER]: Raft consensus shutting down.
I20260809 20:11:52.196589 27408 raft_consensus.cc:2258] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:52.197113 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 25221
I20260809 20:11:52.198431 25317 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:52.198925 27408 ts_tablet_manager.cc:1905] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:52.202828 27405 ts_tablet_manager.cc:1918] T ebaa8dffa52d4cd2a7a9bfeb428a677d P e03dd651846c4fedbe380653aad87fca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:11:52.204643 27404 ts_tablet_manager.cc:1918] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 788f6af08e2c478d8143aaabe2fd7cf6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:11:52.204872 27404 log.cc:1196] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 788f6af08e2c478d8143aaabe2fd7cf6: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/wal/wals/ebaa8dffa52d4cd2a7a9bfeb428a677d
I20260809 20:11:52.205508 27404 ts_tablet_manager.cc:1939] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 788f6af08e2c478d8143aaabe2fd7cf6: Deleting consensus metadata
I20260809 20:11:52.205729 27405 log.cc:1196] T ebaa8dffa52d4cd2a7a9bfeb428a677d P e03dd651846c4fedbe380653aad87fca: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/wal/wals/ebaa8dffa52d4cd2a7a9bfeb428a677d
I20260809 20:11:52.206390 27405 ts_tablet_manager.cc:1939] T ebaa8dffa52d4cd2a7a9bfeb428a677d P e03dd651846c4fedbe380653aad87fca: Deleting consensus metadata
I20260809 20:11:52.206825 27408 ts_tablet_manager.cc:1918] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:11:52.207039 27408 log.cc:1196] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/wal/wals/ebaa8dffa52d4cd2a7a9bfeb428a677d
I20260809 20:11:52.207717 27408 ts_tablet_manager.cc:1939] T ebaa8dffa52d4cd2a7a9bfeb428a677d P 29f2635fb37e415382cbf8dece012472: Deleting consensus metadata
I20260809 20:11:52.225740 27340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:52.186413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51552 (local address 127.14.181.61:37669)
0809 20:11:52.186588 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:52.186595 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:52.195570 (+ 8975us) server_negotiation.cc:407] Connection header received
0809 20:11:52.207423 (+ 11853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:52.207430 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:52.207531 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:52.207615 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:52.210075 (+ 2460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:52.211276 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:52.213345 (+ 2069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:52.214035 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:52.214135 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:52.217937 (+ 3802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:52.217944 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:52.217949 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:52.217992 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:52.221619 (+ 3627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:52.222635 (+ 1016us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:52.222641 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:52.222645 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:52.222844 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:52.223378 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:52.223383 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:52.223386 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:52.223822 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:52.224098 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:52.225072 (+ 974us) server_negotiation.cc:299] Negotiation successful
0809 20:11:52.225411 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 20:11:52.243350 27323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:52.196053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41274 (local address 127.14.181.60:41321)
0809 20:11:52.196204 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:52.196209 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:52.227200 (+ 30991us) server_negotiation.cc:407] Connection header received
0809 20:11:52.227475 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:52.227481 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:52.227568 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:52.227640 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:52.229475 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:52.230558 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:52.232407 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:52.233032 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:52.233129 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:52.236601 (+ 3472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:52.236608 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:52.236613 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:52.236652 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:52.240170 (+ 3518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:52.240998 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:52.241003 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:52.241007 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:52.241194 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:52.241645 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:52.241651 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:52.241654 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:52.241998 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:52.242223 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:52.242797 (+ 574us) server_negotiation.cc:299] Negotiation successful
0809 20:11:52.243005 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 20:11:52.345844 25251 catalog_manager.cc:4841] TS 788f6af08e2c478d8143aaabe2fd7cf6 (127.14.181.1:45009): tablet ebaa8dffa52d4cd2a7a9bfeb428a677d (table test-table [id=39144987b64c42388092d6a2f461bb0a]) successfully deleted
W20260809 20:11:52.346145 25251 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.14.181.1:45009, user_credentials={real_user=slave}} blocked reactor thread for 137799us
I20260809 20:11:52.347255 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 25221
W20260809 20:11:52.381531 27121 connection.cc:535] server connection from 127.0.0.1:36366 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 20:11:52.405931 27340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:52.388179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51564 (local address 127.14.181.61:37669)
0809 20:11:52.388401 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:52.388408 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:52.389363 (+ 955us) server_negotiation.cc:407] Connection header received
0809 20:11:52.389646 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:52.389652 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:52.389756 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:52.389828 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:52.392205 (+ 2377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:52.393361 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:52.394654 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:52.395303 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:52.395433 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:52.399824 (+ 4391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:52.399830 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:52.399834 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:52.399870 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:52.403264 (+ 3394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:52.404035 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:52.404041 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:52.404045 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:52.404175 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:52.404590 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:52.404595 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:52.404598 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:52.404920 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:52.405154 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:52.405472 (+ 318us) server_negotiation.cc:299] Negotiation successful
0809 20:11:52.405628 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260809 20:11:52.406862 27323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:52.389411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41276 (local address 127.14.181.60:41321)
0809 20:11:52.389631 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:52.389638 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:52.389659 (+ 21us) server_negotiation.cc:407] Connection header received
0809 20:11:52.389812 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:52.389818 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:52.389899 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:52.390000 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:52.393564 (+ 3564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:52.394708 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:52.396220 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:52.396873 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:52.397021 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:52.399714 (+ 2693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:52.399720 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:52.399724 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:52.399763 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:52.403002 (+ 3239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:52.403763 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:52.403769 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:52.403773 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:52.403916 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:52.404547 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:52.404553 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:52.404556 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:52.404920 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:52.405156 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:52.406283 (+ 1127us) server_negotiation.cc:299] Negotiation successful
0809 20:11:52.406537 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 20:11:53.169545 27426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:53.168860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.14.181.2:56371)
0809 20:11:53.169271 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:53.169382 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":215,"threads_started":1}
W20260809 20:11:53.170073 27080 heartbeater.cc:644] Failed to heartbeat to 127.14.181.62:39865 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
I20260809 20:11:53.171092 27428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:53.170325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.14.181.1:57275)
0809 20:11:53.170787 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:53.170918 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":231,"threads_started":1}
W20260809 20:11:53.171509 26843 heartbeater.cc:644] Failed to heartbeat to 127.14.181.62:39865 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
I20260809 20:11:53.172748 27429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:53.172042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.14.181.3:46221)
0809 20:11:53.172451 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:53.172568 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":240,"threads_started":1}
W20260809 20:11:53.173079 27310 heartbeater.cc:644] Failed to heartbeat to 127.14.181.62:39865 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
I20260809 20:11:53.682222 27430 raft_consensus.cc:482] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 405a23adfdbb45138c47bfee654cc5a8)
I20260809 20:11:53.682427 27431 raft_consensus.cc:482] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 405a23adfdbb45138c47bfee654cc5a8)
I20260809 20:11:53.682555 27430 raft_consensus.cc:504] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: false } }
I20260809 20:11:53.682657 27431 raft_consensus.cc:504] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: false } }
I20260809 20:11:53.684118 27430 leader_election.cc:288] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 405a23adfdbb45138c47bfee654cc5a8 (127.14.181.62:39865), e73d6d5b3a52489995316da66349e3b9 (127.14.181.60:41321)
I20260809 20:11:53.690325 27431 leader_election.cc:288] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 405a23adfdbb45138c47bfee654cc5a8 (127.14.181.62:39865), ae4c504732ae4c32bc8e160ec9d1ac14 (127.14.181.61:37669)
I20260809 20:11:53.694309 27440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:53.684147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.0.0.1:46508)
0809 20:11:53.693846 (+ 9699us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:53.694047 (+ 201us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":9565,"threads_started":1}
I20260809 20:11:53.695930 27437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:53.684147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.0.0.1:46510)
0809 20:11:53.695457 (+ 11310us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:53.695648 (+ 191us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11185,"threads_started":1}
W20260809 20:11:53.697520 26223 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
W20260809 20:11:53.698129 26528 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
I20260809 20:11:53.703801 27437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:53.684312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:37669 (local address 127.0.0.1:51576)
0809 20:11:53.696367 (+ 12055us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:53.696385 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:53.696501 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:53.697325 (+ 824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:53.697330 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:53.697358 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:53.697561 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:53.697569 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:53.699450 (+ 1881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:53.699456 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:53.701429 (+ 1973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:53.701445 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:53.703089 (+ 1644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:53.703096 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:53.703272 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:53.703311 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 20:11:53.703383 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 20:11:53.703509 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11964,"thread_start_us":11746,"threads_started":1}
I20260809 20:11:53.705041 27438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:53.684474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51576 (local address 127.14.181.61:37669)
0809 20:11:53.696987 (+ 12513us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:53.696993 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:53.697012 (+ 19us) server_negotiation.cc:407] Connection header received
0809 20:11:53.697068 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:53.697073 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:53.697154 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:53.697667 (+ 513us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:53.697891 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:53.699270 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:53.701618 (+ 2348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:53.702917 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:53.704386 (+ 1469us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:53.704508 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:53.704555 (+ 47us) server_negotiation.cc:299] Negotiation successful
0809 20:11:53.704672 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":8,"server-negotiator.queue_time_us":12416,"thread_start_us":12237,"threads_started":1}
I20260809 20:11:53.705094 27440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:53.684533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41321 (local address 127.0.0.1:41292)
0809 20:11:53.695505 (+ 10972us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:53.695527 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:53.695647 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:53.698470 (+ 2823us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:53.698476 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:53.698505 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:53.698821 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:53.698837 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:53.700646 (+ 1809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:53.700652 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:53.702688 (+ 2036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:53.702704 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:53.704377 (+ 1673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:53.704383 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:53.704594 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:53.704624 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 20:11:53.704681 (+ 57us) client_negotiation.cc:240] Negotiation successful
0809 20:11:53.704800 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10894,"mutex_wait_us":6,"thread_start_us":9052,"threads_started":1}
I20260809 20:11:53.705520 27434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:53.704956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.0.0.1:46518)
0809 20:11:53.705117 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:53.705298 (+ 181us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 20:11:53.705804 27441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:53.697239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41292 (local address 127.14.181.60:41321)
0809 20:11:53.698136 (+ 897us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:53.698142 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:53.698157 (+ 15us) server_negotiation.cc:407] Connection header received
0809 20:11:53.698228 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:53.698233 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:53.698293 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:53.698956 (+ 663us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:53.699172 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:53.700499 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:53.702909 (+ 2410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:53.704182 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:53.705219 (+ 1037us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:53.705315 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:53.705365 (+ 50us) server_negotiation.cc:299] Negotiation successful
0809 20:11:53.705487 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":777,"thread_start_us":682,"threads_started":1}
I20260809 20:11:53.705945 27437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:53.705551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.0.0.1:46526)
0809 20:11:53.705684 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:53.705762 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 20:11:53.705864 26223 leader_election.cc:334] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 405a23adfdbb45138c47bfee654cc5a8 (127.14.181.62:39865): Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
I20260809 20:11:53.705994 26258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e73d6d5b3a52489995316da66349e3b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" is_pre_election: true
I20260809 20:11:53.706301 26258 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e73d6d5b3a52489995316da66349e3b9 in term 1.
W20260809 20:11:53.706270 26528 leader_election.cc:334] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 405a23adfdbb45138c47bfee654cc5a8 (127.14.181.62:39865): Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
I20260809 20:11:53.706801 26526 leader_election.cc:302] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae4c504732ae4c32bc8e160ec9d1ac14, e73d6d5b3a52489995316da66349e3b9; no voters: 405a23adfdbb45138c47bfee654cc5a8
I20260809 20:11:53.706842 26568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e73d6d5b3a52489995316da66349e3b9" is_pre_election: true
I20260809 20:11:53.707122 26568 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae4c504732ae4c32bc8e160ec9d1ac14 in term 1.
I20260809 20:11:53.707296 27431 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 20:11:53.707415 27431 raft_consensus.cc:482] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 405a23adfdbb45138c47bfee654cc5a8)
I20260809 20:11:53.707507 27431 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [term 1 FOLLOWER]: Advancing to term 2
I20260809 20:11:53.707605 26216 leader_election.cc:302] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae4c504732ae4c32bc8e160ec9d1ac14, e73d6d5b3a52489995316da66349e3b9; no voters: 405a23adfdbb45138c47bfee654cc5a8
I20260809 20:11:53.707901 27430 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 20:11:53.708021 27430 raft_consensus.cc:482] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 405a23adfdbb45138c47bfee654cc5a8)
I20260809 20:11:53.708109 27430 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 1 FOLLOWER]: Advancing to term 2
I20260809 20:11:53.710404 27431 raft_consensus.cc:504] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: false } }
I20260809 20:11:53.710839 27430 raft_consensus.cc:504] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: false } }
I20260809 20:11:53.711068 27431 leader_election.cc:288] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [CANDIDATE]: Term 2 election: Requested vote from peers 405a23adfdbb45138c47bfee654cc5a8 (127.14.181.62:39865), ae4c504732ae4c32bc8e160ec9d1ac14 (127.14.181.61:37669)
I20260809 20:11:53.711472 27437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:53.711126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.0.0.1:46530)
0809 20:11:53.711260 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:53.711347 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 20:11:53.711540 26258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e73d6d5b3a52489995316da66349e3b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14"
I20260809 20:11:53.711766 27430 leader_election.cc:288] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [CANDIDATE]: Term 2 election: Requested vote from peers 405a23adfdbb45138c47bfee654cc5a8 (127.14.181.62:39865), e73d6d5b3a52489995316da66349e3b9 (127.14.181.60:41321)
I20260809 20:11:53.711951 27434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:53.711599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.0.0.1:46534)
0809 20:11:53.711717 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:53.711798 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260809 20:11:53.711792 26258 raft_consensus.cc:2379] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e73d6d5b3a52489995316da66349e3b9 in current term 2: Already voted for candidate ae4c504732ae4c32bc8e160ec9d1ac14 in this term.
I20260809 20:11:53.712065 26568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e73d6d5b3a52489995316da66349e3b9"
I20260809 20:11:53.712320 26568 raft_consensus.cc:2379] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ae4c504732ae4c32bc8e160ec9d1ac14 in current term 2: Already voted for candidate e73d6d5b3a52489995316da66349e3b9 in this term.
I20260809 20:11:53.713028 27437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:53.712674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.0.0.1:46542)
0809 20:11:53.712813 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:53.712887 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 20:11:53.713608 26528 leader_election.cc:334] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 405a23adfdbb45138c47bfee654cc5a8 (127.14.181.62:39865): Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
I20260809 20:11:53.713737 26528 leader_election.cc:302] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e73d6d5b3a52489995316da66349e3b9; no voters: 405a23adfdbb45138c47bfee654cc5a8, ae4c504732ae4c32bc8e160ec9d1ac14
I20260809 20:11:53.713827 27434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:53.712673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.0.0.1:46538)
0809 20:11:53.713596 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:53.713675 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":830}
I20260809 20:11:53.714016 27431 raft_consensus.cc:2726] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260809 20:11:53.714011 26223 leader_election.cc:334] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 405a23adfdbb45138c47bfee654cc5a8 (127.14.181.62:39865): Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
I20260809 20:11:53.714120 26223 leader_election.cc:302] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae4c504732ae4c32bc8e160ec9d1ac14; no voters: 405a23adfdbb45138c47bfee654cc5a8, e73d6d5b3a52489995316da66349e3b9
I20260809 20:11:53.714391 27430 raft_consensus.cc:2726] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260809 20:11:54.171564 27446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:54.170767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.14.181.2:33335)
0809 20:11:54.171277 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:54.171378 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":239,"threads_started":1}
I20260809 20:11:54.173350 27447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:54.172163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.14.181.1:55145)
0809 20:11:54.173057 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:54.173153 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":788,"thread_start_us":691,"threads_started":1}
I20260809 20:11:54.174892 27448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:54.173641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.14.181.3:53043)
0809 20:11:54.174660 (+ 1019us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:54.174735 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":925,"thread_start_us":829,"threads_started":1}
I20260809 20:11:55.172992 27449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.172286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.14.181.2:54833)
0809 20:11:55.172723 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:55.172812 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":228,"threads_started":1}
I20260809 20:11:55.175257 27450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.174445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.14.181.1:57031)
0809 20:11:55.174954 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:55.175052 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":338,"threads_started":1}
I20260809 20:11:55.176347 27451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.175651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.14.181.3:36299)
0809 20:11:55.176135 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:55.176213 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":300,"threads_started":1}
I20260809 20:11:55.417292 27453 raft_consensus.cc:482] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:11:55.417465 27453 raft_consensus.cc:504] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: false } }
I20260809 20:11:55.417979 27453 leader_election.cc:288] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 405a23adfdbb45138c47bfee654cc5a8 (127.14.181.62:39865), e73d6d5b3a52489995316da66349e3b9 (127.14.181.60:41321)
I20260809 20:11:55.418465 26568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e73d6d5b3a52489995316da66349e3b9" is_pre_election: true
I20260809 20:11:55.418673 26568 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae4c504732ae4c32bc8e160ec9d1ac14 in term 2.
I20260809 20:11:55.418922 27454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.418142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.0.0.1:46824)
0809 20:11:55.418612 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:55.418735 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":251,"threads_started":1}
I20260809 20:11:55.419090 26216 leader_election.cc:302] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae4c504732ae4c32bc8e160ec9d1ac14, e73d6d5b3a52489995316da66349e3b9; no voters:
I20260809 20:11:55.419394 27453 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260809 20:11:55.419528 27453 raft_consensus.cc:482] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:11:55.419633 27453 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 2 FOLLOWER]: Advancing to term 3
I20260809 20:11:55.420354 27454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.419939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.0.0.1:46832)
0809 20:11:55.420117 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:55.420203 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260809 20:11:55.420542 26223 leader_election.cc:334] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 405a23adfdbb45138c47bfee654cc5a8 (127.14.181.62:39865): Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
I20260809 20:11:55.421943 27453 raft_consensus.cc:504] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: false } }
I20260809 20:11:55.422533 27453 leader_election.cc:288] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [CANDIDATE]: Term 3 election: Requested vote from peers 405a23adfdbb45138c47bfee654cc5a8 (127.14.181.62:39865), e73d6d5b3a52489995316da66349e3b9 (127.14.181.60:41321)
I20260809 20:11:55.422971 27454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.422592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.0.0.1:46834)
0809 20:11:55.422753 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:55.422833 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260809 20:11:55.423022 26568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e73d6d5b3a52489995316da66349e3b9"
I20260809 20:11:55.423225 26568 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [term 2 FOLLOWER]: Advancing to term 3
I20260809 20:11:55.423877 27454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.423518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.0.0.1:46840)
0809 20:11:55.423668 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:55.423748 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 20:11:55.424050 26223 leader_election.cc:334] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 405a23adfdbb45138c47bfee654cc5a8 (127.14.181.62:39865): Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
I20260809 20:11:55.425432 26568 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae4c504732ae4c32bc8e160ec9d1ac14 in term 3.
I20260809 20:11:55.425755 26216 leader_election.cc:302] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae4c504732ae4c32bc8e160ec9d1ac14, e73d6d5b3a52489995316da66349e3b9; no voters: 405a23adfdbb45138c47bfee654cc5a8
I20260809 20:11:55.426002 27453 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 20:11:55.426384 27453 raft_consensus.cc:686] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [term 3 LEADER]: Becoming Leader. State: Replica: ae4c504732ae4c32bc8e160ec9d1ac14, State: Running, Role: LEADER
I20260809 20:11:55.426744 27453 consensus_queue.cc:237] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: false } }
I20260809 20:11:55.428483 27460 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ae4c504732ae4c32bc8e160ec9d1ac14. Latest consensus state: current_term: 3 leader_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: false } } }
I20260809 20:11:55.428792 27460 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:55.429392 27466 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:11:55.433320 27466 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:11:55.434099 27466 catalog_manager.cc:1259] Loaded cluster ID: 2139cd6844304a8690178ebf4e4486c9
I20260809 20:11:55.434168 27466 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:11:55.435315 27466 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:11:55.436157 27466 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14: Loaded TSK: 0
I20260809 20:11:55.437021 27466 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:11:55.483364 26245 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51564:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 20:11:55.490010 26245 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 20:11:55.493664 27454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.493296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.0.0.1:46860)
0809 20:11:55.493469 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:55.493538 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260809 20:11:55.493741 26568 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [term 3 FOLLOWER]: Refusing update from remote peer ae4c504732ae4c32bc8e160ec9d1ac14: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260809 20:11:55.494426 27460 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260809 20:11:55.494587 27454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.494221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.0.0.1:46874)
0809 20:11:55.494404 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:55.494477 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 20:11:55.494752 26223 consensus_peers.cc:487] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 -> Peer 405a23adfdbb45138c47bfee654cc5a8 (127.14.181.62:39865): Couldn't send request to peer 405a23adfdbb45138c47bfee654cc5a8. Status: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 20:11:55.496680 27468 sys_catalog.cc:455] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ae4c504732ae4c32bc8e160ec9d1ac14. Latest consensus state: current_term: 3 leader_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: false } } }
I20260809 20:11:55.496924 27468 sys_catalog.cc:458] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 20:11:55.498284 27460 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: false } } }
I20260809 20:11:55.498569 27460 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:55.499238 27468 sys_catalog.cc:455] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "405a23adfdbb45138c47bfee654cc5a8" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39865 } } peers { permanent_uuid: "ae4c504732ae4c32bc8e160ec9d1ac14" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 37669 } attrs { promote: false } } peers { permanent_uuid: "e73d6d5b3a52489995316da66349e3b9" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41321 } attrs { promote: false } } }
I20260809 20:11:55.499565 27468 sys_catalog.cc:458] T 00000000000000000000000000000000 P e73d6d5b3a52489995316da66349e3b9 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 20:11:55.517050 27479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.506138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:42403 (local address 127.0.0.1:47146)
0809 20:11:55.506679 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:55.506701 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:55.506801 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:55.510431 (+ 3630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:55.510437 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:55.510465 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:55.510793 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:55.510805 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:55.512335 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:55.512341 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:55.514533 (+ 2192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:55.514550 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:55.516204 (+ 1654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:55.516211 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:55.516410 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:55.516449 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 20:11:55.516536 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 20:11:55.516682 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":289,"threads_started":1}
I20260809 20:11:55.517833 27483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.506581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47146 (local address 127.14.181.2:42403)
0809 20:11:55.507032 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:55.507038 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:55.507058 (+ 20us) server_negotiation.cc:407] Connection header received
0809 20:11:55.507132 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:55.507138 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:55.507215 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:55.507312 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:55.511026 (+ 3714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:55.512202 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:55.514709 (+ 2507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:55.516032 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:55.516172 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:55.516286 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:55.516585 (+ 299us) server_negotiation.cc:299] Negotiation successful
0809 20:11:55.516738 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":303,"threads_started":1}
I20260809 20:11:55.518903 26980 tablet_service.cc:1467] Processing CreateTablet for tablet 7e5e0d873c2c4ce4a89b02c3d2316692 (DEFAULT_TABLE table=test-table [id=b216b91505f54653bf31e954ada913ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:55.519344 26980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e5e0d873c2c4ce4a89b02c3d2316692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:55.523617 27454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.505825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:45009 (local address 127.0.0.1:54770)
0809 20:11:55.506248 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:55.506272 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:55.506776 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:55.517982 (+ 11206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:55.517987 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:55.518013 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:55.518253 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:55.518262 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:55.519934 (+ 1672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:55.519939 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:55.521408 (+ 1469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:55.521420 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:55.522903 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:55.522910 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:55.523077 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:55.523109 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 20:11:55.523195 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 20:11:55.523323 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"mutex_wait_us":1}
I20260809 20:11:55.523792 27477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.505991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54770 (local address 127.14.181.1:45009)
0809 20:11:55.517565 (+ 11574us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:55.517571 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:55.517591 (+ 20us) server_negotiation.cc:407] Connection header received
0809 20:11:55.517658 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:55.517663 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:55.517741 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:55.518625 (+ 884us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:55.518820 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:55.519792 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:55.521586 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:55.522730 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:55.522864 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:55.522969 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:55.523239 (+ 270us) server_negotiation.cc:299] Negotiation successful
0809 20:11:55.523376 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11436,"thread_start_us":11829,"threads_started":1}
I20260809 20:11:55.524458 26731 tablet_service.cc:1467] Processing CreateTablet for tablet 7e5e0d873c2c4ce4a89b02c3d2316692 (DEFAULT_TABLE table=test-table [id=b216b91505f54653bf31e954ada913ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:55.524897 26731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e5e0d873c2c4ce4a89b02c3d2316692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:55.525014 27484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.506744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:39471 (local address 127.0.0.1:36374)
0809 20:11:55.507908 (+ 1164us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:55.507925 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:55.508030 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:55.518983 (+ 10953us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:55.518988 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:55.519012 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:11:55.519277 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:55.519285 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:55.520465 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:55.520470 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:55.522615 (+ 2145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:55.522630 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:55.524203 (+ 1573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:55.524209 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:55.524367 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:55.524396 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 20:11:55.524471 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 20:11:55.524587 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1028,"mutex_wait_us":28,"thread_start_us":881,"threads_started":1}
I20260809 20:11:55.525259 27487 tablet_bootstrap.cc:492] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472: Bootstrap starting.
I20260809 20:11:55.526872 27487 tablet_bootstrap.cc:654] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:55.528525 27487 tablet_bootstrap.cc:492] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472: No bootstrap required, opened a new log
I20260809 20:11:55.528647 27487 ts_tablet_manager.cc:1397] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.003s
I20260809 20:11:55.529243 27487 raft_consensus.cc:348] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "788f6af08e2c478d8143aaabe2fd7cf6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45009 } } peers { permanent_uuid: "29f2635fb37e415382cbf8dece012472" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42403 } } peers { permanent_uuid: "e03dd651846c4fedbe380653aad87fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 39471 } }
I20260809 20:11:55.529412 27487 raft_consensus.cc:374] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:55.529500 27487 raft_consensus.cc:729] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29f2635fb37e415382cbf8dece012472, State: Initialized, Role: FOLLOWER
I20260809 20:11:55.529711 27487 consensus_queue.cc:260] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "788f6af08e2c478d8143aaabe2fd7cf6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45009 } } peers { permanent_uuid: "29f2635fb37e415382cbf8dece012472" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42403 } } peers { permanent_uuid: "e03dd651846c4fedbe380653aad87fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 39471 } }
I20260809 20:11:55.530004 27491 tablet_bootstrap.cc:492] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 788f6af08e2c478d8143aaabe2fd7cf6: Bootstrap starting.
I20260809 20:11:55.530542 27485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.507146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36374 (local address 127.14.181.3:39471)
0809 20:11:55.518732 (+ 11586us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:55.518736 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:55.518751 (+ 15us) server_negotiation.cc:407] Connection header received
0809 20:11:55.518806 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:55.518810 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:55.518863 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:55.518951 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:11:55.519418 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:55.520320 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:55.522771 (+ 2451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:55.524018 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:55.529896 (+ 5878us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:55.530022 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:55.530079 (+ 57us) server_negotiation.cc:299] Negotiation successful
0809 20:11:55.530228 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11477,"thread_start_us":11362,"threads_started":1}
I20260809 20:11:55.531327 27198 tablet_service.cc:1467] Processing CreateTablet for tablet 7e5e0d873c2c4ce4a89b02c3d2316692 (DEFAULT_TABLE table=test-table [id=b216b91505f54653bf31e954ada913ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:11:55.531730 27198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e5e0d873c2c4ce4a89b02c3d2316692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:55.531733 27491 tablet_bootstrap.cc:654] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 788f6af08e2c478d8143aaabe2fd7cf6: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:55.533881 27491 tablet_bootstrap.cc:492] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 788f6af08e2c478d8143aaabe2fd7cf6: No bootstrap required, opened a new log
I20260809 20:11:55.533998 27491 ts_tablet_manager.cc:1397] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 788f6af08e2c478d8143aaabe2fd7cf6: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260809 20:11:55.534776 27491 raft_consensus.cc:348] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 788f6af08e2c478d8143aaabe2fd7cf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "788f6af08e2c478d8143aaabe2fd7cf6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45009 } } peers { permanent_uuid: "29f2635fb37e415382cbf8dece012472" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42403 } } peers { permanent_uuid: "e03dd651846c4fedbe380653aad87fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 39471 } }
I20260809 20:11:55.534996 27491 raft_consensus.cc:374] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 788f6af08e2c478d8143aaabe2fd7cf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:55.535079 27491 raft_consensus.cc:729] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 788f6af08e2c478d8143aaabe2fd7cf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 788f6af08e2c478d8143aaabe2fd7cf6, State: Initialized, Role: FOLLOWER
I20260809 20:11:55.535301 27491 consensus_queue.cc:260] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 788f6af08e2c478d8143aaabe2fd7cf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "788f6af08e2c478d8143aaabe2fd7cf6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45009 } } peers { permanent_uuid: "29f2635fb37e415382cbf8dece012472" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42403 } } peers { permanent_uuid: "e03dd651846c4fedbe380653aad87fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 39471 } }
I20260809 20:11:55.536104 27491 ts_tablet_manager.cc:1428] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 788f6af08e2c478d8143aaabe2fd7cf6: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 20:11:55.536536 27487 ts_tablet_manager.cc:1428] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472: Time spent starting tablet: real 0.008s user 0.000s sys 0.008s
I20260809 20:11:55.537060 27450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.536673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.14.181.1:50695)
0809 20:11:55.536811 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:55.536910 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 20:11:55.539337 27450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.538041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.14.181.1:56535)
0809 20:11:55.538995 (+ 954us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:55.539080 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":849}
I20260809 20:11:55.541064 27449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.540621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.14.181.2:47907)
0809 20:11:55.540832 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:55.540922 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
I20260809 20:11:55.542320 27449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.541875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.14.181.2:44743)
0809 20:11:55.542079 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:55.542170 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
I20260809 20:11:55.542975 27501 tablet_bootstrap.cc:492] T 7e5e0d873c2c4ce4a89b02c3d2316692 P e03dd651846c4fedbe380653aad87fca: Bootstrap starting.
I20260809 20:11:55.544237 27082 heartbeater.cc:503] Master 127.14.181.61:37669 was elected leader, sending a full tablet report...
I20260809 20:11:55.544704 27501 tablet_bootstrap.cc:654] T 7e5e0d873c2c4ce4a89b02c3d2316692 P e03dd651846c4fedbe380653aad87fca: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:55.546657 27501 tablet_bootstrap.cc:492] T 7e5e0d873c2c4ce4a89b02c3d2316692 P e03dd651846c4fedbe380653aad87fca: No bootstrap required, opened a new log
I20260809 20:11:55.546785 27501 ts_tablet_manager.cc:1397] T 7e5e0d873c2c4ce4a89b02c3d2316692 P e03dd651846c4fedbe380653aad87fca: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260809 20:11:55.547385 27501 raft_consensus.cc:348] T 7e5e0d873c2c4ce4a89b02c3d2316692 P e03dd651846c4fedbe380653aad87fca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "788f6af08e2c478d8143aaabe2fd7cf6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45009 } } peers { permanent_uuid: "29f2635fb37e415382cbf8dece012472" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42403 } } peers { permanent_uuid: "e03dd651846c4fedbe380653aad87fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 39471 } }
I20260809 20:11:55.547606 27501 raft_consensus.cc:374] T 7e5e0d873c2c4ce4a89b02c3d2316692 P e03dd651846c4fedbe380653aad87fca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:55.547717 27501 raft_consensus.cc:729] T 7e5e0d873c2c4ce4a89b02c3d2316692 P e03dd651846c4fedbe380653aad87fca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e03dd651846c4fedbe380653aad87fca, State: Initialized, Role: FOLLOWER
I20260809 20:11:55.548027 27501 consensus_queue.cc:260] T 7e5e0d873c2c4ce4a89b02c3d2316692 P e03dd651846c4fedbe380653aad87fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "788f6af08e2c478d8143aaabe2fd7cf6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45009 } } peers { permanent_uuid: "29f2635fb37e415382cbf8dece012472" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42403 } } peers { permanent_uuid: "e03dd651846c4fedbe380653aad87fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 39471 } }
I20260809 20:11:55.548715 27501 ts_tablet_manager.cc:1428] T 7e5e0d873c2c4ce4a89b02c3d2316692 P e03dd651846c4fedbe380653aad87fca: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 20:11:55.549723 27451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.549324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.14.181.3:60619)
0809 20:11:55.549485 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:55.549575 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260809 20:11:55.550835 27311 heartbeater.cc:503] Master 127.14.181.61:37669 was elected leader, sending a full tablet report...
I20260809 20:11:55.551000 27451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.550558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.14.181.3:51899)
0809 20:11:55.550712 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:55.550796 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260809 20:11:55.763208 27495 raft_consensus.cc:482] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:11:55.763451 27495 raft_consensus.cc:504] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "788f6af08e2c478d8143aaabe2fd7cf6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45009 } } peers { permanent_uuid: "29f2635fb37e415382cbf8dece012472" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42403 } } peers { permanent_uuid: "e03dd651846c4fedbe380653aad87fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 39471 } }
I20260809 20:11:55.764161 27495 leader_election.cc:288] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 788f6af08e2c478d8143aaabe2fd7cf6 (127.14.181.1:45009), e03dd651846c4fedbe380653aad87fca (127.14.181.3:39471)
I20260809 20:11:55.764644 26757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e5e0d873c2c4ce4a89b02c3d2316692" candidate_uuid: "29f2635fb37e415382cbf8dece012472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "788f6af08e2c478d8143aaabe2fd7cf6" is_pre_election: true
I20260809 20:11:55.764703 27237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e5e0d873c2c4ce4a89b02c3d2316692" candidate_uuid: "29f2635fb37e415382cbf8dece012472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03dd651846c4fedbe380653aad87fca" is_pre_election: true
I20260809 20:11:55.764873 26757 raft_consensus.cc:2454] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 788f6af08e2c478d8143aaabe2fd7cf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29f2635fb37e415382cbf8dece012472 in term 0.
I20260809 20:11:55.764942 27237 raft_consensus.cc:2454] T 7e5e0d873c2c4ce4a89b02c3d2316692 P e03dd651846c4fedbe380653aad87fca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29f2635fb37e415382cbf8dece012472 in term 0.
I20260809 20:11:55.765336 26915 leader_election.cc:302] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29f2635fb37e415382cbf8dece012472, 788f6af08e2c478d8143aaabe2fd7cf6; no voters:
I20260809 20:11:55.765586 27495 raft_consensus.cc:2781] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:11:55.765688 27495 raft_consensus.cc:482] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:11:55.765795 27495 raft_consensus.cc:3037] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:55.767974 27495 raft_consensus.cc:504] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "788f6af08e2c478d8143aaabe2fd7cf6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45009 } } peers { permanent_uuid: "29f2635fb37e415382cbf8dece012472" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42403 } } peers { permanent_uuid: "e03dd651846c4fedbe380653aad87fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 39471 } }
I20260809 20:11:55.768443 27495 leader_election.cc:288] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472 [CANDIDATE]: Term 1 election: Requested vote from peers 788f6af08e2c478d8143aaabe2fd7cf6 (127.14.181.1:45009), e03dd651846c4fedbe380653aad87fca (127.14.181.3:39471)
I20260809 20:11:55.768904 26757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e5e0d873c2c4ce4a89b02c3d2316692" candidate_uuid: "29f2635fb37e415382cbf8dece012472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "788f6af08e2c478d8143aaabe2fd7cf6"
I20260809 20:11:55.768942 27237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e5e0d873c2c4ce4a89b02c3d2316692" candidate_uuid: "29f2635fb37e415382cbf8dece012472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03dd651846c4fedbe380653aad87fca"
I20260809 20:11:55.769104 27237 raft_consensus.cc:3037] T 7e5e0d873c2c4ce4a89b02c3d2316692 P e03dd651846c4fedbe380653aad87fca [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:55.769151 26757 raft_consensus.cc:3037] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 788f6af08e2c478d8143aaabe2fd7cf6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:55.771984 26757 raft_consensus.cc:2454] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 788f6af08e2c478d8143aaabe2fd7cf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29f2635fb37e415382cbf8dece012472 in term 1.
I20260809 20:11:55.771984 27237 raft_consensus.cc:2454] T 7e5e0d873c2c4ce4a89b02c3d2316692 P e03dd651846c4fedbe380653aad87fca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29f2635fb37e415382cbf8dece012472 in term 1.
I20260809 20:11:55.772384 26915 leader_election.cc:302] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29f2635fb37e415382cbf8dece012472, 788f6af08e2c478d8143aaabe2fd7cf6; no voters:
I20260809 20:11:55.772643 27495 raft_consensus.cc:2781] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:55.773030 27495 raft_consensus.cc:686] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472 [term 1 LEADER]: Becoming Leader. State: Replica: 29f2635fb37e415382cbf8dece012472, State: Running, Role: LEADER
I20260809 20:11:55.773464 27495 consensus_queue.cc:237] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "788f6af08e2c478d8143aaabe2fd7cf6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45009 } } peers { permanent_uuid: "29f2635fb37e415382cbf8dece012472" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42403 } } peers { permanent_uuid: "e03dd651846c4fedbe380653aad87fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 39471 } }
I20260809 20:11:55.773959 27449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.773557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.14.181.2:52397)
0809 20:11:55.773727 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:55.773805 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 20:11:55.776018 26245 catalog_manager.cc:5495] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29f2635fb37e415382cbf8dece012472 (127.14.181.2). New cstate: current_term: 1 leader_uuid: "29f2635fb37e415382cbf8dece012472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "788f6af08e2c478d8143aaabe2fd7cf6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29f2635fb37e415382cbf8dece012472" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 42403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e03dd651846c4fedbe380653aad87fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 39471 } health_report { overall_health: UNKNOWN } } }
I20260809 20:11:55.807018 27483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.802648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35962 (local address 127.14.181.2:42403)
0809 20:11:55.802837 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:55.802842 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:55.802860 (+ 18us) server_negotiation.cc:407] Connection header received
0809 20:11:55.803011 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:55.803016 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:55.803082 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:55.803153 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:11:55.803525 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:55.804196 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:55.805472 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:55.805896 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:55.805999 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:55.806402 (+ 403us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:11:55.806502 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:11:55.806576 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:55.806718 (+ 142us) server_negotiation.cc:299] Negotiation successful
0809 20:11:55.806791 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 20:11:55.809562 27237 raft_consensus.cc:1261] T 7e5e0d873c2c4ce4a89b02c3d2316692 P e03dd651846c4fedbe380653aad87fca [term 1 FOLLOWER]: Refusing update from remote peer 29f2635fb37e415382cbf8dece012472: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:11:55.809691 26757 raft_consensus.cc:1261] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 788f6af08e2c478d8143aaabe2fd7cf6 [term 1 FOLLOWER]: Refusing update from remote peer 29f2635fb37e415382cbf8dece012472: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:11:55.810150 27506 consensus_queue.cc:1035] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e03dd651846c4fedbe380653aad87fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 39471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:11:55.810456 27495 consensus_queue.cc:1035] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "788f6af08e2c478d8143aaabe2fd7cf6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:11:55.811815 26844 heartbeater.cc:503] Master 127.14.181.61:37669 was elected leader, sending a full tablet report...
I20260809 20:11:55.813040 27451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.812254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.14.181.3:45845)
0809 20:11:55.812807 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:55.812905 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":436}
I20260809 20:11:55.814440 27450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.814015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.14.181.1:44757)
0809 20:11:55.814201 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:55.814270 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260809 20:11:55.817852 27449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.817376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.14.181.2:59591)
0809 20:11:55.817580 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:55.817668 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260809 20:11:55.818329 27450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.817872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.14.181.1:40545)
0809 20:11:55.818074 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:55.818165 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260809 20:11:55.823601 26243 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51564:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:11:55.823858 26243 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51564:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:11:55.825296 27449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.824916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.14.181.2:40099)
0809 20:11:55.825076 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:55.825158 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 20:11:55.826994 27451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.826482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.14.181.3:45465)
0809 20:11:55.826751 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:55.826838 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155}
I20260809 20:11:55.831158 26243 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ae4c504732ae4c32bc8e160ec9d1ac14: Sending DeleteTablet for 3 replicas of tablet 7e5e0d873c2c4ce4a89b02c3d2316692
I20260809 20:11:55.832001 27198 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e5e0d873c2c4ce4a89b02c3d2316692 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:55 UTC) from {username='oryx', principal='oryx/127.14.181.61@KRBTEST.COM'} at 127.0.0.1:36374
I20260809 20:11:55.832393 26731 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e5e0d873c2c4ce4a89b02c3d2316692 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:55 UTC) from {username='oryx', principal='oryx/127.14.181.61@KRBTEST.COM'} at 127.0.0.1:54770
I20260809 20:11:55.832465 26980 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e5e0d873c2c4ce4a89b02c3d2316692 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:55 UTC) from {username='oryx', principal='oryx/127.14.181.61@KRBTEST.COM'} at 127.0.0.1:47146
I20260809 20:11:55.832605 27525 tablet_replica.cc:330] T 7e5e0d873c2c4ce4a89b02c3d2316692 P e03dd651846c4fedbe380653aad87fca: stopping tablet replica
I20260809 20:11:55.832823 27525 raft_consensus.cc:2229] T 7e5e0d873c2c4ce4a89b02c3d2316692 P e03dd651846c4fedbe380653aad87fca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:11:55.833067 27527 tablet_replica.cc:330] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 788f6af08e2c478d8143aaabe2fd7cf6: stopping tablet replica
I20260809 20:11:55.833127 27525 raft_consensus.cc:2258] T 7e5e0d873c2c4ce4a89b02c3d2316692 P e03dd651846c4fedbe380653aad87fca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:55.833314 27527 raft_consensus.cc:2229] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 788f6af08e2c478d8143aaabe2fd7cf6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:11:55.833634 27527 raft_consensus.cc:2258] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 788f6af08e2c478d8143aaabe2fd7cf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:55.833691 26980 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e5e0d873c2c4ce4a89b02c3d2316692 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:55 UTC) from {username='oryx', principal='oryx/127.14.181.61@KRBTEST.COM'} at 127.0.0.1:47146
I20260809 20:11:55.834030 27528 tablet_replica.cc:330] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472: stopping tablet replica
I20260809 20:11:55.834204 27525 ts_tablet_manager.cc:1905] T 7e5e0d873c2c4ce4a89b02c3d2316692 P e03dd651846c4fedbe380653aad87fca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:55.834240 27528 raft_consensus.cc:2229] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472 [term 1 LEADER]: Raft consensus shutting down.
I20260809 20:11:55.834651 27528 raft_consensus.cc:2258] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:11:55.834787 27198 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e5e0d873c2c4ce4a89b02c3d2316692 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:11:55 UTC) from {username='oryx', principal='oryx/127.14.181.61@KRBTEST.COM'} at 127.0.0.1:36374
I20260809 20:11:55.835130 27527 ts_tablet_manager.cc:1905] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 788f6af08e2c478d8143aaabe2fd7cf6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:55.836010 27528 ts_tablet_manager.cc:1905] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:11:55.837293 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 26517
I20260809 20:11:55.840425 27525 ts_tablet_manager.cc:1918] T 7e5e0d873c2c4ce4a89b02c3d2316692 P e03dd651846c4fedbe380653aad87fca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:11:55.840600 27525 log.cc:1196] T 7e5e0d873c2c4ce4a89b02c3d2316692 P e03dd651846c4fedbe380653aad87fca: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-2/wal/wals/7e5e0d873c2c4ce4a89b02c3d2316692
I20260809 20:11:55.841075 27525 ts_tablet_manager.cc:1939] T 7e5e0d873c2c4ce4a89b02c3d2316692 P e03dd651846c4fedbe380653aad87fca: Deleting consensus metadata
I20260809 20:11:55.842162 26219 catalog_manager.cc:4841] TS e03dd651846c4fedbe380653aad87fca (127.14.181.3:39471): tablet 7e5e0d873c2c4ce4a89b02c3d2316692 (table test-table [id=b216b91505f54653bf31e954ada913ca]) successfully deleted
I20260809 20:11:55.842510 27528 ts_tablet_manager.cc:1918] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:11:55.842685 27528 log.cc:1196] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-1/wal/wals/7e5e0d873c2c4ce4a89b02c3d2316692
I20260809 20:11:55.842818 27527 ts_tablet_manager.cc:1918] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 788f6af08e2c478d8143aaabe2fd7cf6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:11:55.842975 27527 log.cc:1196] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 788f6af08e2c478d8143aaabe2fd7cf6: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786306256699363-15060-0/minicluster-data/ts-0/wal/wals/7e5e0d873c2c4ce4a89b02c3d2316692
I20260809 20:11:55.843164 27528 ts_tablet_manager.cc:1939] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 29f2635fb37e415382cbf8dece012472: Deleting consensus metadata
W20260809 20:11:55.843127 26219 catalog_manager.cc:4808] TS e03dd651846c4fedbe380653aad87fca (127.14.181.3:39471): delete failed for tablet 7e5e0d873c2c4ce4a89b02c3d2316692 because the tablet was not found. No further retry: Not found: Tablet not found: 7e5e0d873c2c4ce4a89b02c3d2316692
I20260809 20:11:55.843454 27527 ts_tablet_manager.cc:1939] T 7e5e0d873c2c4ce4a89b02c3d2316692 P 788f6af08e2c478d8143aaabe2fd7cf6: Deleting consensus metadata
I20260809 20:11:55.844192 26219 catalog_manager.cc:4841] TS 29f2635fb37e415382cbf8dece012472 (127.14.181.2:42403): tablet 7e5e0d873c2c4ce4a89b02c3d2316692 (table test-table [id=b216b91505f54653bf31e954ada913ca]) successfully deleted
I20260809 20:11:55.844332 26223 catalog_manager.cc:4841] TS 788f6af08e2c478d8143aaabe2fd7cf6 (127.14.181.1:45009): tablet 7e5e0d873c2c4ce4a89b02c3d2316692 (table test-table [id=b216b91505f54653bf31e954ada913ca]) successfully deleted
W20260809 20:11:55.844499 26219 catalog_manager.cc:4808] TS 29f2635fb37e415382cbf8dece012472 (127.14.181.2:42403): delete failed for tablet 7e5e0d873c2c4ce4a89b02c3d2316692 because the tablet was not found. No further retry: Not found: Tablet not found: 7e5e0d873c2c4ce4a89b02c3d2316692
I20260809 20:11:55.857518 27477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.838482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35444 (local address 127.14.181.1:45009)
0809 20:11:55.838614 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:55.838620 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:55.846719 (+ 8099us) server_negotiation.cc:407] Connection header received
0809 20:11:55.846836 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:55.846840 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:55.846896 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:55.846968 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:55.848131 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:55.848778 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:55.849966 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:55.850466 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:55.850556 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:55.852797 (+ 2241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:55.852811 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:55.852825 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:55.852866 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:55.855452 (+ 2586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:55.855959 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:55.855966 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:55.855969 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:55.856096 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:55.856367 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:55.856370 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:55.856372 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:55.856680 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:55.856878 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:55.857075 (+ 197us) server_negotiation.cc:299] Negotiation successful
0809 20:11:55.857222 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 20:11:55.858109 26832 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:55.947279 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 26517
I20260809 20:11:55.971237 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 26864
I20260809 20:11:55.983562 27483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:55.971919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35964 (local address 127.14.181.2:42403)
0809 20:11:55.972112 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:55.972116 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:55.972134 (+ 18us) server_negotiation.cc:407] Connection header received
0809 20:11:55.972304 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:55.972307 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:55.972403 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:55.972486 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:55.973737 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:55.974538 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:55.975681 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:55.976063 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:55.976151 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:55.978396 (+ 2245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:55.978414 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:55.978436 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:55.978475 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:55.980987 (+ 2512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:55.981599 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:55.981606 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:55.981608 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:55.981752 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:55.982046 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:55.982051 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:55.982055 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:55.982559 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:55.982890 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:55.983103 (+ 213us) server_negotiation.cc:299] Negotiation successful
0809 20:11:55.983256 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 20:11:55.984122 27073 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:56.064375 27533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:56.063679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.0.0.1:56020)
0809 20:11:56.064097 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:56.064195 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":208,"threads_started":1}
I20260809 20:11:56.065879 27533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:56.065570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39865 (local address 127.0.0.1:56034)
0809 20:11:56.065691 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:56.065775 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 20:11:56.103302 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 26864
I20260809 20:11:56.129088 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 27099
I20260809 20:11:56.141446 27538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:56.129755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54536 (local address 127.14.181.3:39471)
0809 20:11:56.130163 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:56.130167 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:56.130184 (+ 17us) server_negotiation.cc:407] Connection header received
0809 20:11:56.130241 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:56.130245 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:56.130311 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:56.130439 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:56.131671 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:56.132347 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:56.133460 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:56.133846 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:56.133931 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:56.136326 (+ 2395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:56.136341 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:56.136359 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:56.136390 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:56.139299 (+ 2909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:56.139873 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:56.139880 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:56.139883 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:56.140029 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:56.140296 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:56.140299 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:56.140301 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:56.140614 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:56.140843 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:56.141024 (+ 181us) server_negotiation.cc:299] Negotiation successful
0809 20:11:56.141199 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":204,"threads_started":1}
I20260809 20:11:56.142040 27301 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:56.230649 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 27099
I20260809 20:11:56.251818 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 26011
I20260809 20:11:56.252825 26297 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:56.370498 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 26011
I20260809 20:11:56.395236 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 26185
I20260809 20:11:56.396314 26599 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:11:56.507587 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 26185
2026-08-09T20:11:56Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (11012 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:11:56 dist-test-slave-6zbq krb5kdc[27548](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:11:56 dist-test-slave-6zbq krb5kdc[27548](info): set up 2 sockets
Aug 09 20:11:56 dist-test-slave-6zbq krb5kdc[27548](info): commencing operation
krb5kdc: starting...
W20260809 20:11:57.701380 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.143s user 0.000s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:11:57 dist-test-slave-6zbq krb5kdc[27548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:11:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:11:57Z Disabled control of system clock
WARNING: no policy specified for oryx/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.62.keytab.
Entry for principal oryx/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.62.keytab.
I20260809 20:11:57.891562 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:39675
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.62.keytab
--principal=oryx/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:38413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:39675
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:58.194011 27567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:58.194271 27567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:58.194422 27567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:58.201618 27567 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:11:58.201722 27567 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 20:11:58.201790 27567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:58.201872 27567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:58.201939 27567 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:11:58.202021 27567 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:11:58.211220 27567 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:38413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:39675
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.62.keytab
--principal=oryx/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:39675
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:58.212311 27567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:58.213491 27567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:58.224282 27574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:58.224354 27573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:58.224320 27577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:58.224620 27567 server_base.cc:1034] running on GCE node
I20260809 20:11:58.225431 27567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:58.226682 27567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:58.227906 27567 hybrid_clock.cc:648] HybridClock initialized: now 1786306318227851 us; error 23 us; skew 500 ppm
I20260809 20:11:58.228195 27567 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:58 dist-test-slave-6zbq krb5kdc[27548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306318, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:58.231041 27567 init.cc:377] Logged in from keytab as oryx/127.14.181.62@KRBTEST.COM (short username oryx)
I20260809 20:11:58.232353 27567 webserver.cc:460] Webserver started at http://127.14.181.62:46681/ using document root <none> and password file <none>
I20260809 20:11:58.232967 27567 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:58.233072 27567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:58.233362 27567 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:58.236066 27567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "d7d1eb29af3948a1bf21c7d36b407a84"
format_stamp: "Formatted at 2026-08-09 20:11:58 on dist-test-slave-6zbq"
server_key: "4b587e39a7012a49f015bb01ce65daf3"
server_key_iv: "a7a51e00e8abea073ffc9d6d451b809c"
server_key_version: "encryptionkey@0"
I20260809 20:11:58.236807 27567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "d7d1eb29af3948a1bf21c7d36b407a84"
format_stamp: "Formatted at 2026-08-09 20:11:58 on dist-test-slave-6zbq"
server_key: "4b587e39a7012a49f015bb01ce65daf3"
server_key_iv: "a7a51e00e8abea073ffc9d6d451b809c"
server_key_version: "encryptionkey@0"
I20260809 20:11:58.241328 27567 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 20:11:58.244410 27586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:58.245507 27567 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 20:11:58.245657 27567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "d7d1eb29af3948a1bf21c7d36b407a84"
format_stamp: "Formatted at 2026-08-09 20:11:58 on dist-test-slave-6zbq"
server_key: "4b587e39a7012a49f015bb01ce65daf3"
server_key_iv: "a7a51e00e8abea073ffc9d6d451b809c"
server_key_version: "encryptionkey@0"
I20260809 20:11:58.245857 27567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:58.268082 27567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:58.271806 27567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:58.272028 27567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:58.291006 27567 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:39675
I20260809 20:11:58.291035 27689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:39675 every 8 connection(s)
I20260809 20:11:58.292147 27567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:11:58.295533 27690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:11:58.296826 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 27567
I20260809 20:11:58.297031 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:11:58.297839 15060 external_mini_cluster.cc:1428] Setting key 617254138d2b0063da3f912be44ff0d9
I20260809 20:11:58.308701 27690 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7d1eb29af3948a1bf21c7d36b407a84: Bootstrap starting.
Aug 09 20:11:58 dist-test-slave-6zbq krb5kdc[27548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM
I20260809 20:11:58.312023 27690 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d7d1eb29af3948a1bf21c7d36b407a84: Neither blocks nor log segments found. Creating new log.
I20260809 20:11:58.313232 27690 log.cc:824] T 00000000000000000000000000000000 P d7d1eb29af3948a1bf21c7d36b407a84: Log is configured to *not* fsync() on all Append() calls
I20260809 20:11:58.316383 27690 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7d1eb29af3948a1bf21c7d36b407a84: No bootstrap required, opened a new log
I20260809 20:11:58.320163 27694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:58.299753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52012 (local address 127.14.181.62:39675)
0809 20:11:58.300493 (+ 740us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:58.300506 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:58.300547 (+ 41us) server_negotiation.cc:407] Connection header received
0809 20:11:58.302098 (+ 1551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:58.302118 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:58.302509 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:58.302797 (+ 288us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:58.304422 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:58.305655 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:58.307385 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:58.307990 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:58.308105 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:58.312396 (+ 4291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:58.312407 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:58.312428 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:58.312476 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:58.316137 (+ 3661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:58.316790 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:58.316798 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:58.316805 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:58.317003 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:58.317316 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:58.317321 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:58.317324 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:58.317966 (+ 642us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:58.318274 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:58.318562 (+ 288us) server_negotiation.cc:299] Negotiation successful
0809 20:11:58.318970 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":551,"thread_start_us":343,"threads_started":1}
I20260809 20:11:58.325067 27690 raft_consensus.cc:348] T 00000000000000000000000000000000 P d7d1eb29af3948a1bf21c7d36b407a84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7d1eb29af3948a1bf21c7d36b407a84" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39675 } }
I20260809 20:11:58.325408 27690 raft_consensus.cc:374] T 00000000000000000000000000000000 P d7d1eb29af3948a1bf21c7d36b407a84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:11:58.325502 27690 raft_consensus.cc:729] T 00000000000000000000000000000000 P d7d1eb29af3948a1bf21c7d36b407a84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7d1eb29af3948a1bf21c7d36b407a84, State: Initialized, Role: FOLLOWER
I20260809 20:11:58.326059 27690 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7d1eb29af3948a1bf21c7d36b407a84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7d1eb29af3948a1bf21c7d36b407a84" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39675 } }
I20260809 20:11:58.326320 27690 raft_consensus.cc:388] T 00000000000000000000000000000000 P d7d1eb29af3948a1bf21c7d36b407a84 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:11:58.326449 27690 raft_consensus.cc:482] T 00000000000000000000000000000000 P d7d1eb29af3948a1bf21c7d36b407a84 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:11:58.326570 27690 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d7d1eb29af3948a1bf21c7d36b407a84 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:11:58.328632 27690 raft_consensus.cc:504] T 00000000000000000000000000000000 P d7d1eb29af3948a1bf21c7d36b407a84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7d1eb29af3948a1bf21c7d36b407a84" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39675 } }
I20260809 20:11:58.329032 27690 leader_election.cc:302] T 00000000000000000000000000000000 P d7d1eb29af3948a1bf21c7d36b407a84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d7d1eb29af3948a1bf21c7d36b407a84; no voters:
I20260809 20:11:58.329479 27690 leader_election.cc:288] T 00000000000000000000000000000000 P d7d1eb29af3948a1bf21c7d36b407a84 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:11:58.329588 27696 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d7d1eb29af3948a1bf21c7d36b407a84 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:11:58.330222 27696 raft_consensus.cc:686] T 00000000000000000000000000000000 P d7d1eb29af3948a1bf21c7d36b407a84 [term 1 LEADER]: Becoming Leader. State: Replica: d7d1eb29af3948a1bf21c7d36b407a84, State: Running, Role: LEADER
I20260809 20:11:58.330703 27696 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7d1eb29af3948a1bf21c7d36b407a84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7d1eb29af3948a1bf21c7d36b407a84" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39675 } }
I20260809 20:11:58.331238 27690 sys_catalog.cc:564] T 00000000000000000000000000000000 P d7d1eb29af3948a1bf21c7d36b407a84 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:11:58.333416 27698 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7d1eb29af3948a1bf21c7d36b407a84 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7d1eb29af3948a1bf21c7d36b407a84. Latest consensus state: current_term: 1 leader_uuid: "d7d1eb29af3948a1bf21c7d36b407a84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7d1eb29af3948a1bf21c7d36b407a84" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39675 } } }
I20260809 20:11:58.333814 27698 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7d1eb29af3948a1bf21c7d36b407a84 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:58.333793 27697 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7d1eb29af3948a1bf21c7d36b407a84 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d7d1eb29af3948a1bf21c7d36b407a84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7d1eb29af3948a1bf21c7d36b407a84" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39675 } } }
I20260809 20:11:58.334733 27697 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7d1eb29af3948a1bf21c7d36b407a84 [sys.catalog]: This master's current role is: LEADER
I20260809 20:11:58.335525 27711 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:11:58.340382 27711 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:11:58.348183 27711 catalog_manager.cc:1347] Generated new cluster ID: 85bcb4de82364601ab0e6a4fc7ccd464
I20260809 20:11:58.348285 27711 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:11:58.379307 27711 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:11:58.380450 27711 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:11:58.385421 27711 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d7d1eb29af3948a1bf21c7d36b407a84: Generated new TSK 0
I20260809 20:11:58.386076 27711 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.14.181.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.181.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.181.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.1.keytab.
Entry for principal oryx/127.14.181.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.1.keytab.
I20260809 20:11:58.445353 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:0
--local_ip_for_outbound_sockets=127.14.181.1
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39675
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.1.keytab
--principal=oryx/127.14.181.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:38413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:58.779202 27733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:58.779433 27733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:58.779553 27733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:58.786296 27733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:58.786419 27733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:58.786542 27733 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 20:11:58.786650 27733 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:11:58.795663 27733 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:38413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.1.keytab
--principal=oryx/127.14.181.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.181.62:39675
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:58.796659 27733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:58.797821 27733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:58.809458 27742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:58.809482 27745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:58.809526 27751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:58.810463 27733 server_base.cc:1034] running on GCE node
I20260809 20:11:58.810995 27733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:58.811762 27733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:58.812961 27733 hybrid_clock.cc:648] HybridClock initialized: now 1786306318812905 us; error 32 us; skew 500 ppm
I20260809 20:11:58.813218 27733 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:58 dist-test-slave-6zbq krb5kdc[27548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306318, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:58.816027 27733 init.cc:377] Logged in from keytab as oryx/127.14.181.1@KRBTEST.COM (short username oryx)
I20260809 20:11:58.817278 27733 webserver.cc:460] Webserver started at http://127.14.181.1:45327/ using document root <none> and password file <none>
I20260809 20:11:58.817870 27733 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:58.817965 27733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:58.818254 27733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:58.820863 27733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-0/data/instance:
uuid: "e096433beba5480db2fb141954e88ed6"
format_stamp: "Formatted at 2026-08-09 20:11:58 on dist-test-slave-6zbq"
server_key: "3d64535f25c7a256d05a2b18491d4fb3"
server_key_iv: "db20791226c154d63bff3db2c8bc95aa"
server_key_version: "encryptionkey@0"
I20260809 20:11:58.821609 27733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance:
uuid: "e096433beba5480db2fb141954e88ed6"
format_stamp: "Formatted at 2026-08-09 20:11:58 on dist-test-slave-6zbq"
server_key: "3d64535f25c7a256d05a2b18491d4fb3"
server_key_iv: "db20791226c154d63bff3db2c8bc95aa"
server_key_version: "encryptionkey@0"
I20260809 20:11:58.826143 27733 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 20:11:58.829221 27765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:58.830397 27733 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:11:58.830541 27733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "e096433beba5480db2fb141954e88ed6"
format_stamp: "Formatted at 2026-08-09 20:11:58 on dist-test-slave-6zbq"
server_key: "3d64535f25c7a256d05a2b18491d4fb3"
server_key_iv: "db20791226c154d63bff3db2c8bc95aa"
server_key_version: "encryptionkey@0"
I20260809 20:11:58.830744 27733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:58.845438 27733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:58.848812 27733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:58.849038 27733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:58.851507 27733 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:58.851650 27733 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260809 20:11:58.851788 27733 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:58.851858 27733 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 20:11:58 dist-test-slave-6zbq krb5kdc[27548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306318, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM
I20260809 20:11:58.873190 27782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:58.852359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39675 (local address 127.14.181.1:54007)
0809 20:11:58.853208 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:58.853255 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:58.855131 (+ 1876us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:58.855898 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:58.855908 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:58.856550 (+ 642us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:58.857343 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:58.857369 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:58.858732 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:58.858736 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:58.860827 (+ 2091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:58.860839 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:58.861834 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:58.861842 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:58.862062 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:58.862765 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:58.862802 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:58.865329 (+ 2527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:58.868371 (+ 3042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:58.868379 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:58.868396 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:58.868971 (+ 575us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:58.869344 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:58.869351 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:58.869355 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:58.869614 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:58.870202 (+ 588us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:58.870210 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:58.870679 (+ 469us) client_negotiation.cc:769] Sending connection context
0809 20:11:58.871028 (+ 349us) client_negotiation.cc:240] Negotiation successful
0809 20:11:58.871591 (+ 563us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":340,"threads_started":1}
I20260809 20:11:58.874296 27780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:58.851809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:54007 (local address 127.14.181.62:39675)
0809 20:11:58.852307 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:58.852314 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:58.853378 (+ 1064us) server_negotiation.cc:407] Connection header received
0809 20:11:58.855393 (+ 2015us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:58.855400 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:58.855500 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:58.855619 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:58.857566 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:58.858572 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:58.860962 (+ 2390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:58.861395 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:58.861506 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:58.865526 (+ 4020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:58.865531 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:58.865534 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:58.865564 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:58.868234 (+ 2670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:58.869084 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:58.869090 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:58.869094 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:58.869225 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:58.869750 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:58.869756 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:58.869759 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:58.870064 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:58.870176 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:58.873715 (+ 3539us) server_negotiation.cc:299] Negotiation successful
0809 20:11:58.873938 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":231,"threads_started":1}
I20260809 20:11:58.892053 27911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:58.880150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39675 (local address 127.14.181.1:58347)
0809 20:11:58.880621 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:58.880635 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:58.880774 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:58.881125 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:58.881129 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:58.881821 (+ 692us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:58.882277 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:58.882293 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:58.883255 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:58.883260 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:58.884846 (+ 1586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:58.884862 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:58.885730 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:58.885737 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:58.885905 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:58.886463 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:58.886479 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:58.887134 (+ 655us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:58.889529 (+ 2395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:58.889534 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:58.889539 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:58.889896 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:58.890241 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:58.890246 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:58.890250 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:58.890401 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:58.890965 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:58.890971 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:58.891182 (+ 211us) client_negotiation.cc:769] Sending connection context
0809 20:11:58.891319 (+ 137us) client_negotiation.cc:240] Negotiation successful
0809 20:11:58.891613 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":257,"threads_started":1}
I20260809 20:11:58.892861 27780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:58.880173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:58347 (local address 127.14.181.62:39675)
0809 20:11:58.880331 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:58.880337 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:58.880722 (+ 385us) server_negotiation.cc:407] Connection header received
0809 20:11:58.880901 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:58.880906 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:58.880982 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:58.881081 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:58.882448 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:58.883114 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:58.884973 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:58.885542 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:58.885693 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:58.887311 (+ 1618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:58.887316 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:58.887319 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:58.887346 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:58.889412 (+ 2066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:58.890000 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:58.890005 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:58.890009 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:58.890136 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:58.890512 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:58.890517 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:58.890521 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:58.890824 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:58.892291 (+ 1467us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:58.892417 (+ 126us) server_negotiation.cc:299] Negotiation successful
0809 20:11:58.892628 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 20:11:58.896652 27733 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:45253
I20260809 20:11:58.896659 27961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:45253 every 8 connection(s)
I20260809 20:11:58.897697 27733 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:11:58.899446 27962 heartbeater.cc:347] Connected to a master server at 127.14.181.62:39675
I20260809 20:11:58.899643 27962 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:58.900199 27962 heartbeater.cc:511] Master 127.14.181.62:39675 requested a full tablet report, sending...
I20260809 20:11:58.901859 27610 ts_manager.cc:194] Registered new tserver with Master: e096433beba5480db2fb141954e88ed6 (127.14.181.1:45253)
I20260809 20:11:58.903273 27610 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.181.1@KRBTEST.COM'} at 127.14.181.1:54007
I20260809 20:11:58.906488 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 27733
I20260809 20:11:58.906641 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance
I20260809 20:11:58.907199 15060 external_mini_cluster.cc:1428] Setting key 174e79750fed887cfa70013263376599
WARNING: no policy specified for oryx/127.14.181.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.181.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.181.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.2.keytab.
Entry for principal oryx/127.14.181.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.2.keytab.
I20260809 20:11:58.950826 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:0
--local_ip_for_outbound_sockets=127.14.181.2
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39675
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.2.keytab
--principal=oryx/127.14.181.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:38413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:59.265614 27966 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:59.265841 27966 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:59.265926 27966 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:59.272650 27966 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:59.272737 27966 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:59.272820 27966 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 20:11:59.272894 27966 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:11:59.281945 27966 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:38413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.2.keytab
--principal=oryx/127.14.181.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.181.62:39675
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:59.282939 27966 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:59.284065 27966 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:59.296200 27975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:59.296376 27980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:59.296733 27974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:59.299538 27966 server_base.cc:1034] running on GCE node
I20260809 20:11:59.300133 27966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:59.301079 27966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:59.302333 27966 hybrid_clock.cc:648] HybridClock initialized: now 1786306319302274 us; error 42 us; skew 500 ppm
I20260809 20:11:59.302649 27966 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:59 dist-test-slave-6zbq krb5kdc[27548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306319, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:59.306257 27966 init.cc:377] Logged in from keytab as oryx/127.14.181.2@KRBTEST.COM (short username oryx)
I20260809 20:11:59.307753 27966 webserver.cc:460] Webserver started at http://127.14.181.2:43975/ using document root <none> and password file <none>
I20260809 20:11:59.308364 27966 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:59.308454 27966 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:59.308739 27966 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:59.311358 27966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-1/data/instance:
uuid: "922e7d39b9a24541968e2df2043849d6"
format_stamp: "Formatted at 2026-08-09 20:11:59 on dist-test-slave-6zbq"
server_key: "4f3e55cc10345d4809aa2a9e4882b577"
server_key_iv: "45e08ae1adcea5414d6669280d0afb5b"
server_key_version: "encryptionkey@0"
I20260809 20:11:59.312070 27966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance:
uuid: "922e7d39b9a24541968e2df2043849d6"
format_stamp: "Formatted at 2026-08-09 20:11:59 on dist-test-slave-6zbq"
server_key: "4f3e55cc10345d4809aa2a9e4882b577"
server_key_iv: "45e08ae1adcea5414d6669280d0afb5b"
server_key_version: "encryptionkey@0"
I20260809 20:11:59.316562 27966 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 20:11:59.319619 27990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:59.320744 27966 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260809 20:11:59.320871 27966 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "922e7d39b9a24541968e2df2043849d6"
format_stamp: "Formatted at 2026-08-09 20:11:59 on dist-test-slave-6zbq"
server_key: "4f3e55cc10345d4809aa2a9e4882b577"
server_key_iv: "45e08ae1adcea5414d6669280d0afb5b"
server_key_version: "encryptionkey@0"
I20260809 20:11:59.321059 27966 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:59.334196 27966 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:59.337769 27966 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:59.337989 27966 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:59.340404 27966 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:59.340541 27966 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:59.340677 27966 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:59.340781 27966 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 20:11:59 dist-test-slave-6zbq krb5kdc[27548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306319, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM
I20260809 20:11:59.361274 27780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:59.340676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:39719 (local address 127.14.181.62:39675)
0809 20:11:59.340896 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:59.340902 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:59.342168 (+ 1266us) server_negotiation.cc:407] Connection header received
0809 20:11:59.344834 (+ 2666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:59.344838 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:59.344904 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:59.344998 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:59.346945 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:59.347659 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:59.349616 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:59.350318 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:59.350467 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:59.354541 (+ 4074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:59.354548 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:59.354553 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:59.354593 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:59.357640 (+ 3047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:59.358482 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:59.358487 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:59.358491 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:59.358657 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:59.359313 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:59.359318 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:59.359321 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:59.359629 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:59.359770 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:59.360700 (+ 930us) server_negotiation.cc:299] Negotiation successful
0809 20:11:59.360937 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 20:11:59.362103 28005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:59.341166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39675 (local address 127.14.181.2:39719)
0809 20:11:59.341979 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:59.342042 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:59.344532 (+ 2490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:59.345247 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:59.345256 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:59.345916 (+ 660us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:59.346780 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:59.346806 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:59.347812 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:59.347817 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:59.349415 (+ 1598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:59.349433 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:59.350540 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:59.350545 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:59.350731 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:59.351423 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:59.351461 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:59.354310 (+ 2849us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:59.357815 (+ 3505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:59.357823 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:59.357837 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:59.358332 (+ 495us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:59.358809 (+ 477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:59.358817 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:59.358821 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:59.359115 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:59.359856 (+ 741us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:59.359864 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:59.360276 (+ 412us) client_negotiation.cc:769] Sending connection context
0809 20:11:59.360591 (+ 315us) client_negotiation.cc:240] Negotiation successful
0809 20:11:59.361066 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":331,"threads_started":1}
I20260809 20:11:59.380370 27780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:59.367479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:45765 (local address 127.14.181.62:39675)
0809 20:11:59.367649 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:59.367655 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:59.368110 (+ 455us) server_negotiation.cc:407] Connection header received
0809 20:11:59.368257 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:59.368260 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:59.368314 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:59.368386 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:59.369469 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:59.370108 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:59.372117 (+ 2009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:59.372649 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:59.372774 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:59.374982 (+ 2208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:59.374987 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:59.374990 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:59.375016 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:59.377624 (+ 2608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:59.378223 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:59.378228 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:59.378232 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:59.378386 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:59.378800 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:59.378805 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:59.378808 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:59.379226 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:59.379376 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:59.379860 (+ 484us) server_negotiation.cc:299] Negotiation successful
0809 20:11:59.380051 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 20:11:59.380487 28104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:59.367118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39675 (local address 127.14.181.2:45765)
0809 20:11:59.368007 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:59.368027 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:59.368155 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:59.368435 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:59.368440 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:59.368996 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:59.369351 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:59.369364 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:59.370217 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:59.370222 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:59.371965 (+ 1743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:59.371981 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:59.372861 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:59.372869 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:59.373083 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:59.373742 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:59.373768 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:59.374767 (+ 999us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:59.377739 (+ 2972us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:59.377744 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:59.377748 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:59.378118 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:59.378503 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:59.378509 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:59.378513 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:59.378642 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:59.379343 (+ 701us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:59.379348 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:59.379585 (+ 237us) client_negotiation.cc:769] Sending connection context
0809 20:11:59.379738 (+ 153us) client_negotiation.cc:240] Negotiation successful
0809 20:11:59.380050 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":737,"thread_start_us":558,"threads_started":1}
I20260809 20:11:59.389632 27966 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:40463
I20260809 20:11:59.389653 28194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:40463 every 8 connection(s)
I20260809 20:11:59.390720 27966 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:11:59.392527 28195 heartbeater.cc:347] Connected to a master server at 127.14.181.62:39675
I20260809 20:11:59.392711 28195 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:59.393370 28195 heartbeater.cc:511] Master 127.14.181.62:39675 requested a full tablet report, sending...
I20260809 20:11:59.393465 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 27966
I20260809 20:11:59.393630 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance
I20260809 20:11:59.394186 15060 external_mini_cluster.cc:1428] Setting key 65147fe63a1e7762238000b462a89f5d
I20260809 20:11:59.394827 27610 ts_manager.cc:194] Registered new tserver with Master: 922e7d39b9a24541968e2df2043849d6 (127.14.181.2:40463)
I20260809 20:11:59.395641 27610 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.181.2@KRBTEST.COM'} at 127.14.181.2:39719
WARNING: no policy specified for oryx/127.14.181.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.181.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.181.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.3.keytab.
Entry for principal oryx/127.14.181.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.3.keytab.
I20260809 20:11:59.439177 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:0
--local_ip_for_outbound_sockets=127.14.181.3
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39675
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.3.keytab
--principal=oryx/127.14.181.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:38413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:11:59.741042 28207 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:11:59.741308 28207 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:11:59.741446 28207 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:11:59.748255 28207 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:11:59.748356 28207 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:11:59.748476 28207 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 20:11:59.748591 28207 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:11:59.758064 28207 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:38413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.3.keytab
--principal=oryx/127.14.181.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.14.181.62:39675
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:11:59.759092 28207 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:11:59.760210 28207 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:11:59.771833 28215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:59.771888 28220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:11:59.771847 28218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:11:59.772799 28207 server_base.cc:1034] running on GCE node
I20260809 20:11:59.773347 28207 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:11:59.774142 28207 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:11:59.775338 28207 hybrid_clock.cc:648] HybridClock initialized: now 1786306319775266 us; error 59 us; skew 500 ppm
I20260809 20:11:59.775596 28207 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:11:59 dist-test-slave-6zbq krb5kdc[27548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306319, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:11:59.778498 28207 init.cc:377] Logged in from keytab as oryx/127.14.181.3@KRBTEST.COM (short username oryx)
I20260809 20:11:59.779742 28207 webserver.cc:460] Webserver started at http://127.14.181.3:43531/ using document root <none> and password file <none>
I20260809 20:11:59.780304 28207 fs_manager.cc:359] Metadata directory not provided
I20260809 20:11:59.780385 28207 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:11:59.780629 28207 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:11:59.783214 28207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-2/data/instance:
uuid: "8fc7adedd38a480dba8ceb9b947ea2a9"
format_stamp: "Formatted at 2026-08-09 20:11:59 on dist-test-slave-6zbq"
server_key: "beeb1abc58f3e8be665a1111d59e4da4"
server_key_iv: "64dc7d79fab0cc53f342651c3164257d"
server_key_version: "encryptionkey@0"
I20260809 20:11:59.783911 28207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance:
uuid: "8fc7adedd38a480dba8ceb9b947ea2a9"
format_stamp: "Formatted at 2026-08-09 20:11:59 on dist-test-slave-6zbq"
server_key: "beeb1abc58f3e8be665a1111d59e4da4"
server_key_iv: "64dc7d79fab0cc53f342651c3164257d"
server_key_version: "encryptionkey@0"
I20260809 20:11:59.788481 28207 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 20:11:59.791446 28231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:59.792579 28207 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:11:59.792702 28207 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "8fc7adedd38a480dba8ceb9b947ea2a9"
format_stamp: "Formatted at 2026-08-09 20:11:59 on dist-test-slave-6zbq"
server_key: "beeb1abc58f3e8be665a1111d59e4da4"
server_key_iv: "64dc7d79fab0cc53f342651c3164257d"
server_key_version: "encryptionkey@0"
I20260809 20:11:59.792872 28207 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:11:59.808072 28207 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:11:59.811369 28207 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:11:59.811561 28207 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:11:59.813851 28207 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:11:59.813938 28207 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:11:59.814106 28207 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:11:59.814188 28207 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 20:11:59 dist-test-slave-6zbq krb5kdc[27548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306319, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM
I20260809 20:11:59.836298 28244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:59.814617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39675 (local address 127.14.181.3:58687)
0809 20:11:59.815476 (+ 859us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:59.815520 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:59.817272 (+ 1752us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:59.817946 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:59.817954 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:59.818688 (+ 734us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:59.819419 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:59.819442 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:59.820951 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:59.820957 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:59.822904 (+ 1947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:59.822921 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:59.823893 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:59.823900 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:59.824169 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:59.824875 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:59.824910 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:59.828075 (+ 3165us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:59.832041 (+ 3966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:59.832047 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:59.832056 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:59.832692 (+ 636us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:59.833109 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:59.833115 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:59.833118 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:59.833403 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:59.834126 (+ 723us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:59.834133 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:59.834595 (+ 462us) client_negotiation.cc:769] Sending connection context
0809 20:11:59.834960 (+ 365us) client_negotiation.cc:240] Negotiation successful
0809 20:11:59.835324 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":349,"threads_started":1}
I20260809 20:11:59.837307 27780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:59.814151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:58687 (local address 127.14.181.62:39675)
0809 20:11:59.814379 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:59.814385 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:59.815650 (+ 1265us) server_negotiation.cc:407] Connection header received
0809 20:11:59.817530 (+ 1880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:59.817536 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:59.817629 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:59.817714 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:59.819614 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:59.820780 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:59.823057 (+ 2277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:59.823670 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:59.823827 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:59.828307 (+ 4480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:59.828315 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:59.828321 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:59.828364 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:59.831920 (+ 3556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:59.832812 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:59.832818 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:59.832821 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:59.832976 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:59.833588 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:59.833594 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:59.833598 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:59.833991 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:59.834146 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:59.836907 (+ 2761us) server_negotiation.cc:299] Negotiation successful
0809 20:11:59.837073 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 20:11:59.854620 28337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:59.842326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39675 (local address 127.14.181.3:38215)
0809 20:11:59.842885 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0809 20:11:59.842900 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:11:59.843013 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:11:59.843303 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:11:59.843308 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:11:59.843698 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:11:59.843957 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:59.843966 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:59.844893 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:59.844897 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:59.846198 (+ 1301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:11:59.846213 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:11:59.847130 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:11:59.847138 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:11:59.847338 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:59.847855 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:11:59.847877 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:11:59.848830 (+ 953us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:11:59.852320 (+ 3490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:59.852325 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:59.852328 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:59.852796 (+ 468us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:59.853200 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:11:59.853203 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:11:59.853205 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:11:59.853322 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:11:59.853833 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:11:59.853836 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:11:59.853971 (+ 135us) client_negotiation.cc:769] Sending connection context
0809 20:11:59.854070 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 20:11:59.854289 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":303,"threads_started":1}
I20260809 20:11:59.854809 27780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:11:59.842222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:38215 (local address 127.14.181.62:39675)
0809 20:11:59.842377 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:59.842382 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:59.842982 (+ 600us) server_negotiation.cc:407] Connection header received
0809 20:11:59.843112 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:59.843118 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:59.843189 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:59.843266 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:59.844084 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:59.844757 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:59.846365 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:59.846899 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:59.847023 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:11:59.849000 (+ 1977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:11:59.849004 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:11:59.849008 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:11:59.849035 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:11:59.852185 (+ 3150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:59.852922 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:59.852929 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:59.852933 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:59.853093 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:11:59.853408 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:11:59.853413 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:11:59.853416 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:11:59.853731 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:11:59.853882 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 20:11:59.854181 (+ 299us) server_negotiation.cc:299] Negotiation successful
0809 20:11:59.854444 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 20:11:59.866178 28207 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:44669
I20260809 20:11:59.866205 28416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:44669 every 8 connection(s)
I20260809 20:11:59.867229 28207 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:11:59.868932 28418 heartbeater.cc:347] Connected to a master server at 127.14.181.62:39675
I20260809 20:11:59.869129 28418 heartbeater.cc:464] Registering TS with master...
I20260809 20:11:59.869681 28418 heartbeater.cc:511] Master 127.14.181.62:39675 requested a full tablet report, sending...
I20260809 20:11:59.870820 27610 ts_manager.cc:194] Registered new tserver with Master: 8fc7adedd38a480dba8ceb9b947ea2a9 (127.14.181.3:44669)
I20260809 20:11:59.871551 27610 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.14.181.3@KRBTEST.COM'} at 127.14.181.3:58687
I20260809 20:11:59.875651 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 28207
I20260809 20:11:59.875800 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance
I20260809 20:11:59.876200 15060 external_mini_cluster.cc:1428] Setting key 94c1309672d9c2944c703b3bffb4678e
I20260809 20:11:59.878769 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 20:11:59.905483 27962 heartbeater.cc:503] Master 127.14.181.62:39675 was elected leader, sending a full tablet report...
Aug 09 20:11:59 dist-test-slave-6zbq krb5kdc[27548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306319, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 20:11:59 dist-test-slave-6zbq krb5kdc[27548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:11:59 dist-test-slave-6zbq krb5kdc[27548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:00.398221 28195 heartbeater.cc:503] Master 127.14.181.62:39675 was elected leader, sending a full tablet report...
I20260809 20:12:00.873477 28418 heartbeater.cc:503] Master 127.14.181.62:39675 was elected leader, sending a full tablet report...
W20260809 20:12:00.927500 28428 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.003s user 0.000s sys 0.015s
W20260809 20:12:00.928547 27780 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:11:59.919280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52022 (local address 127.14.181.62:39675)
0809 20:11:59.919463 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 20:11:59.919469 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:11:59.919686 (+ 217us) server_negotiation.cc:407] Connection header received
0809 20:11:59.919848 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:11:59.919851 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:11:59.919911 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:11:59.919988 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:11:59.921261 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:59.921961 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:59.923232 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:11:59.923637 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:11:59.923744 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:00.928317 (+1004573us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52022: BlockingRecv error: recv got EOF from 127.0.0.1:52022 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 09 20:12:00 dist-test-slave-6zbq krb5kdc[27548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306319, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM
I20260809 20:12:00.950861 27780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:00.933659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52024 (local address 127.14.181.62:39675)
0809 20:12:00.933851 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:00.933856 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:00.935463 (+ 1607us) server_negotiation.cc:407] Connection header received
0809 20:12:00.935631 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:00.935637 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:00.935721 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:00.935813 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:00.937035 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:00.937804 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:00.939107 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:00.939514 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:00.939623 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:00.946134 (+ 6511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:00.946139 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:00.946142 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:12:00.946174 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:00.948408 (+ 2234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:00.949025 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:00.949029 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:00.949031 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:00.949150 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:00.949503 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:00.949507 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:00.949509 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:00.949781 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:00.950078 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:00.950333 (+ 255us) server_negotiation.cc:299] Negotiation successful
0809 20:12:00.950587 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 20:12:00.954530 27610 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52024:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 20:12:00.961036 27610 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 20:12:00.981976 28450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:00.973061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53126 (local address 127.14.181.1:45253)
0809 20:12:00.974183 (+ 1122us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:00.974188 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:00.974218 (+ 30us) server_negotiation.cc:407] Connection header received
0809 20:12:00.974296 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:00.974301 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:00.974512 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:00.974678 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:12:00.975310 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:00.976838 (+ 1528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:00.979489 (+ 2651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:00.980866 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:00.981003 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:00.981218 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:00.981546 (+ 328us) server_negotiation.cc:299] Negotiation successful
0809 20:12:00.981704 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":974,"thread_start_us":840,"threads_started":1}
I20260809 20:12:00.982033 28449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:00.972612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:45253 (local address 127.0.0.1:53126)
0809 20:12:00.973587 (+ 975us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:00.973605 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:00.973713 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:00.974697 (+ 984us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:00.974704 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:00.974740 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:12:00.975111 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:00.975125 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:00.976970 (+ 1845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:00.976979 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:00.979313 (+ 2334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:00.979327 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:00.981073 (+ 1746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:00.981080 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:00.981287 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:00.981338 (+ 51us) client_negotiation.cc:769] Sending connection context
0809 20:12:00.981479 (+ 141us) client_negotiation.cc:240] Negotiation successful
0809 20:12:00.981642 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":863,"mutex_wait_us":41,"thread_start_us":733,"threads_started":1}
I20260809 20:12:00.983109 28451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:00.973122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:40463 (local address 127.0.0.1:59628)
0809 20:12:00.975679 (+ 2557us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:00.975701 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:00.975811 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:00.976627 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:00.976631 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:00.976654 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:12:00.977015 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:00.977026 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:00.978574 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:00.978579 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:00.980294 (+ 1715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:00.980306 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:00.982061 (+ 1755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:00.982068 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:00.982513 (+ 445us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:00.982546 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 20:12:00.982625 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 20:12:00.982750 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2413,"mutex_wait_us":2,"thread_start_us":2285,"threads_started":1}
I20260809 20:12:00.983868 28452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:00.973621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59628 (local address 127.14.181.2:40463)
0809 20:12:00.975234 (+ 1613us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:00.975243 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:00.975921 (+ 678us) server_negotiation.cc:407] Connection header received
0809 20:12:00.976015 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:00.976022 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:00.976229 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:00.976440 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:12:00.977218 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:00.978385 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:00.980439 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:00.981598 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:00.981733 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:00.981913 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:00.982836 (+ 923us) server_negotiation.cc:299] Negotiation successful
0809 20:12:00.982996 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1454,"thread_start_us":1313,"threads_started":1}
I20260809 20:12:00.984344 28445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:00.972036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:44669 (local address 127.0.0.1:35858)
0809 20:12:00.972765 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:00.972803 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:00.972979 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:00.977156 (+ 4177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:00.977164 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:00.977189 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:12:00.977625 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:00.977638 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:00.979393 (+ 1755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:00.979398 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:00.981418 (+ 2020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:00.981430 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:00.983630 (+ 2200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:00.983637 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:00.983814 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:00.983845 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 20:12:00.983942 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 20:12:00.984060 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":302,"threads_started":1}
I20260809 20:12:00.984629 28446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:00.972237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35858 (local address 127.14.181.3:44669)
0809 20:12:00.976662 (+ 4425us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:00.976668 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:00.976689 (+ 21us) server_negotiation.cc:407] Connection header received
0809 20:12:00.976788 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:00.976796 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:00.976967 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:00.977167 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:12:00.977800 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:00.979270 (+ 1470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:00.981589 (+ 2319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:00.983421 (+ 1832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:00.983548 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:00.983682 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:00.984191 (+ 509us) server_negotiation.cc:299] Negotiation successful
0809 20:12:00.984360 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4291,"thread_start_us":4156,"threads_started":1}
I20260809 20:12:00.985594 27847 tablet_service.cc:1467] Processing CreateTablet for tablet e845759a28fd4c52a699bf7e08b49da3 (DEFAULT_TABLE table=test-table [id=06e9390022ac4339853b9f12abd6b46f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:12:00.986945 27847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e845759a28fd4c52a699bf7e08b49da3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:12:00.986815 28076 tablet_service.cc:1467] Processing CreateTablet for tablet e845759a28fd4c52a699bf7e08b49da3 (DEFAULT_TABLE table=test-table [id=06e9390022ac4339853b9f12abd6b46f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:12:00.988121 28076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e845759a28fd4c52a699bf7e08b49da3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:12:00.989370 28306 tablet_service.cc:1467] Processing CreateTablet for tablet e845759a28fd4c52a699bf7e08b49da3 (DEFAULT_TABLE table=test-table [id=06e9390022ac4339853b9f12abd6b46f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:12:00.990661 28306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e845759a28fd4c52a699bf7e08b49da3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:12:00.998293 28454 tablet_bootstrap.cc:492] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6: Bootstrap starting.
I20260809 20:12:01.001202 28454 tablet_bootstrap.cc:654] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6: Neither blocks nor log segments found. Creating new log.
I20260809 20:12:01.001492 28455 tablet_bootstrap.cc:492] T e845759a28fd4c52a699bf7e08b49da3 P 922e7d39b9a24541968e2df2043849d6: Bootstrap starting.
I20260809 20:12:01.002506 28454 log.cc:824] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6: Log is configured to *not* fsync() on all Append() calls
I20260809 20:12:01.004752 28458 tablet_bootstrap.cc:492] T e845759a28fd4c52a699bf7e08b49da3 P 8fc7adedd38a480dba8ceb9b947ea2a9: Bootstrap starting.
I20260809 20:12:01.004880 28455 tablet_bootstrap.cc:654] T e845759a28fd4c52a699bf7e08b49da3 P 922e7d39b9a24541968e2df2043849d6: Neither blocks nor log segments found. Creating new log.
I20260809 20:12:01.005429 28454 tablet_bootstrap.cc:492] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6: No bootstrap required, opened a new log
I20260809 20:12:01.005654 28454 ts_tablet_manager.cc:1397] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 20:12:01.006062 28455 log.cc:824] T e845759a28fd4c52a699bf7e08b49da3 P 922e7d39b9a24541968e2df2043849d6: Log is configured to *not* fsync() on all Append() calls
I20260809 20:12:01.007931 28458 tablet_bootstrap.cc:654] T e845759a28fd4c52a699bf7e08b49da3 P 8fc7adedd38a480dba8ceb9b947ea2a9: Neither blocks nor log segments found. Creating new log.
I20260809 20:12:01.009105 28458 log.cc:824] T e845759a28fd4c52a699bf7e08b49da3 P 8fc7adedd38a480dba8ceb9b947ea2a9: Log is configured to *not* fsync() on all Append() calls
I20260809 20:12:01.009315 28455 tablet_bootstrap.cc:492] T e845759a28fd4c52a699bf7e08b49da3 P 922e7d39b9a24541968e2df2043849d6: No bootstrap required, opened a new log
I20260809 20:12:01.009560 28455 ts_tablet_manager.cc:1397] T e845759a28fd4c52a699bf7e08b49da3 P 922e7d39b9a24541968e2df2043849d6: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 20:12:01.011844 28458 tablet_bootstrap.cc:492] T e845759a28fd4c52a699bf7e08b49da3 P 8fc7adedd38a480dba8ceb9b947ea2a9: No bootstrap required, opened a new log
I20260809 20:12:01.012082 28458 ts_tablet_manager.cc:1397] T e845759a28fd4c52a699bf7e08b49da3 P 8fc7adedd38a480dba8ceb9b947ea2a9: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260809 20:12:01.013065 28454 raft_consensus.cc:348] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } }
I20260809 20:12:01.013478 28454 raft_consensus.cc:374] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:12:01.013583 28454 raft_consensus.cc:729] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e096433beba5480db2fb141954e88ed6, State: Initialized, Role: FOLLOWER
I20260809 20:12:01.014098 28454 consensus_queue.cc:260] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } }
I20260809 20:12:01.015450 28454 ts_tablet_manager.cc:1428] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260809 20:12:01.020823 28455 raft_consensus.cc:348] T e845759a28fd4c52a699bf7e08b49da3 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } }
I20260809 20:12:01.021232 28455 raft_consensus.cc:374] T e845759a28fd4c52a699bf7e08b49da3 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:12:01.021334 28455 raft_consensus.cc:729] T e845759a28fd4c52a699bf7e08b49da3 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922e7d39b9a24541968e2df2043849d6, State: Initialized, Role: FOLLOWER
I20260809 20:12:01.021901 28455 consensus_queue.cc:260] T e845759a28fd4c52a699bf7e08b49da3 P 922e7d39b9a24541968e2df2043849d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } }
I20260809 20:12:01.022094 28458 raft_consensus.cc:348] T e845759a28fd4c52a699bf7e08b49da3 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } }
I20260809 20:12:01.022536 28458 raft_consensus.cc:374] T e845759a28fd4c52a699bf7e08b49da3 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:12:01.022634 28458 raft_consensus.cc:729] T e845759a28fd4c52a699bf7e08b49da3 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fc7adedd38a480dba8ceb9b947ea2a9, State: Initialized, Role: FOLLOWER
I20260809 20:12:01.023268 28458 consensus_queue.cc:260] T e845759a28fd4c52a699bf7e08b49da3 P 8fc7adedd38a480dba8ceb9b947ea2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } }
I20260809 20:12:01.023543 28455 ts_tablet_manager.cc:1428] T e845759a28fd4c52a699bf7e08b49da3 P 922e7d39b9a24541968e2df2043849d6: Time spent starting tablet: real 0.014s user 0.008s sys 0.003s
I20260809 20:12:01.024961 28458 ts_tablet_manager.cc:1428] T e845759a28fd4c52a699bf7e08b49da3 P 8fc7adedd38a480dba8ceb9b947ea2a9: Time spent starting tablet: real 0.013s user 0.010s sys 0.004s
W20260809 20:12:01.119192 28419 tablet.cc:2369] T e845759a28fd4c52a699bf7e08b49da3 P 8fc7adedd38a480dba8ceb9b947ea2a9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 20:12:01.143070 28199 tablet.cc:2369] T e845759a28fd4c52a699bf7e08b49da3 P 922e7d39b9a24541968e2df2043849d6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 20:12:01.150262 27963 tablet.cc:2369] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:12:01.238852 28461 raft_consensus.cc:482] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:12:01.239145 28461 raft_consensus.cc:504] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } }
I20260809 20:12:01.240702 28461 leader_election.cc:288] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fc7adedd38a480dba8ceb9b947ea2a9 (127.14.181.3:44669), 922e7d39b9a24541968e2df2043849d6 (127.14.181.2:40463)
I20260809 20:12:01.247545 28446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:01.241015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:40621 (local address 127.14.181.3:44669)
0809 20:12:01.241193 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:01.241197 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:01.241834 (+ 637us) server_negotiation.cc:407] Connection header received
0809 20:12:01.242223 (+ 389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:01.242241 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:01.242362 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:01.242462 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:12:01.243084 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.243898 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.245749 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.246620 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.246745 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:01.246796 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:01.247187 (+ 391us) server_negotiation.cc:299] Negotiation successful
0809 20:12:01.247320 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 20:12:01.247557 28452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:01.241936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:54037 (local address 127.14.181.2:40463)
0809 20:12:01.242109 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:01.242115 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:01.242551 (+ 436us) server_negotiation.cc:407] Connection header received
0809 20:12:01.242705 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:01.242711 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:01.242798 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:01.242894 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:12:01.243431 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.244208 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.245919 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.246758 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.246911 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:01.246980 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:01.247219 (+ 239us) server_negotiation.cc:299] Negotiation successful
0809 20:12:01.247332 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 20:12:01.247612 28469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:01.241831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:40463 (local address 127.14.181.1:54037)
0809 20:12:01.242451 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:01.242467 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:01.242592 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:01.242910 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:01.242913 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:01.242931 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:12:01.243284 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:01.243295 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.244350 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.244354 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:01.245766 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:01.245780 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.246960 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.246965 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:01.247073 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:01.247095 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 20:12:01.247181 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 20:12:01.247301 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":290,"threads_started":1}
I20260809 20:12:01.247960 28466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:01.241031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:44669 (local address 127.14.181.1:40621)
0809 20:12:01.241742 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:01.241759 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:01.241899 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:01.242495 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:01.242498 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:01.242526 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:12:01.242935 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:01.242950 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.244021 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.244027 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:01.245590 (+ 1563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:01.245603 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.246818 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.246825 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:01.247010 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:01.247044 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 20:12:01.247130 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 20:12:01.247243 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"thread_start_us":342,"threads_started":1}
I20260809 20:12:01.248574 28116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e845759a28fd4c52a699bf7e08b49da3" candidate_uuid: "e096433beba5480db2fb141954e88ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922e7d39b9a24541968e2df2043849d6" is_pre_election: true
I20260809 20:12:01.248787 28340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e845759a28fd4c52a699bf7e08b49da3" candidate_uuid: "e096433beba5480db2fb141954e88ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" is_pre_election: true
I20260809 20:12:01.249018 28116 raft_consensus.cc:2454] T e845759a28fd4c52a699bf7e08b49da3 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e096433beba5480db2fb141954e88ed6 in term 0.
I20260809 20:12:01.249274 28340 raft_consensus.cc:2454] T e845759a28fd4c52a699bf7e08b49da3 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e096433beba5480db2fb141954e88ed6 in term 0.
I20260809 20:12:01.249686 27767 leader_election.cc:302] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 922e7d39b9a24541968e2df2043849d6, e096433beba5480db2fb141954e88ed6; no voters:
I20260809 20:12:01.250020 28461 raft_consensus.cc:2781] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:12:01.250147 28461 raft_consensus.cc:482] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:12:01.250245 28461 raft_consensus.cc:3037] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:12:01.252332 28461 raft_consensus.cc:504] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } }
I20260809 20:12:01.252830 28461 leader_election.cc:288] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6 [CANDIDATE]: Term 1 election: Requested vote from peers 8fc7adedd38a480dba8ceb9b947ea2a9 (127.14.181.3:44669), 922e7d39b9a24541968e2df2043849d6 (127.14.181.2:40463)
I20260809 20:12:01.253281 28340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e845759a28fd4c52a699bf7e08b49da3" candidate_uuid: "e096433beba5480db2fb141954e88ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9"
I20260809 20:12:01.253304 28116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e845759a28fd4c52a699bf7e08b49da3" candidate_uuid: "e096433beba5480db2fb141954e88ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922e7d39b9a24541968e2df2043849d6"
I20260809 20:12:01.253484 28116 raft_consensus.cc:3037] T e845759a28fd4c52a699bf7e08b49da3 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:12:01.253484 28340 raft_consensus.cc:3037] T e845759a28fd4c52a699bf7e08b49da3 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:12:01.256565 28340 raft_consensus.cc:2454] T e845759a28fd4c52a699bf7e08b49da3 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e096433beba5480db2fb141954e88ed6 in term 1.
I20260809 20:12:01.256565 28116 raft_consensus.cc:2454] T e845759a28fd4c52a699bf7e08b49da3 P 922e7d39b9a24541968e2df2043849d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e096433beba5480db2fb141954e88ed6 in term 1.
I20260809 20:12:01.256917 27767 leader_election.cc:302] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 922e7d39b9a24541968e2df2043849d6, e096433beba5480db2fb141954e88ed6; no voters:
I20260809 20:12:01.257164 28461 raft_consensus.cc:2781] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:12:01.257560 28461 raft_consensus.cc:686] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6 [term 1 LEADER]: Becoming Leader. State: Replica: e096433beba5480db2fb141954e88ed6, State: Running, Role: LEADER
I20260809 20:12:01.257972 28461 consensus_queue.cc:237] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } }
I20260809 20:12:01.262138 27608 catalog_manager.cc:5495] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e096433beba5480db2fb141954e88ed6 (127.14.181.1). New cstate: current_term: 1 leader_uuid: "e096433beba5480db2fb141954e88ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } health_report { overall_health: HEALTHY } } }
I20260809 20:12:01.345292 28450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:01.340287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53138 (local address 127.14.181.1:45253)
0809 20:12:01.340494 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:01.340500 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:01.340514 (+ 14us) server_negotiation.cc:407] Connection header received
0809 20:12:01.340598 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:01.340601 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:01.340693 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:01.340835 (+ 142us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:12:01.341208 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.341898 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.343270 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.343658 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.343788 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:01.344199 (+ 411us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:12:01.344720 (+ 521us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:12:01.344849 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:01.344953 (+ 104us) server_negotiation.cc:299] Negotiation successful
0809 20:12:01.345034 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 20:12:01.352859 28340 raft_consensus.cc:1261] T e845759a28fd4c52a699bf7e08b49da3 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 1 FOLLOWER]: Refusing update from remote peer e096433beba5480db2fb141954e88ed6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:12:01.352877 28116 raft_consensus.cc:1261] T e845759a28fd4c52a699bf7e08b49da3 P 922e7d39b9a24541968e2df2043849d6 [term 1 FOLLOWER]: Refusing update from remote peer e096433beba5480db2fb141954e88ed6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:12:01.353680 28461 consensus_queue.cc:1035] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:12:01.353974 28470 consensus_queue.cc:1035] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:12:01.369743 28475 mvcc.cc:205] Tried to move back new op lower bound from 7316710692252061696 to 7316710691876098048. Current Snapshot: MvccSnapshot[applied={T|T < 7316710692252061696 or (T in {7316710692252061696})}]
I20260809 20:12:01.375734 28479 mvcc.cc:205] Tried to move back new op lower bound from 7316710692252061696 to 7316710691876098048. Current Snapshot: MvccSnapshot[applied={T|T < 7316710692252061696}]
I20260809 20:12:01.377231 27608 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52024:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:12:01.377516 27608 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52024:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:12:01.381615 27608 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d7d1eb29af3948a1bf21c7d36b407a84: Sending DeleteTablet for 3 replicas of tablet e845759a28fd4c52a699bf7e08b49da3
I20260809 20:12:01.382658 28306 tablet_service.cc:1514] Processing DeleteTablet for tablet e845759a28fd4c52a699bf7e08b49da3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:12:01 UTC) from {username='oryx', principal='oryx/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:35858
I20260809 20:12:01.382689 27847 tablet_service.cc:1514] Processing DeleteTablet for tablet e845759a28fd4c52a699bf7e08b49da3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:12:01 UTC) from {username='oryx', principal='oryx/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:53126
I20260809 20:12:01.382871 28076 tablet_service.cc:1514] Processing DeleteTablet for tablet e845759a28fd4c52a699bf7e08b49da3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:12:01 UTC) from {username='oryx', principal='oryx/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:59628
I20260809 20:12:01.384354 27610 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52024:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 20:12:01.385025 27610 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 20:12:01.391984 27846 tablet_service.cc:1467] Processing CreateTablet for tablet 07584785e6b943bc8e83de1bb8159525 (DEFAULT_TABLE table=test-table [id=7f4d4173ec2d45c0a2cf891552299653]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:12:01.392573 27846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07584785e6b943bc8e83de1bb8159525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:12:01.395215 28075 tablet_service.cc:1467] Processing CreateTablet for tablet 07584785e6b943bc8e83de1bb8159525 (DEFAULT_TABLE table=test-table [id=7f4d4173ec2d45c0a2cf891552299653]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:12:01.395740 28496 tablet_replica.cc:330] T e845759a28fd4c52a699bf7e08b49da3 P 8fc7adedd38a480dba8ceb9b947ea2a9: stopping tablet replica
I20260809 20:12:01.395767 28075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07584785e6b943bc8e83de1bb8159525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:12:01.396118 28496 raft_consensus.cc:2229] T e845759a28fd4c52a699bf7e08b49da3 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:12:01.396488 28498 tablet_replica.cc:330] T e845759a28fd4c52a699bf7e08b49da3 P 922e7d39b9a24541968e2df2043849d6: stopping tablet replica
I20260809 20:12:01.396718 28496 raft_consensus.cc:2258] T e845759a28fd4c52a699bf7e08b49da3 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:12:01.396871 28498 raft_consensus.cc:2229] T e845759a28fd4c52a699bf7e08b49da3 P 922e7d39b9a24541968e2df2043849d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:12:01.398694 28496 ts_tablet_manager.cc:1905] T e845759a28fd4c52a699bf7e08b49da3 P 8fc7adedd38a480dba8ceb9b947ea2a9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:12:01.398846 28306 tablet_service.cc:1467] Processing CreateTablet for tablet 07584785e6b943bc8e83de1bb8159525 (DEFAULT_TABLE table=test-table [id=7f4d4173ec2d45c0a2cf891552299653]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:12:01.399247 28306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07584785e6b943bc8e83de1bb8159525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:12:01.403937 28497 tablet_replica.cc:330] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6: stopping tablet replica
I20260809 20:12:01.404278 28497 raft_consensus.cc:2229] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6 [term 1 LEADER]: Raft consensus shutting down.
I20260809 20:12:01.404853 28497 raft_consensus.cc:2258] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:12:01.405391 28498 raft_consensus.cc:2258] T e845759a28fd4c52a699bf7e08b49da3 P 922e7d39b9a24541968e2df2043849d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:12:01.405926 28496 ts_tablet_manager.cc:1918] T e845759a28fd4c52a699bf7e08b49da3 P 8fc7adedd38a480dba8ceb9b947ea2a9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:12:01.406092 28496 log.cc:1196] T e845759a28fd4c52a699bf7e08b49da3 P 8fc7adedd38a480dba8ceb9b947ea2a9: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-2/wal/wals/e845759a28fd4c52a699bf7e08b49da3
I20260809 20:12:01.406698 28496 ts_tablet_manager.cc:1939] T e845759a28fd4c52a699bf7e08b49da3 P 8fc7adedd38a480dba8ceb9b947ea2a9: Deleting consensus metadata
I20260809 20:12:01.407287 28498 ts_tablet_manager.cc:1905] T e845759a28fd4c52a699bf7e08b49da3 P 922e7d39b9a24541968e2df2043849d6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:12:01.407994 28458 tablet_bootstrap.cc:492] T 07584785e6b943bc8e83de1bb8159525 P 8fc7adedd38a480dba8ceb9b947ea2a9: Bootstrap starting.
I20260809 20:12:01.409437 28458 tablet_bootstrap.cc:654] T 07584785e6b943bc8e83de1bb8159525 P 8fc7adedd38a480dba8ceb9b947ea2a9: Neither blocks nor log segments found. Creating new log.
I20260809 20:12:01.409763 28497 ts_tablet_manager.cc:1905] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:12:01.410668 27587 catalog_manager.cc:4841] TS 8fc7adedd38a480dba8ceb9b947ea2a9 (127.14.181.3:44669): tablet e845759a28fd4c52a699bf7e08b49da3 (table test-table [id=06e9390022ac4339853b9f12abd6b46f]) successfully deleted
I20260809 20:12:01.412245 28455 tablet_bootstrap.cc:492] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6: Bootstrap starting.
I20260809 20:12:01.413674 28455 tablet_bootstrap.cc:654] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6: Neither blocks nor log segments found. Creating new log.
I20260809 20:12:01.416635 28497 ts_tablet_manager.cc:1918] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:12:01.416807 28497 log.cc:1196] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-0/wal/wals/e845759a28fd4c52a699bf7e08b49da3
I20260809 20:12:01.417320 28497 ts_tablet_manager.cc:1939] T e845759a28fd4c52a699bf7e08b49da3 P e096433beba5480db2fb141954e88ed6: Deleting consensus metadata
I20260809 20:12:01.419121 28454 tablet_bootstrap.cc:492] T 07584785e6b943bc8e83de1bb8159525 P e096433beba5480db2fb141954e88ed6: Bootstrap starting.
I20260809 20:12:01.420691 28454 tablet_bootstrap.cc:654] T 07584785e6b943bc8e83de1bb8159525 P e096433beba5480db2fb141954e88ed6: Neither blocks nor log segments found. Creating new log.
I20260809 20:12:01.425127 28458 tablet_bootstrap.cc:492] T 07584785e6b943bc8e83de1bb8159525 P 8fc7adedd38a480dba8ceb9b947ea2a9: No bootstrap required, opened a new log
I20260809 20:12:01.425273 28458 ts_tablet_manager.cc:1397] T 07584785e6b943bc8e83de1bb8159525 P 8fc7adedd38a480dba8ceb9b947ea2a9: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.001s
I20260809 20:12:01.426023 28458 raft_consensus.cc:348] T 07584785e6b943bc8e83de1bb8159525 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:01.426247 28458 raft_consensus.cc:374] T 07584785e6b943bc8e83de1bb8159525 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:12:01.426364 28458 raft_consensus.cc:729] T 07584785e6b943bc8e83de1bb8159525 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fc7adedd38a480dba8ceb9b947ea2a9, State: Initialized, Role: FOLLOWER
I20260809 20:12:01.426669 28458 consensus_queue.cc:260] T 07584785e6b943bc8e83de1bb8159525 P 8fc7adedd38a480dba8ceb9b947ea2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:01.428064 28458 ts_tablet_manager.cc:1428] T 07584785e6b943bc8e83de1bb8159525 P 8fc7adedd38a480dba8ceb9b947ea2a9: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260809 20:12:01.429344 28455 tablet_bootstrap.cc:492] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6: No bootstrap required, opened a new log
I20260809 20:12:01.429486 28455 ts_tablet_manager.cc:1397] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.000s
I20260809 20:12:01.430274 28455 raft_consensus.cc:348] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:01.430507 28455 raft_consensus.cc:374] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:12:01.430609 28455 raft_consensus.cc:729] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922e7d39b9a24541968e2df2043849d6, State: Initialized, Role: FOLLOWER
I20260809 20:12:01.430867 28455 consensus_queue.cc:260] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:01.432080 28455 ts_tablet_manager.cc:1428] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 20:12:01.433027 27588 catalog_manager.cc:4841] TS e096433beba5480db2fb141954e88ed6 (127.14.181.1:45253): tablet e845759a28fd4c52a699bf7e08b49da3 (table test-table [id=06e9390022ac4339853b9f12abd6b46f]) successfully deleted
I20260809 20:12:01.433182 28498 ts_tablet_manager.cc:1918] T e845759a28fd4c52a699bf7e08b49da3 P 922e7d39b9a24541968e2df2043849d6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:12:01.433423 28498 log.cc:1196] T e845759a28fd4c52a699bf7e08b49da3 P 922e7d39b9a24541968e2df2043849d6: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-1/wal/wals/e845759a28fd4c52a699bf7e08b49da3
I20260809 20:12:01.433981 28498 ts_tablet_manager.cc:1939] T e845759a28fd4c52a699bf7e08b49da3 P 922e7d39b9a24541968e2df2043849d6: Deleting consensus metadata
I20260809 20:12:01.435573 27587 catalog_manager.cc:4841] TS 922e7d39b9a24541968e2df2043849d6 (127.14.181.2:40463): tablet e845759a28fd4c52a699bf7e08b49da3 (table test-table [id=06e9390022ac4339853b9f12abd6b46f]) successfully deleted
I20260809 20:12:01.436774 28454 tablet_bootstrap.cc:492] T 07584785e6b943bc8e83de1bb8159525 P e096433beba5480db2fb141954e88ed6: No bootstrap required, opened a new log
I20260809 20:12:01.436924 28454 ts_tablet_manager.cc:1397] T 07584785e6b943bc8e83de1bb8159525 P e096433beba5480db2fb141954e88ed6: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.007s
I20260809 20:12:01.437702 28454 raft_consensus.cc:348] T 07584785e6b943bc8e83de1bb8159525 P e096433beba5480db2fb141954e88ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:01.437935 28454 raft_consensus.cc:374] T 07584785e6b943bc8e83de1bb8159525 P e096433beba5480db2fb141954e88ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:12:01.438035 28454 raft_consensus.cc:729] T 07584785e6b943bc8e83de1bb8159525 P e096433beba5480db2fb141954e88ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e096433beba5480db2fb141954e88ed6, State: Initialized, Role: FOLLOWER
I20260809 20:12:01.438318 28454 consensus_queue.cc:260] T 07584785e6b943bc8e83de1bb8159525 P e096433beba5480db2fb141954e88ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:01.438999 28454 ts_tablet_manager.cc:1428] T 07584785e6b943bc8e83de1bb8159525 P e096433beba5480db2fb141954e88ed6: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 20:12:01.570565 28464 raft_consensus.cc:482] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:12:01.570806 28464 raft_consensus.cc:504] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:01.572700 28464 leader_election.cc:288] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e096433beba5480db2fb141954e88ed6 (127.14.181.1:45253), 8fc7adedd38a480dba8ceb9b947ea2a9 (127.14.181.3:44669)
I20260809 20:12:01.580896 28446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:01.573515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:49129 (local address 127.14.181.3:44669)
0809 20:12:01.573703 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:01.573708 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:01.574796 (+ 1088us) server_negotiation.cc:407] Connection header received
0809 20:12:01.574982 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:01.574988 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:01.575058 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:01.575108 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:12:01.575850 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.576976 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.579219 (+ 2243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.580006 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.580160 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:01.580235 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:01.580521 (+ 286us) server_negotiation.cc:299] Negotiation successful
0809 20:12:01.580652 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 20:12:01.580983 28503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:01.572917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:44669 (local address 127.14.181.2:49129)
0809 20:12:01.574680 (+ 1763us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:01.574699 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:01.574817 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:01.575265 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:01.575268 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:01.575287 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:12:01.575671 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:01.575685 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.577119 (+ 1434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.577124 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:01.579073 (+ 1949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:01.579092 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.580223 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.580229 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:01.580373 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:01.580401 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 20:12:01.580486 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 20:12:01.580615 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1631,"mutex_wait_us":38,"thread_start_us":959,"threads_started":1}
I20260809 20:12:01.581226 28450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:01.573113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:38907 (local address 127.14.181.1:45253)
0809 20:12:01.573304 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:01.573310 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:01.574313 (+ 1003us) server_negotiation.cc:407] Connection header received
0809 20:12:01.574695 (+ 382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:01.574702 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:01.574784 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:01.574876 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:12:01.575488 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.576468 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.578910 (+ 2442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.580043 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.580182 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:01.580247 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:01.580783 (+ 536us) server_negotiation.cc:299] Negotiation successful
0809 20:12:01.580916 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 20:12:01.581761 28506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:01.572845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:45253 (local address 127.14.181.2:38907)
0809 20:12:01.574199 (+ 1354us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:01.574219 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:01.574466 (+ 247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:01.574899 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:01.574904 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:01.574932 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:12:01.575270 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:01.575283 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.576590 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.576596 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:01.578730 (+ 2134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:01.578746 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.580404 (+ 1658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.580410 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:01.580599 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:01.580639 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 20:12:01.581291 (+ 652us) client_negotiation.cc:240] Negotiation successful
0809 20:12:01.581417 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1206,"mutex_wait_us":17,"thread_start_us":1523,"threads_started":1}
I20260809 20:12:01.582366 28340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07584785e6b943bc8e83de1bb8159525" candidate_uuid: "922e7d39b9a24541968e2df2043849d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" is_pre_election: true
I20260809 20:12:01.582619 28340 raft_consensus.cc:2454] T 07584785e6b943bc8e83de1bb8159525 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 922e7d39b9a24541968e2df2043849d6 in term 0.
I20260809 20:12:01.582647 27883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07584785e6b943bc8e83de1bb8159525" candidate_uuid: "922e7d39b9a24541968e2df2043849d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e096433beba5480db2fb141954e88ed6" is_pre_election: true
I20260809 20:12:01.583027 27883 raft_consensus.cc:2454] T 07584785e6b943bc8e83de1bb8159525 P e096433beba5480db2fb141954e88ed6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 922e7d39b9a24541968e2df2043849d6 in term 0.
I20260809 20:12:01.583055 27991 leader_election.cc:302] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fc7adedd38a480dba8ceb9b947ea2a9, 922e7d39b9a24541968e2df2043849d6; no voters:
I20260809 20:12:01.583408 28464 raft_consensus.cc:2781] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:12:01.583541 28464 raft_consensus.cc:482] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:12:01.583642 28464 raft_consensus.cc:3037] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:12:01.585691 28464 raft_consensus.cc:504] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:01.586299 28464 leader_election.cc:288] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6 [CANDIDATE]: Term 1 election: Requested vote from peers e096433beba5480db2fb141954e88ed6 (127.14.181.1:45253), 8fc7adedd38a480dba8ceb9b947ea2a9 (127.14.181.3:44669)
I20260809 20:12:01.586691 27883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07584785e6b943bc8e83de1bb8159525" candidate_uuid: "922e7d39b9a24541968e2df2043849d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e096433beba5480db2fb141954e88ed6"
I20260809 20:12:01.586907 27883 raft_consensus.cc:3037] T 07584785e6b943bc8e83de1bb8159525 P e096433beba5480db2fb141954e88ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:12:01.586843 28340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07584785e6b943bc8e83de1bb8159525" candidate_uuid: "922e7d39b9a24541968e2df2043849d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9"
I20260809 20:12:01.587034 28340 raft_consensus.cc:3037] T 07584785e6b943bc8e83de1bb8159525 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:12:01.589808 28340 raft_consensus.cc:2454] T 07584785e6b943bc8e83de1bb8159525 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922e7d39b9a24541968e2df2043849d6 in term 1.
I20260809 20:12:01.590066 27883 raft_consensus.cc:2454] T 07584785e6b943bc8e83de1bb8159525 P e096433beba5480db2fb141954e88ed6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922e7d39b9a24541968e2df2043849d6 in term 1.
I20260809 20:12:01.590173 27991 leader_election.cc:302] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fc7adedd38a480dba8ceb9b947ea2a9, 922e7d39b9a24541968e2df2043849d6; no voters:
I20260809 20:12:01.590453 28464 raft_consensus.cc:2781] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:12:01.590894 28464 raft_consensus.cc:686] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6 [term 1 LEADER]: Becoming Leader. State: Replica: 922e7d39b9a24541968e2df2043849d6, State: Running, Role: LEADER
I20260809 20:12:01.591280 28464 consensus_queue.cc:237] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:01.594152 27610 catalog_manager.cc:5495] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 922e7d39b9a24541968e2df2043849d6 (127.14.181.2). New cstate: current_term: 1 leader_uuid: "922e7d39b9a24541968e2df2043849d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } health_report { overall_health: UNKNOWN } } }
Aug 09 20:12:01 dist-test-slave-6zbq krb5kdc[27548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306318, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.62@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM
I20260809 20:12:01.648828 28524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:01.628896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39675 (local address 127.0.0.1:52038)
0809 20:12:01.635417 (+ 6521us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:01.635436 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:01.635597 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:01.635924 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:01.635929 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:01.636581 (+ 652us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:01.636774 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:01.636786 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.637814 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.637819 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:01.638850 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:01.638864 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.639575 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.639581 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:01.639764 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:01.640420 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:01.640436 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:01.642789 (+ 2353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:12:01.646497 (+ 3708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:12:01.646507 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:12:01.646513 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:12:01.646893 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:12:01.647291 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:12:01.647294 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:12:01.647296 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:12:01.647425 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:12:01.648048 (+ 623us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:12:01.648053 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:12:01.648203 (+ 150us) client_negotiation.cc:769] Sending connection context
0809 20:12:01.648338 (+ 135us) client_negotiation.cc:240] Negotiation successful
0809 20:12:01.648518 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6392,"thread_start_us":6278,"threads_started":1}
I20260809 20:12:01.649180 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:01.629053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52038 (local address 127.14.181.62:39675)
0809 20:12:01.635013 (+ 5960us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:01.635019 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:01.635519 (+ 500us) server_negotiation.cc:407] Connection header received
0809 20:12:01.635717 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:01.635722 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:01.635786 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:01.635873 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:01.636909 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.637674 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.638976 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.639425 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.639531 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:01.642988 (+ 3457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:01.642996 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:01.643001 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:12:01.643038 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:01.646336 (+ 3298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:01.647030 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:01.647036 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:01.647039 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:01.647190 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:01.647547 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:01.647553 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:01.647556 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:01.647927 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:01.648095 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:01.648482 (+ 387us) server_negotiation.cc:299] Negotiation successful
0809 20:12:01.648742 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5796,"thread_start_us":5481,"threads_started":1}
I20260809 20:12:01.653852 27610 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:52038:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 20:12:01.654867 27610 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 20:12:01.661417 27846 tablet_service.cc:1467] Processing CreateTablet for tablet 69351537ca7648f9be2ac9c9733a1285 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=420ed695d1d1409e9eaee6427dd85f5a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 20:12:01.661590 28075 tablet_service.cc:1467] Processing CreateTablet for tablet 69351537ca7648f9be2ac9c9733a1285 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=420ed695d1d1409e9eaee6427dd85f5a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 20:12:01.662019 27846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69351537ca7648f9be2ac9c9733a1285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:12:01.662127 28075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69351537ca7648f9be2ac9c9733a1285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:12:01.668062 28454 tablet_bootstrap.cc:492] T 69351537ca7648f9be2ac9c9733a1285 P e096433beba5480db2fb141954e88ed6: Bootstrap starting.
I20260809 20:12:01.669130 28455 tablet_bootstrap.cc:492] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6: Bootstrap starting.
I20260809 20:12:01.669129 28306 tablet_service.cc:1467] Processing CreateTablet for tablet 69351537ca7648f9be2ac9c9733a1285 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=420ed695d1d1409e9eaee6427dd85f5a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 20:12:01.669663 28306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69351537ca7648f9be2ac9c9733a1285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:12:01.669796 28454 tablet_bootstrap.cc:654] T 69351537ca7648f9be2ac9c9733a1285 P e096433beba5480db2fb141954e88ed6: Neither blocks nor log segments found. Creating new log.
I20260809 20:12:01.670776 28455 tablet_bootstrap.cc:654] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6: Neither blocks nor log segments found. Creating new log.
I20260809 20:12:01.677157 28458 tablet_bootstrap.cc:492] T 69351537ca7648f9be2ac9c9733a1285 P 8fc7adedd38a480dba8ceb9b947ea2a9: Bootstrap starting.
I20260809 20:12:01.678819 28458 tablet_bootstrap.cc:654] T 69351537ca7648f9be2ac9c9733a1285 P 8fc7adedd38a480dba8ceb9b947ea2a9: Neither blocks nor log segments found. Creating new log.
I20260809 20:12:01.682821 28455 tablet_bootstrap.cc:492] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6: No bootstrap required, opened a new log
I20260809 20:12:01.682983 28455 ts_tablet_manager.cc:1397] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.004s
I20260809 20:12:01.683732 28455 raft_consensus.cc:348] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:01.683988 28455 raft_consensus.cc:374] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:12:01.684080 28455 raft_consensus.cc:729] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922e7d39b9a24541968e2df2043849d6, State: Initialized, Role: FOLLOWER
I20260809 20:12:01.684357 28455 consensus_queue.cc:260] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:01.684993 28455 ts_tablet_manager.cc:1428] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 20:12:01.684831 28464 tablet_replica.cc:439] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } } }
I20260809 20:12:01.685751 28464 tablet_replica.cc:442] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 20:12:01.688457 28458 tablet_bootstrap.cc:492] T 69351537ca7648f9be2ac9c9733a1285 P 8fc7adedd38a480dba8ceb9b947ea2a9: No bootstrap required, opened a new log
I20260809 20:12:01.688627 28458 ts_tablet_manager.cc:1397] T 69351537ca7648f9be2ac9c9733a1285 P 8fc7adedd38a480dba8ceb9b947ea2a9: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.002s
I20260809 20:12:01.689342 28458 raft_consensus.cc:348] T 69351537ca7648f9be2ac9c9733a1285 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:01.689600 28458 raft_consensus.cc:374] T 69351537ca7648f9be2ac9c9733a1285 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:12:01.689680 28458 raft_consensus.cc:729] T 69351537ca7648f9be2ac9c9733a1285 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fc7adedd38a480dba8ceb9b947ea2a9, State: Initialized, Role: FOLLOWER
I20260809 20:12:01.689958 28458 consensus_queue.cc:260] T 69351537ca7648f9be2ac9c9733a1285 P 8fc7adedd38a480dba8ceb9b947ea2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:01.690481 28465 tablet_replica.cc:439] T 69351537ca7648f9be2ac9c9733a1285 P 8fc7adedd38a480dba8ceb9b947ea2a9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } } }
I20260809 20:12:01.690845 28465 tablet_replica.cc:442] T 69351537ca7648f9be2ac9c9733a1285 P 8fc7adedd38a480dba8ceb9b947ea2a9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 20:12:01.691502 28458 ts_tablet_manager.cc:1428] T 69351537ca7648f9be2ac9c9733a1285 P 8fc7adedd38a480dba8ceb9b947ea2a9: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260809 20:12:01.693143 28454 tablet_bootstrap.cc:492] T 69351537ca7648f9be2ac9c9733a1285 P e096433beba5480db2fb141954e88ed6: No bootstrap required, opened a new log
I20260809 20:12:01.693373 28454 ts_tablet_manager.cc:1397] T 69351537ca7648f9be2ac9c9733a1285 P e096433beba5480db2fb141954e88ed6: Time spent bootstrapping tablet: real 0.025s user 0.008s sys 0.010s
I20260809 20:12:01.694185 28454 raft_consensus.cc:348] T 69351537ca7648f9be2ac9c9733a1285 P e096433beba5480db2fb141954e88ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:01.694473 28454 raft_consensus.cc:374] T 69351537ca7648f9be2ac9c9733a1285 P e096433beba5480db2fb141954e88ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:12:01.694577 28454 raft_consensus.cc:729] T 69351537ca7648f9be2ac9c9733a1285 P e096433beba5480db2fb141954e88ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e096433beba5480db2fb141954e88ed6, State: Initialized, Role: FOLLOWER
I20260809 20:12:01.694831 28454 consensus_queue.cc:260] T 69351537ca7648f9be2ac9c9733a1285 P e096433beba5480db2fb141954e88ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:01.695317 28461 tablet_replica.cc:439] T 69351537ca7648f9be2ac9c9733a1285 P e096433beba5480db2fb141954e88ed6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } } }
I20260809 20:12:01.695523 28454 ts_tablet_manager.cc:1428] T 69351537ca7648f9be2ac9c9733a1285 P e096433beba5480db2fb141954e88ed6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 20:12:01.695622 28461 tablet_replica.cc:442] T 69351537ca7648f9be2ac9c9733a1285 P e096433beba5480db2fb141954e88ed6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 20:12:01.712260 28464 raft_consensus.cc:482] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:12:01.712440 28464 raft_consensus.cc:504] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:01.712990 28464 leader_election.cc:288] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e096433beba5480db2fb141954e88ed6 (127.14.181.1:45253), 8fc7adedd38a480dba8ceb9b947ea2a9 (127.14.181.3:44669)
I20260809 20:12:01.713505 27883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69351537ca7648f9be2ac9c9733a1285" candidate_uuid: "922e7d39b9a24541968e2df2043849d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e096433beba5480db2fb141954e88ed6" is_pre_election: true
I20260809 20:12:01.713539 28340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69351537ca7648f9be2ac9c9733a1285" candidate_uuid: "922e7d39b9a24541968e2df2043849d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" is_pre_election: true
I20260809 20:12:01.713748 27883 raft_consensus.cc:2454] T 69351537ca7648f9be2ac9c9733a1285 P e096433beba5480db2fb141954e88ed6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 922e7d39b9a24541968e2df2043849d6 in term 0.
I20260809 20:12:01.713833 28340 raft_consensus.cc:2454] T 69351537ca7648f9be2ac9c9733a1285 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 922e7d39b9a24541968e2df2043849d6 in term 0.
I20260809 20:12:01.714155 27992 leader_election.cc:302] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 922e7d39b9a24541968e2df2043849d6, e096433beba5480db2fb141954e88ed6; no voters:
I20260809 20:12:01.714495 28464 raft_consensus.cc:2781] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:12:01.714592 28464 raft_consensus.cc:482] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:12:01.714718 28464 raft_consensus.cc:3037] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:12:01.716943 28464 raft_consensus.cc:504] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:01.717485 28464 leader_election.cc:288] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6 [CANDIDATE]: Term 1 election: Requested vote from peers e096433beba5480db2fb141954e88ed6 (127.14.181.1:45253), 8fc7adedd38a480dba8ceb9b947ea2a9 (127.14.181.3:44669)
I20260809 20:12:01.717864 27883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69351537ca7648f9be2ac9c9733a1285" candidate_uuid: "922e7d39b9a24541968e2df2043849d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e096433beba5480db2fb141954e88ed6"
I20260809 20:12:01.717942 28340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69351537ca7648f9be2ac9c9733a1285" candidate_uuid: "922e7d39b9a24541968e2df2043849d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9"
I20260809 20:12:01.718094 27883 raft_consensus.cc:3037] T 69351537ca7648f9be2ac9c9733a1285 P e096433beba5480db2fb141954e88ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:12:01.718149 28340 raft_consensus.cc:3037] T 69351537ca7648f9be2ac9c9733a1285 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:12:01.720888 28340 raft_consensus.cc:2454] T 69351537ca7648f9be2ac9c9733a1285 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922e7d39b9a24541968e2df2043849d6 in term 1.
I20260809 20:12:01.721117 27883 raft_consensus.cc:2454] T 69351537ca7648f9be2ac9c9733a1285 P e096433beba5480db2fb141954e88ed6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922e7d39b9a24541968e2df2043849d6 in term 1.
I20260809 20:12:01.721326 27991 leader_election.cc:302] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fc7adedd38a480dba8ceb9b947ea2a9, 922e7d39b9a24541968e2df2043849d6; no voters:
I20260809 20:12:01.721632 28464 raft_consensus.cc:2781] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:12:01.721767 28464 raft_consensus.cc:686] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6 [term 1 LEADER]: Becoming Leader. State: Replica: 922e7d39b9a24541968e2df2043849d6, State: Running, Role: LEADER
I20260809 20:12:01.721982 28464 consensus_queue.cc:237] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:01.723569 28507 tablet_replica.cc:439] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6: TxnStatusTablet state changed. Reason: New leader 922e7d39b9a24541968e2df2043849d6. Latest consensus state: current_term: 1 leader_uuid: "922e7d39b9a24541968e2df2043849d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } } }
I20260809 20:12:01.723963 28507 tablet_replica.cc:442] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6: This TxnStatusTablet replica's current role is: LEADER
I20260809 20:12:01.724677 28537 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 20:12:01.724917 28537 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 20:12:01.724978 27610 catalog_manager.cc:5495] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 922e7d39b9a24541968e2df2043849d6 (127.14.181.2). New cstate: current_term: 1 leader_uuid: "922e7d39b9a24541968e2df2043849d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } health_report { overall_health: UNKNOWN } } }
I20260809 20:12:01.745021 28524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:01.737670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:40463 (local address 127.0.0.1:59642)
0809 20:12:01.738037 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:01.738058 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:01.738205 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:01.738790 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:01.738795 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:01.738808 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 20:12:01.738996 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:01.739008 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.740537 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.740543 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:01.742141 (+ 1598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:01.742159 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.743175 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.743181 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:01.743401 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:01.743472 (+ 71us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 20:12:01.744451 (+ 979us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 20:12:01.744473 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 20:12:01.744565 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 20:12:01.744719 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198}
I20260809 20:12:01.745031 28452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:01.737666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59642 (local address 127.14.181.2:40463)
0809 20:12:01.737840 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:01.737846 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:01.738144 (+ 298us) server_negotiation.cc:407] Connection header received
0809 20:12:01.738451 (+ 307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:01.738457 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:01.738569 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:01.738775 (+ 206us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:12:01.739148 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.740392 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.742308 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.743005 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.743154 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:01.743684 (+ 530us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:12:01.744329 (+ 645us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:12:01.744474 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:01.744597 (+ 123us) server_negotiation.cc:299] Negotiation successful
0809 20:12:01.744690 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 20:12:01.749404 28340 raft_consensus.cc:1261] T 69351537ca7648f9be2ac9c9733a1285 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 1 FOLLOWER]: Refusing update from remote peer 922e7d39b9a24541968e2df2043849d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:12:01.749531 27883 raft_consensus.cc:1261] T 69351537ca7648f9be2ac9c9733a1285 P e096433beba5480db2fb141954e88ed6 [term 1 FOLLOWER]: Refusing update from remote peer 922e7d39b9a24541968e2df2043849d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:12:01.750303 28464 consensus_queue.cc:1035] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:12:01.750739 28507 consensus_queue.cc:1035] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:12:01.764389 28461 tablet_replica.cc:439] T 69351537ca7648f9be2ac9c9733a1285 P e096433beba5480db2fb141954e88ed6: TxnStatusTablet state changed. Reason: New leader 922e7d39b9a24541968e2df2043849d6. Latest consensus state: current_term: 1 leader_uuid: "922e7d39b9a24541968e2df2043849d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } } }
I20260809 20:12:01.764706 28461 tablet_replica.cc:442] T 69351537ca7648f9be2ac9c9733a1285 P e096433beba5480db2fb141954e88ed6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 20:12:01.767184 28465 tablet_replica.cc:439] T 69351537ca7648f9be2ac9c9733a1285 P 8fc7adedd38a480dba8ceb9b947ea2a9: TxnStatusTablet state changed. Reason: New leader 922e7d39b9a24541968e2df2043849d6. Latest consensus state: current_term: 1 leader_uuid: "922e7d39b9a24541968e2df2043849d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } } }
I20260809 20:12:01.767489 28465 tablet_replica.cc:442] T 69351537ca7648f9be2ac9c9733a1285 P 8fc7adedd38a480dba8ceb9b947ea2a9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 20:12:01.768527 28464 tablet_replica.cc:439] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "922e7d39b9a24541968e2df2043849d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } } }
I20260809 20:12:01.768818 28464 tablet_replica.cc:442] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6: This TxnStatusTablet replica's current role is: LEADER
I20260809 20:12:01.769009 28478 mvcc.cc:205] Tried to move back new op lower bound from 7316710693877907456 to 7316710693775290368. Current Snapshot: MvccSnapshot[applied={T|T < 7316710693877907456 or (T in {7316710693877907456})}]
I20260809 20:12:01.771559 28461 tablet_replica.cc:439] T 69351537ca7648f9be2ac9c9733a1285 P e096433beba5480db2fb141954e88ed6: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "922e7d39b9a24541968e2df2043849d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } } }
I20260809 20:12:01.771812 28461 tablet_replica.cc:442] T 69351537ca7648f9be2ac9c9733a1285 P e096433beba5480db2fb141954e88ed6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 20:12:01.772820 28507 tablet_replica.cc:439] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "922e7d39b9a24541968e2df2043849d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } } }
I20260809 20:12:01.773061 28507 tablet_replica.cc:442] T 69351537ca7648f9be2ac9c9733a1285 P 922e7d39b9a24541968e2df2043849d6: This TxnStatusTablet replica's current role is: LEADER
I20260809 20:12:01.774607 28465 tablet_replica.cc:439] T 69351537ca7648f9be2ac9c9733a1285 P 8fc7adedd38a480dba8ceb9b947ea2a9: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "922e7d39b9a24541968e2df2043849d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } } }
I20260809 20:12:01.774830 28465 tablet_replica.cc:442] T 69351537ca7648f9be2ac9c9733a1285 P 8fc7adedd38a480dba8ceb9b947ea2a9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 20:12:01.785805 28452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:01.779521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59644 (local address 127.14.181.2:40463)
0809 20:12:01.779687 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:01.779693 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:01.779836 (+ 143us) server_negotiation.cc:407] Connection header received
0809 20:12:01.780036 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:01.780042 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:01.780141 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:01.780238 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:12:01.780661 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.781872 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.783789 (+ 1917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.784450 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.784578 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:01.785058 (+ 480us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:12:01.785190 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:12:01.785288 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:01.785416 (+ 128us) server_negotiation.cc:299] Negotiation successful
0809 20:12:01.785491 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 20:12:01.811553 28452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:01.804474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:53047 (local address 127.14.181.2:40463)
0809 20:12:01.804674 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:01.804679 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:01.805259 (+ 580us) server_negotiation.cc:407] Connection header received
0809 20:12:01.805424 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:01.805429 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:01.805508 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:01.805601 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:12:01.806227 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.807344 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.809416 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.810099 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.810222 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:01.810765 (+ 543us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:12:01.810919 (+ 154us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:12:01.811004 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:01.811158 (+ 154us) server_negotiation.cc:299] Negotiation successful
0809 20:12:01.811235 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":55}
I20260809 20:12:01.812409 28549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:01.804197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:40463 (local address 127.14.181.2:53047)
0809 20:12:01.805149 (+ 952us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:01.805168 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:01.805314 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:01.805647 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:01.805652 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:01.805665 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 20:12:01.806067 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:01.806080 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.807471 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.807477 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:01.809264 (+ 1787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:01.809280 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.810298 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.810305 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:01.810525 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:01.810597 (+ 72us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 20:12:01.811047 (+ 450us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 20:12:01.811055 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 20:12:01.811821 (+ 766us) client_negotiation.cc:240] Negotiation successful
0809 20:12:01.811965 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":788,"mutex_wait_us":27,"thread_start_us":635,"threads_started":1}
I20260809 20:12:01.821434 27883 raft_consensus.cc:1261] T 07584785e6b943bc8e83de1bb8159525 P e096433beba5480db2fb141954e88ed6 [term 1 FOLLOWER]: Refusing update from remote peer 922e7d39b9a24541968e2df2043849d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:12:01.821429 28339 raft_consensus.cc:1261] T 07584785e6b943bc8e83de1bb8159525 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 1 FOLLOWER]: Refusing update from remote peer 922e7d39b9a24541968e2df2043849d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:12:01.822027 28464 consensus_queue.cc:1035] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:12:01.822546 28464 consensus_queue.cc:1035] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:12:01.897939 27610 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52024:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:12:01.898211 27610 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52024:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:12:01.901355 27610 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d7d1eb29af3948a1bf21c7d36b407a84: Sending DeleteTablet for 3 replicas of tablet 07584785e6b943bc8e83de1bb8159525
I20260809 20:12:01.902307 28075 tablet_service.cc:1514] Processing DeleteTablet for tablet 07584785e6b943bc8e83de1bb8159525 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:12:01 UTC) from {username='oryx', principal='oryx/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:59628
I20260809 20:12:01.902483 27846 tablet_service.cc:1514] Processing DeleteTablet for tablet 07584785e6b943bc8e83de1bb8159525 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:12:01 UTC) from {username='oryx', principal='oryx/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:53126
I20260809 20:12:01.902601 28498 tablet_replica.cc:330] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6: stopping tablet replica
I20260809 20:12:01.902633 28306 tablet_service.cc:1514] Processing DeleteTablet for tablet 07584785e6b943bc8e83de1bb8159525 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:12:01 UTC) from {username='oryx', principal='oryx/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:35858
I20260809 20:12:01.902747 28497 tablet_replica.cc:330] T 07584785e6b943bc8e83de1bb8159525 P e096433beba5480db2fb141954e88ed6: stopping tablet replica
I20260809 20:12:01.902832 28498 raft_consensus.cc:2229] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6 [term 1 LEADER]: Raft consensus shutting down.
I20260809 20:12:01.902920 28497 raft_consensus.cc:2229] T 07584785e6b943bc8e83de1bb8159525 P e096433beba5480db2fb141954e88ed6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:12:01.903090 28497 raft_consensus.cc:2258] T 07584785e6b943bc8e83de1bb8159525 P e096433beba5480db2fb141954e88ed6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:12:01.903272 28498 raft_consensus.cc:2258] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:12:01.903360 28496 tablet_replica.cc:330] T 07584785e6b943bc8e83de1bb8159525 P 8fc7adedd38a480dba8ceb9b947ea2a9: stopping tablet replica
I20260809 20:12:01.903533 28496 raft_consensus.cc:2229] T 07584785e6b943bc8e83de1bb8159525 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:12:01.903697 28496 raft_consensus.cc:2258] T 07584785e6b943bc8e83de1bb8159525 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:12:01.904934 28496 ts_tablet_manager.cc:1905] T 07584785e6b943bc8e83de1bb8159525 P 8fc7adedd38a480dba8ceb9b947ea2a9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:12:01.905140 28497 ts_tablet_manager.cc:1905] T 07584785e6b943bc8e83de1bb8159525 P e096433beba5480db2fb141954e88ed6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:12:01.911159 28497 ts_tablet_manager.cc:1918] T 07584785e6b943bc8e83de1bb8159525 P e096433beba5480db2fb141954e88ed6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 20:12:01.911259 28498 ts_tablet_manager.cc:1905] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:12:01.911495 28497 log.cc:1196] T 07584785e6b943bc8e83de1bb8159525 P e096433beba5480db2fb141954e88ed6: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-0/wal/wals/07584785e6b943bc8e83de1bb8159525
I20260809 20:12:01.911868 28497 ts_tablet_manager.cc:1939] T 07584785e6b943bc8e83de1bb8159525 P e096433beba5480db2fb141954e88ed6: Deleting consensus metadata
I20260809 20:12:01.912817 27588 catalog_manager.cc:4841] TS e096433beba5480db2fb141954e88ed6 (127.14.181.1:45253): tablet 07584785e6b943bc8e83de1bb8159525 (table test-table [id=7f4d4173ec2d45c0a2cf891552299653]) successfully deleted
I20260809 20:12:01.918193 28498 ts_tablet_manager.cc:1918] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 20:12:01.919692 28496 ts_tablet_manager.cc:1918] T 07584785e6b943bc8e83de1bb8159525 P 8fc7adedd38a480dba8ceb9b947ea2a9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 20:12:01.919914 28498 log.cc:1196] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-1/wal/wals/07584785e6b943bc8e83de1bb8159525
I20260809 20:12:01.920398 28498 ts_tablet_manager.cc:1939] T 07584785e6b943bc8e83de1bb8159525 P 922e7d39b9a24541968e2df2043849d6: Deleting consensus metadata
I20260809 20:12:01.920579 28496 log.cc:1196] T 07584785e6b943bc8e83de1bb8159525 P 8fc7adedd38a480dba8ceb9b947ea2a9: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-2/wal/wals/07584785e6b943bc8e83de1bb8159525
I20260809 20:12:01.921716 27587 catalog_manager.cc:4841] TS 922e7d39b9a24541968e2df2043849d6 (127.14.181.2:40463): tablet 07584785e6b943bc8e83de1bb8159525 (table test-table [id=7f4d4173ec2d45c0a2cf891552299653]) successfully deleted
I20260809 20:12:01.922307 28496 ts_tablet_manager.cc:1939] T 07584785e6b943bc8e83de1bb8159525 P 8fc7adedd38a480dba8ceb9b947ea2a9: Deleting consensus metadata
I20260809 20:12:01.923381 27587 catalog_manager.cc:4841] TS 8fc7adedd38a480dba8ceb9b947ea2a9 (127.14.181.3:44669): tablet 07584785e6b943bc8e83de1bb8159525 (table test-table [id=7f4d4173ec2d45c0a2cf891552299653]) successfully deleted
Aug 09 20:12:01 dist-test-slave-6zbq krb5kdc[27548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 20:12:01 dist-test-slave-6zbq krb5kdc[27548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:01 dist-test-slave-6zbq krb5kdc[27548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
W20260809 20:12:01.964988 28527 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:01.954334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52050 (local address 127.14.181.62:39675)
0809 20:12:01.954539 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:01.954545 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:01.954898 (+ 353us) server_negotiation.cc:407] Connection header received
0809 20:12:01.955043 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:01.955048 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:01.955157 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:01.955271 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:01.956460 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.957583 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.958837 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.959490 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.959616 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:01.964751 (+ 5135us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52050: BlockingRecv error: recv got EOF from 127.0.0.1:52050 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 09 20:12:01 dist-test-slave-6zbq krb5kdc[27548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM
I20260809 20:12:01.981242 28527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:01.967332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52054 (local address 127.14.181.62:39675)
0809 20:12:01.967498 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:01.967503 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:01.967753 (+ 250us) server_negotiation.cc:407] Connection header received
0809 20:12:01.967891 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:01.967895 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:01.967949 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:01.968022 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:01.969349 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.969984 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.971747 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:01.972204 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:01.972302 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:01.976326 (+ 4024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:01.976332 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:01.976335 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:12:01.976365 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:01.978843 (+ 2478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:01.979417 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:01.979422 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:01.979424 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:01.979552 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:01.979910 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:01.979914 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:01.979916 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:01.980175 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:01.980427 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:01.980713 (+ 286us) server_negotiation.cc:299] Negotiation successful
0809 20:12:01.980943 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 20:12:01.984616 27610 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52054:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 20:12:01.985273 27610 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 20:12:01.991632 27846 tablet_service.cc:1467] Processing CreateTablet for tablet 8a61d6857cc6465d97800e545f374589 (DEFAULT_TABLE table=test-table [id=74ddae01c3034cc88c817d4a9948e923]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:12:01.992079 27846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a61d6857cc6465d97800e545f374589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:12:01.992367 28306 tablet_service.cc:1467] Processing CreateTablet for tablet 8a61d6857cc6465d97800e545f374589 (DEFAULT_TABLE table=test-table [id=74ddae01c3034cc88c817d4a9948e923]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:12:01.992738 28306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a61d6857cc6465d97800e545f374589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:12:01.997159 28075 tablet_service.cc:1467] Processing CreateTablet for tablet 8a61d6857cc6465d97800e545f374589 (DEFAULT_TABLE table=test-table [id=74ddae01c3034cc88c817d4a9948e923]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:12:01.997673 28075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a61d6857cc6465d97800e545f374589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:12:01.998050 28458 tablet_bootstrap.cc:492] T 8a61d6857cc6465d97800e545f374589 P 8fc7adedd38a480dba8ceb9b947ea2a9: Bootstrap starting.
I20260809 20:12:01.998127 28454 tablet_bootstrap.cc:492] T 8a61d6857cc6465d97800e545f374589 P e096433beba5480db2fb141954e88ed6: Bootstrap starting.
I20260809 20:12:01.999606 28454 tablet_bootstrap.cc:654] T 8a61d6857cc6465d97800e545f374589 P e096433beba5480db2fb141954e88ed6: Neither blocks nor log segments found. Creating new log.
I20260809 20:12:01.999614 28458 tablet_bootstrap.cc:654] T 8a61d6857cc6465d97800e545f374589 P 8fc7adedd38a480dba8ceb9b947ea2a9: Neither blocks nor log segments found. Creating new log.
I20260809 20:12:02.005692 28455 tablet_bootstrap.cc:492] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6: Bootstrap starting.
I20260809 20:12:02.006996 28458 tablet_bootstrap.cc:492] T 8a61d6857cc6465d97800e545f374589 P 8fc7adedd38a480dba8ceb9b947ea2a9: No bootstrap required, opened a new log
I20260809 20:12:02.007197 28458 ts_tablet_manager.cc:1397] T 8a61d6857cc6465d97800e545f374589 P 8fc7adedd38a480dba8ceb9b947ea2a9: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260809 20:12:02.007346 28455 tablet_bootstrap.cc:654] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6: Neither blocks nor log segments found. Creating new log.
I20260809 20:12:02.008046 28458 raft_consensus.cc:348] T 8a61d6857cc6465d97800e545f374589 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:02.008452 28458 raft_consensus.cc:374] T 8a61d6857cc6465d97800e545f374589 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:12:02.008595 28458 raft_consensus.cc:729] T 8a61d6857cc6465d97800e545f374589 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fc7adedd38a480dba8ceb9b947ea2a9, State: Initialized, Role: FOLLOWER
I20260809 20:12:02.008901 28458 consensus_queue.cc:260] T 8a61d6857cc6465d97800e545f374589 P 8fc7adedd38a480dba8ceb9b947ea2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:02.010247 28454 tablet_bootstrap.cc:492] T 8a61d6857cc6465d97800e545f374589 P e096433beba5480db2fb141954e88ed6: No bootstrap required, opened a new log
I20260809 20:12:02.010409 28454 ts_tablet_manager.cc:1397] T 8a61d6857cc6465d97800e545f374589 P e096433beba5480db2fb141954e88ed6: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.007s
I20260809 20:12:02.011142 28454 raft_consensus.cc:348] T 8a61d6857cc6465d97800e545f374589 P e096433beba5480db2fb141954e88ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:02.011399 28454 raft_consensus.cc:374] T 8a61d6857cc6465d97800e545f374589 P e096433beba5480db2fb141954e88ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:12:02.011482 28454 raft_consensus.cc:729] T 8a61d6857cc6465d97800e545f374589 P e096433beba5480db2fb141954e88ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e096433beba5480db2fb141954e88ed6, State: Initialized, Role: FOLLOWER
I20260809 20:12:02.011693 28454 consensus_queue.cc:260] T 8a61d6857cc6465d97800e545f374589 P e096433beba5480db2fb141954e88ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:02.012243 28454 ts_tablet_manager.cc:1428] T 8a61d6857cc6465d97800e545f374589 P e096433beba5480db2fb141954e88ed6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260809 20:12:02.013816 28458 ts_tablet_manager.cc:1428] T 8a61d6857cc6465d97800e545f374589 P 8fc7adedd38a480dba8ceb9b947ea2a9: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260809 20:12:02.019667 28455 tablet_bootstrap.cc:492] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6: No bootstrap required, opened a new log
I20260809 20:12:02.019793 28455 ts_tablet_manager.cc:1397] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6: Time spent bootstrapping tablet: real 0.014s user 0.012s sys 0.000s
I20260809 20:12:02.020390 28455 raft_consensus.cc:348] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:02.020591 28455 raft_consensus.cc:374] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:12:02.020695 28455 raft_consensus.cc:729] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922e7d39b9a24541968e2df2043849d6, State: Initialized, Role: FOLLOWER
I20260809 20:12:02.020906 28455 consensus_queue.cc:260] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:02.021378 28455 ts_tablet_manager.cc:1428] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 20:12:02.036336 28550 raft_consensus.cc:482] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:12:02.036514 28550 raft_consensus.cc:504] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:02.037238 28550 leader_election.cc:288] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e096433beba5480db2fb141954e88ed6 (127.14.181.1:45253), 8fc7adedd38a480dba8ceb9b947ea2a9 (127.14.181.3:44669)
I20260809 20:12:02.037629 28340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a61d6857cc6465d97800e545f374589" candidate_uuid: "922e7d39b9a24541968e2df2043849d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" is_pre_election: true
I20260809 20:12:02.037659 27882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a61d6857cc6465d97800e545f374589" candidate_uuid: "922e7d39b9a24541968e2df2043849d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e096433beba5480db2fb141954e88ed6" is_pre_election: true
I20260809 20:12:02.037839 28340 raft_consensus.cc:2454] T 8a61d6857cc6465d97800e545f374589 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 922e7d39b9a24541968e2df2043849d6 in term 0.
I20260809 20:12:02.037911 27882 raft_consensus.cc:2454] T 8a61d6857cc6465d97800e545f374589 P e096433beba5480db2fb141954e88ed6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 922e7d39b9a24541968e2df2043849d6 in term 0.
I20260809 20:12:02.038187 27991 leader_election.cc:302] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fc7adedd38a480dba8ceb9b947ea2a9, 922e7d39b9a24541968e2df2043849d6; no voters:
I20260809 20:12:02.038558 28550 raft_consensus.cc:2781] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:12:02.038679 28550 raft_consensus.cc:482] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:12:02.038797 28550 raft_consensus.cc:3037] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:12:02.041805 28550 raft_consensus.cc:504] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:02.042472 28550 leader_election.cc:288] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6 [CANDIDATE]: Term 1 election: Requested vote from peers e096433beba5480db2fb141954e88ed6 (127.14.181.1:45253), 8fc7adedd38a480dba8ceb9b947ea2a9 (127.14.181.3:44669)
I20260809 20:12:02.042831 27882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a61d6857cc6465d97800e545f374589" candidate_uuid: "922e7d39b9a24541968e2df2043849d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e096433beba5480db2fb141954e88ed6"
I20260809 20:12:02.042881 28340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a61d6857cc6465d97800e545f374589" candidate_uuid: "922e7d39b9a24541968e2df2043849d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9"
I20260809 20:12:02.043021 27882 raft_consensus.cc:3037] T 8a61d6857cc6465d97800e545f374589 P e096433beba5480db2fb141954e88ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:12:02.043054 28340 raft_consensus.cc:3037] T 8a61d6857cc6465d97800e545f374589 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:12:02.044883 28340 raft_consensus.cc:2454] T 8a61d6857cc6465d97800e545f374589 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922e7d39b9a24541968e2df2043849d6 in term 1.
I20260809 20:12:02.045265 27991 leader_election.cc:302] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fc7adedd38a480dba8ceb9b947ea2a9, 922e7d39b9a24541968e2df2043849d6; no voters:
I20260809 20:12:02.045504 28550 raft_consensus.cc:2781] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:12:02.045658 28550 raft_consensus.cc:686] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6 [term 1 LEADER]: Becoming Leader. State: Replica: 922e7d39b9a24541968e2df2043849d6, State: Running, Role: LEADER
I20260809 20:12:02.045825 27882 raft_consensus.cc:2454] T 8a61d6857cc6465d97800e545f374589 P e096433beba5480db2fb141954e88ed6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922e7d39b9a24541968e2df2043849d6 in term 1.
I20260809 20:12:02.046101 28550 consensus_queue.cc:237] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:02.048504 27604 catalog_manager.cc:5495] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 922e7d39b9a24541968e2df2043849d6 (127.14.181.2). New cstate: current_term: 1 leader_uuid: "922e7d39b9a24541968e2df2043849d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } health_report { overall_health: UNKNOWN } } }
I20260809 20:12:02.071959 28452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:02.067122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59654 (local address 127.14.181.2:40463)
0809 20:12:02.067292 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:02.067298 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:02.067477 (+ 179us) server_negotiation.cc:407] Connection header received
0809 20:12:02.067674 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:02.067678 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:02.067740 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:02.067820 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:12:02.068180 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:02.068952 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:02.070246 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:02.070730 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:02.070850 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:02.071256 (+ 406us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:12:02.071379 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:12:02.071450 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:02.071606 (+ 156us) server_negotiation.cc:299] Negotiation successful
0809 20:12:02.071680 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 20:12:02.074572 28340 raft_consensus.cc:1261] T 8a61d6857cc6465d97800e545f374589 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 1 FOLLOWER]: Refusing update from remote peer 922e7d39b9a24541968e2df2043849d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:12:02.074590 27882 raft_consensus.cc:1261] T 8a61d6857cc6465d97800e545f374589 P e096433beba5480db2fb141954e88ed6 [term 1 FOLLOWER]: Refusing update from remote peer 922e7d39b9a24541968e2df2043849d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:12:02.075138 28507 consensus_queue.cc:1035] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:12:02.075384 28550 consensus_queue.cc:1035] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:12:02.086303 27604 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52054:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:12:02.086555 27604 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52054:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:12:02.089303 27604 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d7d1eb29af3948a1bf21c7d36b407a84: Sending DeleteTablet for 3 replicas of tablet 8a61d6857cc6465d97800e545f374589
I20260809 20:12:02.089932 27846 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a61d6857cc6465d97800e545f374589 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:12:02 UTC) from {username='oryx', principal='oryx/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:53126
I20260809 20:12:02.090216 28497 tablet_replica.cc:330] T 8a61d6857cc6465d97800e545f374589 P e096433beba5480db2fb141954e88ed6: stopping tablet replica
I20260809 20:12:02.090194 28306 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a61d6857cc6465d97800e545f374589 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:12:02 UTC) from {username='oryx', principal='oryx/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:35858
I20260809 20:12:02.090497 28496 tablet_replica.cc:330] T 8a61d6857cc6465d97800e545f374589 P 8fc7adedd38a480dba8ceb9b947ea2a9: stopping tablet replica
I20260809 20:12:02.090672 28496 raft_consensus.cc:2229] T 8a61d6857cc6465d97800e545f374589 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:12:02.090890 28496 raft_consensus.cc:2258] T 8a61d6857cc6465d97800e545f374589 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:12:02.091122 27604 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52054:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 20:12:02.091490 28075 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a61d6857cc6465d97800e545f374589 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:12:02 UTC) from {username='oryx', principal='oryx/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:59628
I20260809 20:12:02.091738 28498 tablet_replica.cc:330] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6: stopping tablet replica
I20260809 20:12:02.091909 28498 raft_consensus.cc:2229] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6 [term 1 LEADER]: Raft consensus shutting down.
I20260809 20:12:02.092029 28496 ts_tablet_manager.cc:1905] T 8a61d6857cc6465d97800e545f374589 P 8fc7adedd38a480dba8ceb9b947ea2a9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:12:02.092185 28498 raft_consensus.cc:2258] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260809 20:12:02.092571 27604 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 20:12:02.093860 28498 ts_tablet_manager.cc:1905] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:12:02.098611 28496 ts_tablet_manager.cc:1918] T 8a61d6857cc6465d97800e545f374589 P 8fc7adedd38a480dba8ceb9b947ea2a9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:12:02.098743 28496 log.cc:1196] T 8a61d6857cc6465d97800e545f374589 P 8fc7adedd38a480dba8ceb9b947ea2a9: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-2/wal/wals/8a61d6857cc6465d97800e545f374589
I20260809 20:12:02.099268 28496 ts_tablet_manager.cc:1939] T 8a61d6857cc6465d97800e545f374589 P 8fc7adedd38a480dba8ceb9b947ea2a9: Deleting consensus metadata
I20260809 20:12:02.099889 28498 ts_tablet_manager.cc:1918] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:12:02.100059 28498 log.cc:1196] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-1/wal/wals/8a61d6857cc6465d97800e545f374589
I20260809 20:12:02.100512 28498 ts_tablet_manager.cc:1939] T 8a61d6857cc6465d97800e545f374589 P 922e7d39b9a24541968e2df2043849d6: Deleting consensus metadata
I20260809 20:12:02.100764 28497 raft_consensus.cc:2229] T 8a61d6857cc6465d97800e545f374589 P e096433beba5480db2fb141954e88ed6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:12:02.101467 28497 pending_rounds.cc:62] T 8a61d6857cc6465d97800e545f374589 P e096433beba5480db2fb141954e88ed6: Trying to abort 2 pending ops.
I20260809 20:12:02.101536 27587 catalog_manager.cc:4841] TS 922e7d39b9a24541968e2df2043849d6 (127.14.181.2:40463): tablet 8a61d6857cc6465d97800e545f374589 (table test-table [id=74ddae01c3034cc88c817d4a9948e923]) successfully deleted
I20260809 20:12:02.101629 28497 pending_rounds.cc:68] T 8a61d6857cc6465d97800e545f374589 P e096433beba5480db2fb141954e88ed6: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7316710695211847680 op_type: WRITE_OP write_request { tablet_id: "8a61d6857cc6465d97800e545f374589" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "val" type: INT32 is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\003\00090\000\0001\324\000\000" indirect_data: "<redacted>""" } external_consistency_mode: CLIENT_PROPAGATED authz_token { token_data: "\010\276\300\343\323\006\"8\n\ntest-admin\022*\n 74ddae01c3034cc88c817d4a9948e923\020\001\030\001 \001(\001" signature: "<redacted>""\230a\303d\363\243\251]\234\327\217\306o\242\331>\230\303W\377\"\232~@\231\367\351\322\375lEj;\371\262\264\321B\014v\325g\326\257\254\366[o\304=\204@\375\222\322\337\036\256$\213An\361H" signing_key_seq_num: 0 } } request_id { client_id: "29cd997395664401963bb54970b6908a" seq_no: 0 first_incomplete_seq_no: 0 attempt_no: 0 }
I20260809 20:12:02.102167 28497 pending_rounds.cc:68] T 8a61d6857cc6465d97800e545f374589 P e096433beba5480db2fb141954e88ed6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316710695103143936 op_type: NO_OP noop_request { }
I20260809 20:12:02.102272 28497 raft_consensus.cc:2866] T 8a61d6857cc6465d97800e545f374589 P e096433beba5480db2fb141954e88ed6 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260809 20:12:02.102411 28497 raft_consensus.cc:2258] T 8a61d6857cc6465d97800e545f374589 P e096433beba5480db2fb141954e88ed6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:12:02.103386 28497 ts_tablet_manager.cc:1905] T 8a61d6857cc6465d97800e545f374589 P e096433beba5480db2fb141954e88ed6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:12:02.103412 27587 catalog_manager.cc:4841] TS 8fc7adedd38a480dba8ceb9b947ea2a9 (127.14.181.3:44669): tablet 8a61d6857cc6465d97800e545f374589 (table test-table [id=74ddae01c3034cc88c817d4a9948e923]) successfully deleted
I20260809 20:12:02.106125 27846 tablet_service.cc:1467] Processing CreateTablet for tablet 1c1a6216fa5d431786b3545717a56342 (DEFAULT_TABLE table=test-table [id=11c97a73261444a8ba2aae0298f16d5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:12:02.106526 27846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c1a6216fa5d431786b3545717a56342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:12:02.106659 28075 tablet_service.cc:1467] Processing CreateTablet for tablet 1c1a6216fa5d431786b3545717a56342 (DEFAULT_TABLE table=test-table [id=11c97a73261444a8ba2aae0298f16d5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:12:02.107084 28075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c1a6216fa5d431786b3545717a56342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:12:02.109474 28497 ts_tablet_manager.cc:1918] T 8a61d6857cc6465d97800e545f374589 P e096433beba5480db2fb141954e88ed6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:12:02.109586 28497 log.cc:1196] T 8a61d6857cc6465d97800e545f374589 P e096433beba5480db2fb141954e88ed6: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-0/wal/wals/8a61d6857cc6465d97800e545f374589
I20260809 20:12:02.109978 28497 ts_tablet_manager.cc:1939] T 8a61d6857cc6465d97800e545f374589 P e096433beba5480db2fb141954e88ed6: Deleting consensus metadata
I20260809 20:12:02.111104 27588 catalog_manager.cc:4841] TS e096433beba5480db2fb141954e88ed6 (127.14.181.1:45253): tablet 8a61d6857cc6465d97800e545f374589 (table test-table [id=74ddae01c3034cc88c817d4a9948e923]) successfully deleted
I20260809 20:12:02.112566 28454 tablet_bootstrap.cc:492] T 1c1a6216fa5d431786b3545717a56342 P e096433beba5480db2fb141954e88ed6: Bootstrap starting.
I20260809 20:12:02.113312 28455 tablet_bootstrap.cc:492] T 1c1a6216fa5d431786b3545717a56342 P 922e7d39b9a24541968e2df2043849d6: Bootstrap starting.
I20260809 20:12:02.113843 28306 tablet_service.cc:1467] Processing CreateTablet for tablet 1c1a6216fa5d431786b3545717a56342 (DEFAULT_TABLE table=test-table [id=11c97a73261444a8ba2aae0298f16d5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:12:02.113958 28454 tablet_bootstrap.cc:654] T 1c1a6216fa5d431786b3545717a56342 P e096433beba5480db2fb141954e88ed6: Neither blocks nor log segments found. Creating new log.
I20260809 20:12:02.114236 28306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c1a6216fa5d431786b3545717a56342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:12:02.114940 28455 tablet_bootstrap.cc:654] T 1c1a6216fa5d431786b3545717a56342 P 922e7d39b9a24541968e2df2043849d6: Neither blocks nor log segments found. Creating new log.
I20260809 20:12:02.120985 28458 tablet_bootstrap.cc:492] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9: Bootstrap starting.
I20260809 20:12:02.122562 28458 tablet_bootstrap.cc:654] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9: Neither blocks nor log segments found. Creating new log.
I20260809 20:12:02.125296 28458 tablet_bootstrap.cc:492] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9: No bootstrap required, opened a new log
I20260809 20:12:02.125458 28458 ts_tablet_manager.cc:1397] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.002s
I20260809 20:12:02.126168 28458 raft_consensus.cc:348] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:02.126453 28458 raft_consensus.cc:374] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:12:02.126539 28458 raft_consensus.cc:729] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fc7adedd38a480dba8ceb9b947ea2a9, State: Initialized, Role: FOLLOWER
I20260809 20:12:02.126770 28458 consensus_queue.cc:260] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:02.127308 28458 ts_tablet_manager.cc:1428] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260809 20:12:02.131512 28455 tablet_bootstrap.cc:492] T 1c1a6216fa5d431786b3545717a56342 P 922e7d39b9a24541968e2df2043849d6: No bootstrap required, opened a new log
I20260809 20:12:02.131682 28455 ts_tablet_manager.cc:1397] T 1c1a6216fa5d431786b3545717a56342 P 922e7d39b9a24541968e2df2043849d6: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.007s
I20260809 20:12:02.131731 28454 tablet_bootstrap.cc:492] T 1c1a6216fa5d431786b3545717a56342 P e096433beba5480db2fb141954e88ed6: No bootstrap required, opened a new log
I20260809 20:12:02.131883 28454 ts_tablet_manager.cc:1397] T 1c1a6216fa5d431786b3545717a56342 P e096433beba5480db2fb141954e88ed6: Time spent bootstrapping tablet: real 0.019s user 0.008s sys 0.004s
I20260809 20:12:02.132499 28454 raft_consensus.cc:348] T 1c1a6216fa5d431786b3545717a56342 P e096433beba5480db2fb141954e88ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:02.132488 28455 raft_consensus.cc:348] T 1c1a6216fa5d431786b3545717a56342 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:02.132726 28454 raft_consensus.cc:374] T 1c1a6216fa5d431786b3545717a56342 P e096433beba5480db2fb141954e88ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:12:02.132772 28455 raft_consensus.cc:374] T 1c1a6216fa5d431786b3545717a56342 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:12:02.132807 28454 raft_consensus.cc:729] T 1c1a6216fa5d431786b3545717a56342 P e096433beba5480db2fb141954e88ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e096433beba5480db2fb141954e88ed6, State: Initialized, Role: FOLLOWER
I20260809 20:12:02.132874 28455 raft_consensus.cc:729] T 1c1a6216fa5d431786b3545717a56342 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922e7d39b9a24541968e2df2043849d6, State: Initialized, Role: FOLLOWER
I20260809 20:12:02.133031 28454 consensus_queue.cc:260] T 1c1a6216fa5d431786b3545717a56342 P e096433beba5480db2fb141954e88ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:02.133138 28455 consensus_queue.cc:260] T 1c1a6216fa5d431786b3545717a56342 P 922e7d39b9a24541968e2df2043849d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:02.133648 28454 ts_tablet_manager.cc:1428] T 1c1a6216fa5d431786b3545717a56342 P e096433beba5480db2fb141954e88ed6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260809 20:12:02.134848 28455 ts_tablet_manager.cc:1428] T 1c1a6216fa5d431786b3545717a56342 P 922e7d39b9a24541968e2df2043849d6: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260809 20:12:02.170848 28465 raft_consensus.cc:482] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:12:02.171060 28465 raft_consensus.cc:504] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:02.172379 28465 leader_election.cc:288] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e096433beba5480db2fb141954e88ed6 (127.14.181.1:45253), 922e7d39b9a24541968e2df2043849d6 (127.14.181.2:40463)
I20260809 20:12:02.180298 28452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:02.172741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:32795 (local address 127.14.181.2:40463)
0809 20:12:02.172946 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:02.172953 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:02.173734 (+ 781us) server_negotiation.cc:407] Connection header received
0809 20:12:02.173979 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:02.173985 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:02.174066 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:02.174134 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:12:02.175039 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:02.176172 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:02.178069 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:02.179273 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:02.179450 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:02.179527 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:02.179835 (+ 308us) server_negotiation.cc:299] Negotiation successful
0809 20:12:02.179977 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 20:12:02.180503 28594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:02.172924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:33009 (local address 127.14.181.1:45253)
0809 20:12:02.174194 (+ 1270us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:02.174199 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:02.174215 (+ 16us) server_negotiation.cc:407] Connection header received
0809 20:12:02.174277 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:02.174282 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:02.174375 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:02.175053 (+ 678us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:12:02.175243 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:02.175987 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:02.178451 (+ 2464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:02.179585 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:02.179724 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:02.179792 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:02.180075 (+ 283us) server_negotiation.cc:299] Negotiation successful
0809 20:12:02.180203 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1150,"thread_start_us":1005,"threads_started":1}
I20260809 20:12:02.180877 28593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:02.172581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:45253 (local address 127.14.181.3:33009)
0809 20:12:02.173401 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:02.173421 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:02.173556 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:02.174513 (+ 957us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:02.174517 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:02.174563 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:12:02.174959 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:02.174971 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:02.176109 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:02.176115 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:02.178285 (+ 2170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:02.178302 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:02.179801 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:02.179807 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:02.179938 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:02.179961 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 20:12:02.180039 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 20:12:02.180160 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":688,"mutex_wait_us":8,"spinlock_wait_cycles":1280,"thread_start_us":821,"threads_started":1}
I20260809 20:12:02.181110 28592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:02.172670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:40463 (local address 127.14.181.3:32795)
0809 20:12:02.173640 (+ 970us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:02.173656 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:02.173828 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:02.174386 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:02.174391 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:02.174428 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:12:02.174812 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:02.174825 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:02.176303 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:02.176308 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:02.177911 (+ 1603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:02.177925 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:02.179451 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:02.179458 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:02.179632 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:02.179669 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 20:12:02.180552 (+ 883us) client_negotiation.cc:240] Negotiation successful
0809 20:12:02.180687 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":873,"mutex_wait_us":48,"thread_start_us":450,"threads_started":1}
I20260809 20:12:02.181591 27882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c1a6216fa5d431786b3545717a56342" candidate_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e096433beba5480db2fb141954e88ed6" is_pre_election: true
I20260809 20:12:02.181690 28116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c1a6216fa5d431786b3545717a56342" candidate_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922e7d39b9a24541968e2df2043849d6" is_pre_election: true
I20260809 20:12:02.181810 27882 raft_consensus.cc:2454] T 1c1a6216fa5d431786b3545717a56342 P e096433beba5480db2fb141954e88ed6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fc7adedd38a480dba8ceb9b947ea2a9 in term 0.
I20260809 20:12:02.181931 28116 raft_consensus.cc:2454] T 1c1a6216fa5d431786b3545717a56342 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fc7adedd38a480dba8ceb9b947ea2a9 in term 0.
I20260809 20:12:02.182245 28235 leader_election.cc:302] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fc7adedd38a480dba8ceb9b947ea2a9, e096433beba5480db2fb141954e88ed6; no voters:
I20260809 20:12:02.182658 28465 raft_consensus.cc:2781] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:12:02.182787 28465 raft_consensus.cc:482] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:12:02.182883 28465 raft_consensus.cc:3037] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:12:02.184882 28465 raft_consensus.cc:504] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:02.185432 28465 leader_election.cc:288] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9 [CANDIDATE]: Term 1 election: Requested vote from peers e096433beba5480db2fb141954e88ed6 (127.14.181.1:45253), 922e7d39b9a24541968e2df2043849d6 (127.14.181.2:40463)
I20260809 20:12:02.185992 27882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c1a6216fa5d431786b3545717a56342" candidate_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e096433beba5480db2fb141954e88ed6"
I20260809 20:12:02.186044 28116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c1a6216fa5d431786b3545717a56342" candidate_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "922e7d39b9a24541968e2df2043849d6"
I20260809 20:12:02.186161 27882 raft_consensus.cc:3037] T 1c1a6216fa5d431786b3545717a56342 P e096433beba5480db2fb141954e88ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:12:02.186262 28116 raft_consensus.cc:3037] T 1c1a6216fa5d431786b3545717a56342 P 922e7d39b9a24541968e2df2043849d6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:12:02.188529 27882 raft_consensus.cc:2454] T 1c1a6216fa5d431786b3545717a56342 P e096433beba5480db2fb141954e88ed6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fc7adedd38a480dba8ceb9b947ea2a9 in term 1.
I20260809 20:12:02.188869 28235 leader_election.cc:302] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fc7adedd38a480dba8ceb9b947ea2a9, e096433beba5480db2fb141954e88ed6; no voters:
I20260809 20:12:02.189118 28465 raft_consensus.cc:2781] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:12:02.189193 28116 raft_consensus.cc:2454] T 1c1a6216fa5d431786b3545717a56342 P 922e7d39b9a24541968e2df2043849d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fc7adedd38a480dba8ceb9b947ea2a9 in term 1.
I20260809 20:12:02.190572 28465 raft_consensus.cc:686] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 1 LEADER]: Becoming Leader. State: Replica: 8fc7adedd38a480dba8ceb9b947ea2a9, State: Running, Role: LEADER
I20260809 20:12:02.190966 28465 consensus_queue.cc:237] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } }
I20260809 20:12:02.194193 27604 catalog_manager.cc:5495] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fc7adedd38a480dba8ceb9b947ea2a9 (127.14.181.3). New cstate: current_term: 1 leader_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fc7adedd38a480dba8ceb9b947ea2a9" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44669 } health_report { overall_health: HEALTHY } } }
I20260809 20:12:02.219535 28600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:02.214037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35874 (local address 127.14.181.3:44669)
0809 20:12:02.214568 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:02.214572 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:02.214588 (+ 16us) server_negotiation.cc:407] Connection header received
0809 20:12:02.214656 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:02.214659 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:02.214742 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:02.214875 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:12:02.215308 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:02.216067 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:02.217369 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:02.217794 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:02.217902 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:02.218363 (+ 461us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:12:02.218927 (+ 564us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:12:02.219054 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:02.219148 (+ 94us) server_negotiation.cc:299] Negotiation successful
0809 20:12:02.219223 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":299,"threads_started":1}
I20260809 20:12:02.234088 28452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:02.228802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:46027 (local address 127.14.181.2:40463)
0809 20:12:02.228957 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:02.228962 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:02.229421 (+ 459us) server_negotiation.cc:407] Connection header received
0809 20:12:02.229576 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:02.229584 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:02.229649 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:02.229731 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:12:02.230188 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:02.230938 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:02.232292 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:02.232886 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:02.233005 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:02.233446 (+ 441us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:12:02.233539 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:12:02.233617 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:02.233753 (+ 136us) server_negotiation.cc:299] Negotiation successful
0809 20:12:02.233826 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 20:12:02.234308 28606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:02.228743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:40463 (local address 127.14.181.3:46027)
0809 20:12:02.229327 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:02.229341 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:02.229464 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:02.229758 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:02.229762 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:02.229774 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 20:12:02.230044 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:02.230052 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:02.231070 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:02.231074 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:02.232156 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:02.232168 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:02.233064 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:02.233071 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:02.233201 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:02.233275 (+ 74us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 20:12:02.233633 (+ 358us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 20:12:02.233644 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 20:12:02.233709 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 20:12:02.233840 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":306,"threads_started":1}
I20260809 20:12:02.242249 28116 raft_consensus.cc:1261] T 1c1a6216fa5d431786b3545717a56342 P 922e7d39b9a24541968e2df2043849d6 [term 1 FOLLOWER]: Refusing update from remote peer 8fc7adedd38a480dba8ceb9b947ea2a9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:12:02.242714 27882 raft_consensus.cc:1261] T 1c1a6216fa5d431786b3545717a56342 P e096433beba5480db2fb141954e88ed6 [term 1 FOLLOWER]: Refusing update from remote peer 8fc7adedd38a480dba8ceb9b947ea2a9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:12:02.242863 28595 consensus_queue.cc:1035] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "922e7d39b9a24541968e2df2043849d6" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 40463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:12:02.243328 28465 consensus_queue.cc:1035] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e096433beba5480db2fb141954e88ed6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:12:02.268908 28549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:02.262647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:44669 (local address 127.14.181.2:47981)
0809 20:12:02.262825 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:02.262843 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:02.262944 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:02.263823 (+ 879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:02.263829 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:02.263842 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 20:12:02.264052 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:02.264063 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:02.265782 (+ 1719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:02.265786 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:02.267245 (+ 1459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:02.267259 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:02.267914 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:02.267920 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:02.268078 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:02.268129 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 20:12:02.268526 (+ 397us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 20:12:02.268534 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 20:12:02.268598 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 20:12:02.268701 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 20:12:02.268989 28600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:02.263202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:47981 (local address 127.14.181.3:44669)
0809 20:12:02.263370 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:02.263375 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:02.263391 (+ 16us) server_negotiation.cc:407] Connection header received
0809 20:12:02.263604 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:02.263610 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:02.263683 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:02.264207 (+ 524us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:12:02.264400 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:02.265646 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:02.267363 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:02.267771 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:02.267875 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:02.268304 (+ 429us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:12:02.268428 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:12:02.268517 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:02.268635 (+ 118us) server_negotiation.cc:299] Negotiation successful
0809 20:12:02.268708 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 20:12:02.298058 27604 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52054:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:12:02.298308 27604 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52054:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:12:02.301569 27604 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d7d1eb29af3948a1bf21c7d36b407a84: Sending DeleteTablet for 3 replicas of tablet 1c1a6216fa5d431786b3545717a56342
I20260809 20:12:02.302623 28306 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c1a6216fa5d431786b3545717a56342 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:12:02 UTC) from {username='oryx', principal='oryx/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:35858
I20260809 20:12:02.302922 28496 tablet_replica.cc:330] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9: stopping tablet replica
I20260809 20:12:02.303128 28496 raft_consensus.cc:2229] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 1 LEADER]: Raft consensus shutting down.
I20260809 20:12:02.303580 28496 raft_consensus.cc:2258] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:12:02.304251 27846 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c1a6216fa5d431786b3545717a56342 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:12:02 UTC) from {username='oryx', principal='oryx/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:53126
I20260809 20:12:02.304499 28497 tablet_replica.cc:330] T 1c1a6216fa5d431786b3545717a56342 P e096433beba5480db2fb141954e88ed6: stopping tablet replica
I20260809 20:12:02.304673 28497 raft_consensus.cc:2229] T 1c1a6216fa5d431786b3545717a56342 P e096433beba5480db2fb141954e88ed6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:12:02.304744 28496 ts_tablet_manager.cc:1905] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:12:02.304844 28497 raft_consensus.cc:2258] T 1c1a6216fa5d431786b3545717a56342 P e096433beba5480db2fb141954e88ed6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:12:02.306207 28497 ts_tablet_manager.cc:1905] T 1c1a6216fa5d431786b3545717a56342 P e096433beba5480db2fb141954e88ed6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:12:02.310930 28075 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c1a6216fa5d431786b3545717a56342 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:12:02 UTC) from {username='oryx', principal='oryx/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:59628
I20260809 20:12:02.311220 28498 tablet_replica.cc:330] T 1c1a6216fa5d431786b3545717a56342 P 922e7d39b9a24541968e2df2043849d6: stopping tablet replica
I20260809 20:12:02.311421 28498 raft_consensus.cc:2229] T 1c1a6216fa5d431786b3545717a56342 P 922e7d39b9a24541968e2df2043849d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:12:02.311602 28498 raft_consensus.cc:2258] T 1c1a6216fa5d431786b3545717a56342 P 922e7d39b9a24541968e2df2043849d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:12:02.312310 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 27733
I20260809 20:12:02.312811 28498 ts_tablet_manager.cc:1905] T 1c1a6216fa5d431786b3545717a56342 P 922e7d39b9a24541968e2df2043849d6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:12:02.319655 28498 ts_tablet_manager.cc:1918] T 1c1a6216fa5d431786b3545717a56342 P 922e7d39b9a24541968e2df2043849d6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 20:12:02.319809 28498 log.cc:1196] T 1c1a6216fa5d431786b3545717a56342 P 922e7d39b9a24541968e2df2043849d6: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-1/wal/wals/1c1a6216fa5d431786b3545717a56342
I20260809 20:12:02.320267 28498 ts_tablet_manager.cc:1939] T 1c1a6216fa5d431786b3545717a56342 P 922e7d39b9a24541968e2df2043849d6: Deleting consensus metadata
I20260809 20:12:02.321290 27587 catalog_manager.cc:4841] TS 922e7d39b9a24541968e2df2043849d6 (127.14.181.2:40463): tablet 1c1a6216fa5d431786b3545717a56342 (table test-table [id=11c97a73261444a8ba2aae0298f16d5a]) successfully deleted
I20260809 20:12:02.319700 28497 ts_tablet_manager.cc:1918] T 1c1a6216fa5d431786b3545717a56342 P e096433beba5480db2fb141954e88ed6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 20:12:02.322376 28496 ts_tablet_manager.cc:1918] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 20:12:02.322540 28496 log.cc:1196] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-2/wal/wals/1c1a6216fa5d431786b3545717a56342
I20260809 20:12:02.322717 28497 log.cc:1196] T 1c1a6216fa5d431786b3545717a56342 P e096433beba5480db2fb141954e88ed6: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786306256699363-15060-0/minicluster-data/ts-0/wal/wals/1c1a6216fa5d431786b3545717a56342
I20260809 20:12:02.322976 28496 ts_tablet_manager.cc:1939] T 1c1a6216fa5d431786b3545717a56342 P 8fc7adedd38a480dba8ceb9b947ea2a9: Deleting consensus metadata
I20260809 20:12:02.323413 28497 ts_tablet_manager.cc:1939] T 1c1a6216fa5d431786b3545717a56342 P e096433beba5480db2fb141954e88ed6: Deleting consensus metadata
I20260809 20:12:02.324503 27587 catalog_manager.cc:4841] TS 8fc7adedd38a480dba8ceb9b947ea2a9 (127.14.181.3:44669): tablet 1c1a6216fa5d431786b3545717a56342 (table test-table [id=11c97a73261444a8ba2aae0298f16d5a]) successfully deleted
I20260809 20:12:02.325733 27588 catalog_manager.cc:4841] TS e096433beba5480db2fb141954e88ed6 (127.14.181.1:45253): tablet 1c1a6216fa5d431786b3545717a56342 (table test-table [id=11c97a73261444a8ba2aae0298f16d5a]) successfully deleted
Aug 09 20:12:02 dist-test-slave-6zbq krb5kdc[27548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.181.1@KRBTEST.COM
I20260809 20:12:02.347676 28594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:02.313691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53150 (local address 127.14.181.1:45253)
0809 20:12:02.313864 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:02.313870 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:02.328960 (+ 15090us) server_negotiation.cc:407] Connection header received
0809 20:12:02.329358 (+ 398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:02.329364 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:02.329443 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:02.329506 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:02.331217 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:02.332306 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:02.334258 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:02.334981 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:02.335076 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:02.340295 (+ 5219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:02.340314 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:02.340334 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:12:02.340377 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:02.344170 (+ 3793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:02.345003 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:02.345012 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:02.345016 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:02.345175 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:02.345614 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:02.345619 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:02.345622 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:02.346061 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:02.346382 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:02.346951 (+ 569us) server_negotiation.cc:299] Negotiation successful
0809 20:12:02.347180 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 20:12:02.348603 27955 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:12:02.554277 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 27733
I20260809 20:12:02.589844 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 27966
Aug 09 20:12:02 dist-test-slave-6zbq krb5kdc[27548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.181.2@KRBTEST.COM
I20260809 20:12:02.615814 28452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:02.590674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59664 (local address 127.14.181.2:40463)
0809 20:12:02.590896 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:02.590902 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:02.591025 (+ 123us) server_negotiation.cc:407] Connection header received
0809 20:12:02.591240 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:02.591246 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:02.591335 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:02.591449 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:02.593096 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:02.594229 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:02.596215 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:02.597004 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:02.597156 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:02.602617 (+ 5461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:02.602658 (+ 41us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:02.602675 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:12:02.602726 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:02.612432 (+ 9706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:02.613305 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:02.613315 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:02.613318 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:02.613530 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:02.613985 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:02.613991 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:02.613995 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:02.614503 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:02.614828 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:02.615171 (+ 343us) server_negotiation.cc:299] Negotiation successful
0809 20:12:02.615425 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 20:12:02.616564 28181 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:12:02.769915 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 27966
I20260809 20:12:02.795805 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 28207
Aug 09 20:12:02 dist-test-slave-6zbq krb5kdc[27548](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.14.181.3@KRBTEST.COM
I20260809 20:12:02.809850 28620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:02.796489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35890 (local address 127.14.181.3:44669)
0809 20:12:02.796947 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:02.796951 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:02.796968 (+ 17us) server_negotiation.cc:407] Connection header received
0809 20:12:02.797023 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:02.797026 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:02.797094 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:02.797189 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:02.798511 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:02.799186 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:02.800323 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:02.800733 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:02.800819 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:02.804899 (+ 4080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:02.804912 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:02.804928 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:12:02.804959 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:02.807409 (+ 2450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:02.807969 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:02.807976 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:02.807979 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:02.808119 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:02.808399 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:02.808404 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:02.808407 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:02.808855 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:02.809147 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:02.809314 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 20:12:02.809530 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":272,"threads_started":1}
I20260809 20:12:02.810544 28406 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:12:02.931582 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 28207
I20260809 20:12:02.957201 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 27567
I20260809 20:12:02.958328 27682 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:12:03.068522 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 27567
2026-08-09T20:12:03Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (6556 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:12:03 dist-test-slave-6zbq krb5kdc[28628](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:12:03 dist-test-slave-6zbq krb5kdc[28628](info): set up 2 sockets
Aug 09 20:12:03 dist-test-slave-6zbq krb5kdc[28628](info): commencing operation
krb5kdc: starting...
W20260809 20:12:04.277562 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.003s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:12:04 dist-test-slave-6zbq krb5kdc[28628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306324, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:12:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:12:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:12:04.487071 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:35887
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:43813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:35887
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:12:04.796622 28649 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:12:04.796886 28649 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:12:04.797019 28649 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:12:04.803869 28649 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:12:04.803969 28649 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:12:04.804047 28649 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:12:04.804133 28649 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:12:04.804198 28649 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:12:04.813187 28649 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:43813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:35887
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:35887
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:12:04.814251 28649 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:12:04.815420 28649 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:12:04.825680 28662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:04.826376 28663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:04.826800 28669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:12:04.827311 28649 server_base.cc:1034] running on GCE node
I20260809 20:12:04.827992 28649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:12:04.829162 28649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:12:04.830374 28649 hybrid_clock.cc:648] HybridClock initialized: now 1786306324830303 us; error 43 us; skew 500 ppm
I20260809 20:12:04.830687 28649 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-09T20:12:04Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1819 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:12:04 dist-test-slave-6zbq krb5kdc[28675](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:12:04 dist-test-slave-6zbq krb5kdc[28675](info): set up 2 sockets
Aug 09 20:12:04 dist-test-slave-6zbq krb5kdc[28675](info): commencing operation
krb5kdc: starting...
W20260809 20:12:06.083256 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.149s user 0.007s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:12:06 dist-test-slave-6zbq krb5kdc[28675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306326, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:12:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:12:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:12:06.280872 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:40169
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:38165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:40169
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:12:06.586845 28695 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:12:06.587117 28695 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:12:06.587258 28695 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:12:06.594221 28695 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:12:06.594336 28695 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:12:06.594431 28695 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:12:06.594512 28695 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:12:06.594574 28695 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:12:06.603981 28695 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:38165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:40169
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:40169
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:12:06.605401 28695 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:12:06.606885 28695 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:12:06.622442 28705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:06.622609 28704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:06.622447 28709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:12:06.623225 28695 server_base.cc:1034] running on GCE node
I20260809 20:12:06.623934 28695 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:12:06.625227 28695 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:12:06.626425 28695 hybrid_clock.cc:648] HybridClock initialized: now 1786306326626372 us; error 39 us; skew 500 ppm
I20260809 20:12:06.626740 28695 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:12:06 dist-test-slave-6zbq krb5kdc[28675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306326, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:12:06.634135 28695 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:12:06.635556 28695 webserver.cc:460] Webserver started at http://127.14.181.62:33981/ using document root <none> and password file <none>
I20260809 20:12:06.636178 28695 fs_manager.cc:359] Metadata directory not provided
I20260809 20:12:06.636313 28695 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:12:06.636601 28695 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:12:06.639418 28695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "4071a155f56d44d9b818320bed10c49f"
format_stamp: "Formatted at 2026-08-09 20:12:06 on dist-test-slave-6zbq"
server_key: "83f1ca38bbca7ff189ce95d4c0655937"
server_key_iv: "987dca77eef78b7294c45bab0130503b"
server_key_version: "encryptionkey@0"
I20260809 20:12:06.640113 28695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "4071a155f56d44d9b818320bed10c49f"
format_stamp: "Formatted at 2026-08-09 20:12:06 on dist-test-slave-6zbq"
server_key: "83f1ca38bbca7ff189ce95d4c0655937"
server_key_iv: "987dca77eef78b7294c45bab0130503b"
server_key_version: "encryptionkey@0"
I20260809 20:12:06.645951 28695 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 20:12:06.649221 28717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:06.650485 28695 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 20:12:06.650642 28695 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "4071a155f56d44d9b818320bed10c49f"
format_stamp: "Formatted at 2026-08-09 20:12:06 on dist-test-slave-6zbq"
server_key: "83f1ca38bbca7ff189ce95d4c0655937"
server_key_iv: "987dca77eef78b7294c45bab0130503b"
server_key_version: "encryptionkey@0"
I20260809 20:12:06.650823 28695 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:12:06.673390 28695 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:12:06.677006 28695 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:12:06.677253 28695 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:12:06.693874 28695 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:40169
I20260809 20:12:06.693893 28789 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:40169 every 8 connection(s)
I20260809 20:12:06.695122 28695 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:12:06.698573 28790 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:12:06.699507 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 28695
I20260809 20:12:06.699729 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:12:06.700556 15060 external_mini_cluster.cc:1428] Setting key a9dbe01291e055dba3e4bffeea4f731d
I20260809 20:12:06.712232 28790 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f: Bootstrap starting.
Aug 09 20:12:06 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306326, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:12:06.715909 28790 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f: Neither blocks nor log segments found. Creating new log.
I20260809 20:12:06.717024 28790 log.cc:824] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f: Log is configured to *not* fsync() on all Append() calls
I20260809 20:12:06.719982 28790 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f: No bootstrap required, opened a new log
I20260809 20:12:06.723115 28795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:06.702599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41024 (local address 127.14.181.62:40169)
0809 20:12:06.703358 (+ 759us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:06.703369 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:06.703413 (+ 44us) server_negotiation.cc:407] Connection header received
0809 20:12:06.705017 (+ 1604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:06.705039 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:06.705406 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:06.705719 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:06.707578 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:06.708840 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:06.710598 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:06.711229 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:06.711364 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:06.715863 (+ 4499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:06.715871 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:06.715885 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:12:06.715922 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:06.719161 (+ 3239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:06.719932 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:06.719938 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:06.719944 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:06.720184 (+ 240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:06.720565 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:06.720568 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:06.720571 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:06.721065 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:06.721295 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:06.721731 (+ 436us) server_negotiation.cc:299] Negotiation successful
0809 20:12:06.722114 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":348,"threads_started":1}
I20260809 20:12:06.727716 28790 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4071a155f56d44d9b818320bed10c49f" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 40169 } }
I20260809 20:12:06.728042 28790 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:12:06.728127 28790 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4071a155f56d44d9b818320bed10c49f, State: Initialized, Role: FOLLOWER
I20260809 20:12:06.728689 28790 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4071a155f56d44d9b818320bed10c49f" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 40169 } }
I20260809 20:12:06.728921 28790 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:12:06.729043 28790 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:12:06.729188 28790 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:12:06.731226 28790 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4071a155f56d44d9b818320bed10c49f" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 40169 } }
I20260809 20:12:06.731660 28790 leader_election.cc:302] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4071a155f56d44d9b818320bed10c49f; no voters:
I20260809 20:12:06.732187 28790 leader_election.cc:288] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:12:06.732307 28798 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:12:06.732905 28798 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [term 1 LEADER]: Becoming Leader. State: Replica: 4071a155f56d44d9b818320bed10c49f, State: Running, Role: LEADER
I20260809 20:12:06.733417 28798 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4071a155f56d44d9b818320bed10c49f" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 40169 } }
I20260809 20:12:06.734167 28790 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:12:06.735778 28800 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4071a155f56d44d9b818320bed10c49f. Latest consensus state: current_term: 1 leader_uuid: "4071a155f56d44d9b818320bed10c49f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4071a155f56d44d9b818320bed10c49f" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 40169 } } }
I20260809 20:12:06.736160 28800 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [sys.catalog]: This master's current role is: LEADER
I20260809 20:12:06.736402 28799 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4071a155f56d44d9b818320bed10c49f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4071a155f56d44d9b818320bed10c49f" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 40169 } } }
I20260809 20:12:06.736708 28799 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [sys.catalog]: This master's current role is: LEADER
I20260809 20:12:06.738302 28812 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:12:06.743135 28812 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:12:06.751531 28812 catalog_manager.cc:1347] Generated new cluster ID: 102a3d1293af46c0aceff119027cf318
I20260809 20:12:06.751628 28812 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:12:06.771786 28812 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:12:06.773506 28812 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:12:06.784005 28812 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f: Generated new TSK 0
I20260809 20:12:06.784870 28812 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.181.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
I20260809 20:12:06.837415 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:0
--local_ip_for_outbound_sockets=127.14.181.1
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:40169
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:38165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:12:07.143992 28841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:12:07.144233 28841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:12:07.144366 28841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:12:07.151265 28841 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:12:07.151366 28841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:12:07.151510 28841 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:12:07.160629 28841 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:38165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:40169
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:12:07.161718 28841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:12:07.162930 28841 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:12:07.174995 28855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:07.175151 28853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:07.174834 28860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:12:07.176018 28841 server_base.cc:1034] running on GCE node
I20260809 20:12:07.176592 28841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:12:07.177419 28841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:12:07.178603 28841 hybrid_clock.cc:648] HybridClock initialized: now 1786306327178556 us; error 38 us; skew 500 ppm
I20260809 20:12:07.178866 28841 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:12:07 dist-test-slave-6zbq krb5kdc[28675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306327, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:12:07.181875 28841 init.cc:377] Logged in from keytab as kudu/127.14.181.1@KRBTEST.COM (short username kudu)
I20260809 20:12:07.183183 28841 webserver.cc:460] Webserver started at http://127.14.181.1:44715/ using document root <none> and password file <none>
I20260809 20:12:07.183785 28841 fs_manager.cc:359] Metadata directory not provided
I20260809 20:12:07.183900 28841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:12:07.184170 28841 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:12:07.186833 28841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/data/instance:
uuid: "ecdba50c1f2d42e8b7f3a5a7f0a8e316"
format_stamp: "Formatted at 2026-08-09 20:12:07 on dist-test-slave-6zbq"
server_key: "109b4b6ced804c7304d00cbf95a9620f"
server_key_iv: "c63248f20a3d5f05fbd14b434d770837"
server_key_version: "encryptionkey@0"
I20260809 20:12:07.187548 28841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance:
uuid: "ecdba50c1f2d42e8b7f3a5a7f0a8e316"
format_stamp: "Formatted at 2026-08-09 20:12:07 on dist-test-slave-6zbq"
server_key: "109b4b6ced804c7304d00cbf95a9620f"
server_key_iv: "c63248f20a3d5f05fbd14b434d770837"
server_key_version: "encryptionkey@0"
I20260809 20:12:07.192055 28841 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260809 20:12:07.195083 28877 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:07.196228 28841 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:12:07.196377 28841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "ecdba50c1f2d42e8b7f3a5a7f0a8e316"
format_stamp: "Formatted at 2026-08-09 20:12:07 on dist-test-slave-6zbq"
server_key: "109b4b6ced804c7304d00cbf95a9620f"
server_key_iv: "c63248f20a3d5f05fbd14b434d770837"
server_key_version: "encryptionkey@0"
I20260809 20:12:07.196547 28841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:12:07.232295 28841 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:12:07.236202 28841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:12:07.236461 28841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:12:07.237267 28841 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:12:07.238507 28841 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:12:07.238590 28841 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:07.238698 28841 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:12:07.238749 28841 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:07.267858 28841 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:33107
I20260809 20:12:07.267910 29060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:33107 every 8 connection(s)
I20260809 20:12:07.268956 28841 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:12:07.276476 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 28841
I20260809 20:12:07.276682 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance
I20260809 20:12:07.277474 15060 external_mini_cluster.cc:1428] Setting key 3ab16146c7aa66592efa2695bf834825
Aug 09 20:12:07 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306327, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:12:07.288268 29063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:07.271171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:37073 (local address 127.14.181.62:40169)
0809 20:12:07.271608 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:07.271615 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:07.272474 (+ 859us) server_negotiation.cc:407] Connection header received
0809 20:12:07.274169 (+ 1695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:07.274173 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:07.274236 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:07.274335 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:07.275653 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:07.276378 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:07.278433 (+ 2055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:07.278859 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:07.278952 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:07.282463 (+ 3511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:07.282469 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:07.282473 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:12:07.282507 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:07.285449 (+ 2942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:07.286105 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:07.286109 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:07.286113 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:07.286270 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:07.286702 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:07.286706 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:07.286709 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:07.287041 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:07.287176 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:07.287746 (+ 570us) server_negotiation.cc:299] Negotiation successful
0809 20:12:07.287947 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":209,"threads_started":1}
I20260809 20:12:07.289047 29064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:07.271659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.1:37073)
0809 20:12:07.272322 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:07.272358 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:07.273935 (+ 1577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:07.274538 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:07.274546 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:07.275003 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:07.275520 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:07.275536 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:07.276534 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:07.276540 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:07.278277 (+ 1737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:07.278290 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:07.279076 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:07.279083 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:07.279355 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:07.280034 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:07.280063 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:07.282238 (+ 2175us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:12:07.285572 (+ 3334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:12:07.285578 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:12:07.285589 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:12:07.285983 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:12:07.286417 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:12:07.286420 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:12:07.286422 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:12:07.286592 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:12:07.287147 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:12:07.287152 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:12:07.287423 (+ 271us) client_negotiation.cc:769] Sending connection context
0809 20:12:07.287626 (+ 203us) client_negotiation.cc:240] Negotiation successful
0809 20:12:07.287977 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":258,"threads_started":1}
I20260809 20:12:07.290498 29061 heartbeater.cc:347] Connected to a master server at 127.14.181.62:40169
I20260809 20:12:07.290795 29061 heartbeater.cc:464] Registering TS with master...
I20260809 20:12:07.291567 29061 heartbeater.cc:511] Master 127.14.181.62:40169 requested a full tablet report, sending...
I20260809 20:12:07.293557 28744 ts_manager.cc:194] Registered new tserver with Master: ecdba50c1f2d42e8b7f3a5a7f0a8e316 (127.14.181.1:33107)
I20260809 20:12:07.294963 28744 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.1@KRBTEST.COM'} at 127.14.181.1:37073
WARNING: no policy specified for kudu/127.14.181.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
I20260809 20:12:07.329910 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:0
--local_ip_for_outbound_sockets=127.14.181.2
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:40169
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:38165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:12:07.636055 29067 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:12:07.636312 29067 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:12:07.636401 29067 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:12:07.643290 29067 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:12:07.643383 29067 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:12:07.643492 29067 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:12:07.653472 29067 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:38165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:40169
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:12:07.654680 29067 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:12:07.655872 29067 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:12:07.667850 29079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:07.667994 29080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:07.667964 29082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:12:07.668803 29067 server_base.cc:1034] running on GCE node
I20260809 20:12:07.669373 29067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:12:07.670219 29067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:12:07.671432 29067 hybrid_clock.cc:648] HybridClock initialized: now 1786306327671369 us; error 54 us; skew 500 ppm
I20260809 20:12:07.671720 29067 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:12:07 dist-test-slave-6zbq krb5kdc[28675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306327, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:12:07.674700 29067 init.cc:377] Logged in from keytab as kudu/127.14.181.2@KRBTEST.COM (short username kudu)
I20260809 20:12:07.675987 29067 webserver.cc:460] Webserver started at http://127.14.181.2:45799/ using document root <none> and password file <none>
I20260809 20:12:07.676595 29067 fs_manager.cc:359] Metadata directory not provided
I20260809 20:12:07.676689 29067 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:12:07.676925 29067 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:12:07.679687 29067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/data/instance:
uuid: "0776b31736944a09967e96b990c48393"
format_stamp: "Formatted at 2026-08-09 20:12:07 on dist-test-slave-6zbq"
server_key: "950e3f8d6228a58defa420b790de3ebb"
server_key_iv: "697f5b2724cf81821416213ab9f23c34"
server_key_version: "encryptionkey@0"
I20260809 20:12:07.680419 29067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance:
uuid: "0776b31736944a09967e96b990c48393"
format_stamp: "Formatted at 2026-08-09 20:12:07 on dist-test-slave-6zbq"
server_key: "950e3f8d6228a58defa420b790de3ebb"
server_key_iv: "697f5b2724cf81821416213ab9f23c34"
server_key_version: "encryptionkey@0"
I20260809 20:12:07.685230 29067 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260809 20:12:07.688443 29090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:07.689635 29067 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 20:12:07.689762 29067 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "0776b31736944a09967e96b990c48393"
format_stamp: "Formatted at 2026-08-09 20:12:07 on dist-test-slave-6zbq"
server_key: "950e3f8d6228a58defa420b790de3ebb"
server_key_iv: "697f5b2724cf81821416213ab9f23c34"
server_key_version: "encryptionkey@0"
I20260809 20:12:07.689914 29067 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:12:07.718667 29067 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:12:07.722851 29067 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:12:07.723080 29067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:12:07.723958 29067 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:12:07.725194 29067 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:12:07.725265 29067 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:07.725364 29067 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:12:07.725415 29067 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:07.754954 29067 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:42765
I20260809 20:12:07.754995 29282 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:42765 every 8 connection(s)
I20260809 20:12:07.756160 29067 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:12:07.760107 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 29067
I20260809 20:12:07.760259 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance
I20260809 20:12:07.760691 15060 external_mini_cluster.cc:1428] Setting key bf2415a748028fa7c58e0a9dbaf41491
Aug 09 20:12:07 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306327, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:12:07.775378 29063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:07.758487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:47387 (local address 127.14.181.62:40169)
0809 20:12:07.758670 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:07.758675 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:07.759816 (+ 1141us) server_negotiation.cc:407] Connection header received
0809 20:12:07.761705 (+ 1889us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:07.761711 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:07.761795 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:07.761900 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:07.763363 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:07.764089 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:07.765541 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:07.765937 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:07.766042 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:07.769363 (+ 3321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:07.769370 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:07.769374 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:12:07.769413 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:07.772416 (+ 3003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:07.773256 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:07.773260 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:07.773263 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:07.773412 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:07.773853 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:07.773856 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:07.773858 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:07.774107 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:07.774215 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:07.774989 (+ 774us) server_negotiation.cc:299] Negotiation successful
0809 20:12:07.775154 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 20:12:07.776571 29289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:07.758952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.2:47387)
0809 20:12:07.759645 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:07.759682 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:07.761418 (+ 1736us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:07.762081 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:07.762088 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:07.762675 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:07.763201 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:07.763218 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:07.764232 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:07.764235 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:07.765406 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:07.765418 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:07.766139 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:07.766147 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:07.766406 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:07.767001 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:07.767022 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:07.769153 (+ 2131us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:12:07.772543 (+ 3390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:12:07.772551 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:12:07.772565 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:12:07.773104 (+ 539us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:12:07.773522 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:12:07.773526 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:12:07.773529 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:12:07.773754 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:12:07.774219 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:12:07.774226 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:12:07.774609 (+ 383us) client_negotiation.cc:769] Sending connection context
0809 20:12:07.774878 (+ 269us) client_negotiation.cc:240] Negotiation successful
0809 20:12:07.775327 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":299,"threads_started":1}
I20260809 20:12:07.777928 29284 heartbeater.cc:347] Connected to a master server at 127.14.181.62:40169
I20260809 20:12:07.778195 29284 heartbeater.cc:464] Registering TS with master...
I20260809 20:12:07.778895 29284 heartbeater.cc:511] Master 127.14.181.62:40169 requested a full tablet report, sending...
I20260809 20:12:07.780261 28744 ts_manager.cc:194] Registered new tserver with Master: 0776b31736944a09967e96b990c48393 (127.14.181.2:42765)
I20260809 20:12:07.781042 28744 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.2@KRBTEST.COM'} at 127.14.181.2:47387
WARNING: no policy specified for kudu/127.14.181.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
I20260809 20:12:07.811416 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:0
--local_ip_for_outbound_sockets=127.14.181.3
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:40169
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:38165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:12:08.119304 29294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:12:08.119560 29294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:12:08.119690 29294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:12:08.126605 29294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:12:08.126713 29294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:12:08.126861 29294 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:12:08.135999 29294 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:38165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:40169
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:12:08.137070 29294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:12:08.138267 29294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:12:08.149948 29303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:08.149971 29306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:08.149981 29304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:12:08.150904 29294 server_base.cc:1034] running on GCE node
I20260809 20:12:08.151427 29294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:12:08.152220 29294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:12:08.153406 29294 hybrid_clock.cc:648] HybridClock initialized: now 1786306328153362 us; error 41 us; skew 500 ppm
I20260809 20:12:08.153676 29294 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:12:08 dist-test-slave-6zbq krb5kdc[28675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306328, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:12:08.156530 29294 init.cc:377] Logged in from keytab as kudu/127.14.181.3@KRBTEST.COM (short username kudu)
I20260809 20:12:08.157836 29294 webserver.cc:460] Webserver started at http://127.14.181.3:37585/ using document root <none> and password file <none>
I20260809 20:12:08.158475 29294 fs_manager.cc:359] Metadata directory not provided
I20260809 20:12:08.158589 29294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:12:08.158856 29294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:12:08.161453 29294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/data/instance:
uuid: "d344ca7497154eac9ef5bdfe23ccf0de"
format_stamp: "Formatted at 2026-08-09 20:12:08 on dist-test-slave-6zbq"
server_key: "7466fe07dbbcafdffa78538f3b3f58b1"
server_key_iv: "009064371186321f17703a74c2a19a1d"
server_key_version: "encryptionkey@0"
I20260809 20:12:08.162142 29294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance:
uuid: "d344ca7497154eac9ef5bdfe23ccf0de"
format_stamp: "Formatted at 2026-08-09 20:12:08 on dist-test-slave-6zbq"
server_key: "7466fe07dbbcafdffa78538f3b3f58b1"
server_key_iv: "009064371186321f17703a74c2a19a1d"
server_key_version: "encryptionkey@0"
I20260809 20:12:08.166712 29294 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 20:12:08.170056 29317 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:08.171325 29294 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:12:08.171468 29294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "d344ca7497154eac9ef5bdfe23ccf0de"
format_stamp: "Formatted at 2026-08-09 20:12:08 on dist-test-slave-6zbq"
server_key: "7466fe07dbbcafdffa78538f3b3f58b1"
server_key_iv: "009064371186321f17703a74c2a19a1d"
server_key_version: "encryptionkey@0"
I20260809 20:12:08.171627 29294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:12:08.192013 29294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:12:08.195719 29294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:12:08.195953 29294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:12:08.196776 29294 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:12:08.197947 29294 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:12:08.198020 29294 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:08.198134 29294 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:12:08.198185 29294 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:08.227835 29294 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:43891
I20260809 20:12:08.227891 29498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:43891 every 8 connection(s)
I20260809 20:12:08.228950 29294 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:12:08.231928 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 29294
I20260809 20:12:08.232076 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance
I20260809 20:12:08.232497 15060 external_mini_cluster.cc:1428] Setting key 5e4cd42df19685f5d05279a51115729b
Aug 09 20:12:08 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306328, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:12:08.246996 29063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:08.231258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:58301 (local address 127.14.181.62:40169)
0809 20:12:08.231418 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:08.231422 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:08.232601 (+ 1179us) server_negotiation.cc:407] Connection header received
0809 20:12:08.234686 (+ 2085us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:08.234692 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:08.234772 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:08.234878 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:08.236216 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:08.236927 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:08.238282 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:08.238755 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:08.238841 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:08.241864 (+ 3023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:08.241869 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:08.241872 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:12:08.241904 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:08.244212 (+ 2308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:08.244854 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:08.244858 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:08.244861 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:08.244974 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:08.245362 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:08.245367 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:08.245370 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:08.245667 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:08.245812 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:08.246469 (+ 657us) server_negotiation.cc:299] Negotiation successful
0809 20:12:08.246692 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 20:12:08.247834 29505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:08.231680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.3:58301)
0809 20:12:08.232453 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:08.232496 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:08.234454 (+ 1958us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:08.235039 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:08.235050 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:08.235567 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:08.236069 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:08.236084 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:08.237029 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:08.237032 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:08.238165 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:08.238176 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:08.238919 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:08.238924 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:08.239108 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:08.239657 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:08.239683 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:08.241671 (+ 1988us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:12:08.244335 (+ 2664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:12:08.244344 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:12:08.244357 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:12:08.244745 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:12:08.245075 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:12:08.245080 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:12:08.245083 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:12:08.245259 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:12:08.245789 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:12:08.245797 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:12:08.246129 (+ 332us) client_negotiation.cc:769] Sending connection context
0809 20:12:08.246398 (+ 269us) client_negotiation.cc:240] Negotiation successful
0809 20:12:08.246770 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":301,"threads_started":1}
I20260809 20:12:08.248888 29501 heartbeater.cc:347] Connected to a master server at 127.14.181.62:40169
I20260809 20:12:08.249145 29501 heartbeater.cc:464] Registering TS with master...
I20260809 20:12:08.249768 29501 heartbeater.cc:511] Master 127.14.181.62:40169 requested a full tablet report, sending...
I20260809 20:12:08.251013 28744 ts_manager.cc:194] Registered new tserver with Master: d344ca7497154eac9ef5bdfe23ccf0de (127.14.181.3:43891)
I20260809 20:12:08.251749 28744 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.3@KRBTEST.COM'} at 127.14.181.3:58301
I20260809 20:12:08.259183 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.14.181.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.181.1@KRBTEST.COM" created.
I20260809 20:12:08.298012 29061 heartbeater.cc:503] Master 127.14.181.62:40169 was elected leader, sending a full tablet report...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.181.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.1.keytab.
Entry for principal oryx/127.14.181.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.1.keytab.
WARNING: no policy specified for oryx/127.14.181.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.181.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.181.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.2.keytab.
Entry for principal oryx/127.14.181.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.2.keytab.
WARNING: no policy specified for oryx/127.14.181.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.14.181.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.14.181.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.3.keytab.
Entry for principal oryx/127.14.181.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.3.keytab.
I20260809 20:12:08.389907 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 28841
Aug 09 20:12:08 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306326, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.1@KRBTEST.COM
I20260809 20:12:08.405191 29517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:08.391109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43244 (local address 127.14.181.1:33107)
0809 20:12:08.391756 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:08.391764 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:08.391792 (+ 28us) server_negotiation.cc:407] Connection header received
0809 20:12:08.391870 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:08.391877 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:08.392074 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:08.392207 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:08.393485 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:08.394565 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:08.395785 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:08.396358 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:08.396465 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:08.400190 (+ 3725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:08.400201 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:08.400216 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:12:08.400247 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:08.402982 (+ 2735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:08.403605 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:08.403611 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:08.403613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:08.403743 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:08.404014 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:08.404017 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:08.404019 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:08.404326 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:08.404553 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:08.404734 (+ 181us) server_negotiation.cc:299] Negotiation successful
0809 20:12:08.404916 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":341,"threads_started":1}
I20260809 20:12:08.406445 29055 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:12:08.487237 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 28841
I20260809 20:12:08.507468 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 29067
Aug 09 20:12:08 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306326, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.2@KRBTEST.COM
I20260809 20:12:08.522136 29522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:08.508317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45484 (local address 127.14.181.2:42765)
0809 20:12:08.508819 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:08.508826 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:08.508852 (+ 26us) server_negotiation.cc:407] Connection header received
0809 20:12:08.508911 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:08.508918 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:08.509167 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:08.509317 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:08.510513 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:08.511528 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:08.512708 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:08.513309 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:08.513422 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:08.517321 (+ 3899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:08.517333 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:08.517346 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:12:08.517379 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:08.519947 (+ 2568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:08.520520 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:08.520525 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:08.520528 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:08.520644 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:08.520903 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:08.520905 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:08.520907 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:08.521224 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:08.521440 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:08.521640 (+ 200us) server_negotiation.cc:299] Negotiation successful
0809 20:12:08.521833 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":265,"threads_started":1}
I20260809 20:12:08.523347 29274 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:12:08.602363 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 29067
I20260809 20:12:08.625986 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 29294
Aug 09 20:12:08 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306326, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.3@KRBTEST.COM
I20260809 20:12:08.641230 29529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:08.627089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34844 (local address 127.14.181.3:43891)
0809 20:12:08.627731 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:08.627737 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:08.627766 (+ 29us) server_negotiation.cc:407] Connection header received
0809 20:12:08.627825 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:08.627832 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:08.628031 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:08.628165 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:08.629359 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:08.630412 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:08.631628 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:08.632173 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:08.632268 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:08.636339 (+ 4071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:08.636351 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:08.636364 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:12:08.636398 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:08.638915 (+ 2517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:08.639513 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:08.639520 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:08.639523 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:08.639659 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:08.639951 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:08.639954 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:08.639956 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:08.640274 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:08.640503 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:08.640663 (+ 160us) server_negotiation.cc:299] Negotiation successful
0809 20:12:08.640849 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":486,"thread_start_us":340,"threads_started":1}
I20260809 20:12:08.642443 29492 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:12:08.723034 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 29294
I20260809 20:12:08.741765 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 28695
I20260809 20:12:08.742920 28785 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:12:08.843104 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 28695
I20260809 20:12:08.869360 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:40169
--webserver_interface=127.14.181.62
--webserver_port=33981
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:38165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:40169
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:12:09.178890 29532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:12:09.179131 29532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:12:09.179229 29532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:12:09.185990 29532 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:12:09.186075 29532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:12:09.186126 29532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:12:09.186180 29532 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:12:09.186228 29532 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:12:09.195322 29532 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:38165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:40169
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:40169
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=33981
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:12:09.196338 29532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:12:09.197471 29532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:12:09.207859 29544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:09.207906 29541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:09.208086 29538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:12:09.209187 29532 server_base.cc:1034] running on GCE node
I20260809 20:12:09.210019 29532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:12:09.211604 29532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:12:09.212815 29532 hybrid_clock.cc:648] HybridClock initialized: now 1786306329212753 us; error 44 us; skew 500 ppm
I20260809 20:12:09.213126 29532 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:12:09 dist-test-slave-6zbq krb5kdc[28675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306329, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:12:09.217015 29532 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:12:09.218833 29532 webserver.cc:460] Webserver started at http://127.14.181.62:33981/ using document root <none> and password file <none>
I20260809 20:12:09.219655 29532 fs_manager.cc:359] Metadata directory not provided
I20260809 20:12:09.219808 29532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:12:09.226833 29532 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 20:12:09.230132 29556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:09.231770 29532 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 20:12:09.231943 29532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "4071a155f56d44d9b818320bed10c49f"
format_stamp: "Formatted at 2026-08-09 20:12:06 on dist-test-slave-6zbq"
server_key: "83f1ca38bbca7ff189ce95d4c0655937"
server_key_iv: "987dca77eef78b7294c45bab0130503b"
server_key_version: "encryptionkey@0"
I20260809 20:12:09.233220 29532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:12:09.254729 29532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:12:09.259001 29532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:12:09.259272 29532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:12:09.277037 29532 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:40169
I20260809 20:12:09.277057 29631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:40169 every 8 connection(s)
I20260809 20:12:09.278430 29532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:12:09.280282 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 29532
I20260809 20:12:09.281232 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:33107
--local_ip_for_outbound_sockets=127.14.181.1
--tserver_master_addrs=127.14.181.62:40169
--webserver_port=44715
--webserver_interface=127.14.181.1
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:38165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.14.181.1
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.1.keytab with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 20:12:09.286880 29634 sys_catalog.cc:263] Verifying existing consensus state
I20260809 20:12:09.290910 29634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f: Bootstrap starting.
I20260809 20:12:09.308864 29634 log.cc:824] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f: Log is configured to *not* fsync() on all Append() calls
I20260809 20:12:09.317562 29634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 20:12:09.318054 29634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f: Bootstrap complete.
I20260809 20:12:09.326758 29634 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4071a155f56d44d9b818320bed10c49f" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 40169 } }
I20260809 20:12:09.327579 29634 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4071a155f56d44d9b818320bed10c49f, State: Initialized, Role: FOLLOWER
I20260809 20:12:09.328202 29634 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4071a155f56d44d9b818320bed10c49f" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 40169 } }
I20260809 20:12:09.328421 29634 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:12:09.328529 29634 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:12:09.328696 29634 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [term 1 FOLLOWER]: Advancing to term 2
I20260809 20:12:09.332291 29634 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4071a155f56d44d9b818320bed10c49f" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 40169 } }
I20260809 20:12:09.332746 29634 leader_election.cc:302] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4071a155f56d44d9b818320bed10c49f; no voters:
I20260809 20:12:09.333324 29634 leader_election.cc:288] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 20:12:09.333510 29640 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [term 2 FOLLOWER]: Leader election won for term 2
I20260809 20:12:09.335119 29634 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:12:09.338598 29640 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [term 2 LEADER]: Becoming Leader. State: Replica: 4071a155f56d44d9b818320bed10c49f, State: Running, Role: LEADER
I20260809 20:12:09.339164 29640 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4071a155f56d44d9b818320bed10c49f" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 40169 } }
I20260809 20:12:09.341569 29642 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4071a155f56d44d9b818320bed10c49f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4071a155f56d44d9b818320bed10c49f" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 40169 } } }
I20260809 20:12:09.341917 29642 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [sys.catalog]: This master's current role is: LEADER
I20260809 20:12:09.342331 29643 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4071a155f56d44d9b818320bed10c49f. Latest consensus state: current_term: 2 leader_uuid: "4071a155f56d44d9b818320bed10c49f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4071a155f56d44d9b818320bed10c49f" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 40169 } } }
I20260809 20:12:09.342643 29643 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f [sys.catalog]: This master's current role is: LEADER
I20260809 20:12:09.350916 29656 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:12:09.356647 29656 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:12:09.357025 29676 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 20:12:09.358007 29656 catalog_manager.cc:1259] Loaded cluster ID: 102a3d1293af46c0aceff119027cf318
I20260809 20:12:09.358095 29656 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:12:09.360783 29656 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:12:09.361831 29656 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4071a155f56d44d9b818320bed10c49f: Loaded TSK: 0
I20260809 20:12:09.362902 29656 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 20:12:09.621443 29638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:12:09.621702 29638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:12:09.621831 29638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:12:09.628875 29638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:12:09.628978 29638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:12:09.629122 29638 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:12:09.638744 29638 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:38165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.1.keytab
--principal=oryx/127.14.181.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:33107
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=44715
--tserver_master_addrs=127.14.181.62:40169
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:12:09.640026 29638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:12:09.641301 29638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:12:09.655702 29682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:09.656375 29683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:09.656752 29685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:12:09.656965 29638 server_base.cc:1034] running on GCE node
I20260809 20:12:09.657538 29638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:12:09.658452 29638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:12:09.659642 29638 hybrid_clock.cc:648] HybridClock initialized: now 1786306329659580 us; error 58 us; skew 500 ppm
I20260809 20:12:09.659926 29638 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:12:09 dist-test-slave-6zbq krb5kdc[28675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306329, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:12:09.662969 29638 init.cc:377] Logged in from keytab as oryx/127.14.181.1@KRBTEST.COM (short username oryx)
I20260809 20:12:09.664387 29638 webserver.cc:460] Webserver started at http://127.14.181.1:44715/ using document root <none> and password file <none>
I20260809 20:12:09.665009 29638 fs_manager.cc:359] Metadata directory not provided
I20260809 20:12:09.665125 29638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:12:09.670130 29638 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 20:12:09.672703 29696 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:09.673959 29638 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 20:12:09.674103 29638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "ecdba50c1f2d42e8b7f3a5a7f0a8e316"
format_stamp: "Formatted at 2026-08-09 20:12:07 on dist-test-slave-6zbq"
server_key: "109b4b6ced804c7304d00cbf95a9620f"
server_key_iv: "c63248f20a3d5f05fbd14b434d770837"
server_key_version: "encryptionkey@0"
I20260809 20:12:09.675074 29638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:12:09.690596 29638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:12:09.694191 29638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:12:09.694464 29638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:12:09.695456 29638 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:12:09.696799 29638 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:12:09.696895 29638 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:09.697002 29638 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:12:09.697078 29638 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:09.728410 29638 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:33107
I20260809 20:12:09.728470 29886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:33107 every 8 connection(s)
I20260809 20:12:09.729748 29638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:12:09.736001 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 29638
I20260809 20:12:09.736743 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:42765
--local_ip_for_outbound_sockets=127.14.181.2
--tserver_master_addrs=127.14.181.62:40169
--webserver_port=45799
--webserver_interface=127.14.181.2
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:38165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.14.181.2
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.2.keytab with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 20:12:09 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:09 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
W20260809 20:12:10.052121 29896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:12:10.052369 29896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:12:10.052487 29896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:12:10.059321 29896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:12:10.059412 29896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:12:10.059563 29896 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:12:10.068584 29896 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:38165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.2.keytab
--principal=oryx/127.14.181.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:42765
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=45799
--tserver_master_addrs=127.14.181.62:40169
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:12:10.069667 29896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:12:10.070870 29896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:12:10.083679 29905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:10.083703 29908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:10.084442 29904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:12:10.085079 29896 server_base.cc:1034] running on GCE node
I20260809 20:12:10.085860 29896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:12:10.087072 29896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:12:10.088322 29896 hybrid_clock.cc:648] HybridClock initialized: now 1786306330088227 us; error 75 us; skew 500 ppm
I20260809 20:12:10.088712 29896 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:12:10 dist-test-slave-6zbq krb5kdc[28675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306330, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:12:10.092999 29896 init.cc:377] Logged in from keytab as oryx/127.14.181.2@KRBTEST.COM (short username oryx)
I20260809 20:12:10.094828 29896 webserver.cc:460] Webserver started at http://127.14.181.2:45799/ using document root <none> and password file <none>
I20260809 20:12:10.095745 29896 fs_manager.cc:359] Metadata directory not provided
I20260809 20:12:10.095919 29896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:12:10.103295 29896 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.000s
I20260809 20:12:10.106737 29919 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:10.108351 29896 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260809 20:12:10.108531 29896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "0776b31736944a09967e96b990c48393"
format_stamp: "Formatted at 2026-08-09 20:12:07 on dist-test-slave-6zbq"
server_key: "950e3f8d6228a58defa420b790de3ebb"
server_key_iv: "697f5b2724cf81821416213ab9f23c34"
server_key_version: "encryptionkey@0"
I20260809 20:12:10.109987 29896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:12:10.136873 29896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:12:10.142751 29896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:12:10.143075 29896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:12:10.144305 29896 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:12:10.146109 29896 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:12:10.146256 29896 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:10.146392 29896 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:12:10.146482 29896 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:10.180491 29896 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:42765
I20260809 20:12:10.180512 30121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:42765 every 8 connection(s)
I20260809 20:12:10.182528 29896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:12:10.190778 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 29896
I20260809 20:12:10.191419 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:43891
--local_ip_for_outbound_sockets=127.14.181.3
--tserver_master_addrs=127.14.181.62:40169
--webserver_port=37585
--webserver_interface=127.14.181.3
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:38165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.14.181.3
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.3.keytab with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 20:12:10 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:10 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
W20260809 20:12:10.698652 30127 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:12:10.699131 30127 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:12:10.699302 30127 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:12:10.711786 30127 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:12:10.711928 30127 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:12:10.712129 30127 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:12:10.728667 30127 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:38165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/krb5kdc/oryx_127.14.181.3.keytab
--principal=oryx/127.14.181.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:43891
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=37585
--tserver_master_addrs=127.14.181.62:40169
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:12:10.730412 30127 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:12:10.732178 30127 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:12:10.748585 30135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:10.754182 30136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:10.756312 30141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:12:10.757320 30127 server_base.cc:1034] running on GCE node
I20260809 20:12:10.757889 30127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:12:10.758890 30127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:12:10.760099 30127 hybrid_clock.cc:648] HybridClock initialized: now 1786306330760046 us; error 48 us; skew 500 ppm
I20260809 20:12:10.760380 30127 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:12:10 dist-test-slave-6zbq krb5kdc[28675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306330, etypes {rep=17 tkt=17 ses=17}, oryx/127.14.181.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:12:10.763415 30127 init.cc:377] Logged in from keytab as oryx/127.14.181.3@KRBTEST.COM (short username oryx)
I20260809 20:12:10.765142 30127 webserver.cc:460] Webserver started at http://127.14.181.3:37585/ using document root <none> and password file <none>
I20260809 20:12:10.765936 30127 fs_manager.cc:359] Metadata directory not provided
I20260809 20:12:10.766069 30127 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:12:10.771173 30127 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 20:12:10.773628 30154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:10.774947 30127 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 20:12:10.775097 30127 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "d344ca7497154eac9ef5bdfe23ccf0de"
format_stamp: "Formatted at 2026-08-09 20:12:08 on dist-test-slave-6zbq"
server_key: "7466fe07dbbcafdffa78538f3b3f58b1"
server_key_iv: "009064371186321f17703a74c2a19a1d"
server_key_version: "encryptionkey@0"
I20260809 20:12:10.775978 30127 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:12:10.788534 30127 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:12:10.792255 30127 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:12:10.792482 30127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:12:10.793394 30127 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:12:10.794790 30127 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:12:10.794883 30127 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:10.794984 30127 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:12:10.795053 30127 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:10.833613 30127 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:43891
I20260809 20:12:10.833662 30353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:43891 every 8 connection(s)
I20260809 20:12:10.835168 30127 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:12:10.845032 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 30127
W20260809 20:12:10.865983 29893 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.122s user 0.003s sys 0.009s
W20260809 20:12:10.868170 29891 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:09.732461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:52447 (local address 127.14.181.62:40169)
0809 20:12:09.733167 (+ 706us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:09.733182 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:09.733429 (+ 247us) server_negotiation.cc:407] Connection header received
0809 20:12:09.735526 (+ 2097us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:09.735547 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:09.736027 (+ 480us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:09.736415 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:09.737848 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:09.739630 (+ 1782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:09.741340 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:09.742322 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:09.742546 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:10.867232 (+1124686us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.1:52447: BlockingRecv error: recv got EOF from 127.14.181.1:52447 (error 108)
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":240,"threads_started":1}
I20260809 20:12:10.868211 29893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:09.732511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.1:52447)
0809 20:12:09.733268 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:09.733316 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:09.734960 (+ 1644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:09.736527 (+ 1567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:09.736536 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:09.737090 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:09.737634 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:09.737653 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:09.739787 (+ 2134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:09.739791 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:09.741161 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:09.741176 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:09.742567 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:09.742573 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:09.742778 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:09.743435 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:09.743458 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:10.866815 (+1123357us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":313,"threads_started":1}
W20260809 20:12:10.869616 29889 heartbeater.cc:644] Failed to heartbeat to 127.14.181.62:40169 (0 consecutive failures): Not authorized: Failed to ping master at 127.14.181.62:40169: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Aug 09 20:12:10 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:10 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:10 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:10 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:10.886833 29893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:10.870372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.1:49319)
0809 20:12:10.870953 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:10.870974 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:10.871100 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:10.871587 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:10.871593 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:10.872073 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:10.872297 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:10.872308 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:10.874014 (+ 1706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:10.874020 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:10.875655 (+ 1635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:10.875671 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:10.876881 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:10.876888 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:10.877077 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:10.877660 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:10.877685 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:10.886548 (+ 8863us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":442}
W20260809 20:12:10.887089 29891 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:10.870728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:49319 (local address 127.14.181.62:40169)
0809 20:12:10.870912 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:10.870918 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:10.871092 (+ 174us) server_negotiation.cc:407] Connection header received
0809 20:12:10.871252 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:10.871258 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:10.871328 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:10.871412 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:10.872487 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:10.873820 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:10.875851 (+ 2031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:10.876503 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:10.876621 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:10.886784 (+ 10163us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.1:49319: BlockingRecv error: recv got EOF from 127.14.181.1:49319 (error 108)
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":68}
Aug 09 20:12:10 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:10 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:10.897753 30358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:10.845957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41030 (local address 127.14.181.62:40169)
0809 20:12:10.861832 (+ 15875us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:10.861838 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:10.862660 (+ 822us) server_negotiation.cc:407] Connection header received
0809 20:12:10.862741 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:10.862747 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:10.862850 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:10.862959 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:10.865409 (+ 2450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:10.868960 (+ 3551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:10.872467 (+ 3507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:10.873152 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:10.873283 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:10.876630 (+ 3347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:10.876641 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:10.876659 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:12:10.876724 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:10.887194 (+ 10470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:10.888008 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:10.888018 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:10.888027 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:10.888284 (+ 257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:10.894475 (+ 6191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:10.894482 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:10.894486 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:10.895199 (+ 713us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:10.895558 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:10.896932 (+ 1374us) server_negotiation.cc:299] Negotiation successful
0809 20:12:10.897329 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":15707,"thread_start_us":15579,"threads_started":1}
W20260809 20:12:10.900429 29891 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:10.888103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:56009 (local address 127.14.181.62:40169)
0809 20:12:10.888267 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:10.888273 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:10.888291 (+ 18us) server_negotiation.cc:407] Connection header received
0809 20:12:10.888340 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:10.888346 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:10.888414 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:10.888510 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:10.889482 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:10.890683 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:10.892601 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:10.893276 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:10.893392 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:10.900125 (+ 6733us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.1:56009: BlockingRecv error: recv got EOF from 127.14.181.1:56009 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 20:12:10.901139 29893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:10.887852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.1:56009)
0809 20:12:10.888005 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:10.888024 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:10.888111 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:10.888687 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:10.888692 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:10.889120 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:10.889318 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:10.889330 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:10.890832 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:10.890838 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:10.892453 (+ 1615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:10.892468 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:10.893427 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:10.893433 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:10.893625 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:10.894255 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:10.894277 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:10.900841 (+ 6564us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 20:12:10.901600 29889 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 20:12:11.295928 30126 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.100s user 0.006s sys 0.013s
W20260809 20:12:11.297333 30125 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:10.185152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:57267 (local address 127.14.181.62:40169)
0809 20:12:10.185569 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:10.185574 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:10.186795 (+ 1221us) server_negotiation.cc:407] Connection header received
0809 20:12:10.188535 (+ 1740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:10.188541 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:10.188615 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:10.188710 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:10.190065 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:10.191066 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:10.193575 (+ 2509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:10.194101 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:10.194236 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:11.296941 (+1102705us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.2:57267: BlockingRecv error: recv got EOF from 127.14.181.2:57267 (error 108)
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":215,"threads_started":1}
I20260809 20:12:11.297501 30126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:10.185858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.2:57267)
0809 20:12:10.186648 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:10.186689 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:10.188285 (+ 1596us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:10.188935 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:10.188942 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:10.189391 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:10.189905 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:10.189921 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:10.191258 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:10.191264 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:10.193398 (+ 2134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:10.193417 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:10.194369 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:10.194377 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:10.194703 (+ 326us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:10.195451 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:10.195483 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:11.296631 (+1101148us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":340,"threads_started":1}
W20260809 20:12:11.298429 30122 heartbeater.cc:644] Failed to heartbeat to 127.14.181.62:40169 (0 consecutive failures): Not authorized: Failed to ping master at 127.14.181.62:40169: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Aug 09 20:12:11 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:11 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:11.307859 30126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:11.299124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.2:37599)
0809 20:12:11.299329 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:11.299346 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:11.299456 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:11.299750 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:11.299754 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:11.300105 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:11.300275 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:11.300283 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:11.301284 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:11.301289 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:11.302432 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:11.302445 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:11.303470 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:11.303475 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:11.303596 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:11.304270 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:11.304288 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:11.307662 (+ 3374us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":87}
W20260809 20:12:11.308238 30125 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:11.299135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:37599 (local address 127.14.181.62:40169)
0809 20:12:11.299291 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:11.299297 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:11.299404 (+ 107us) server_negotiation.cc:407] Connection header received
0809 20:12:11.299560 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:11.299565 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:11.299632 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:11.299711 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:11.300409 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:11.301153 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:11.302573 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:11.303308 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:11.303449 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:11.307978 (+ 4529us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.2:37599: BlockingRecv error: recv got EOF from 127.14.181.2:37599 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 09 20:12:11 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:11 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:11.318461 30126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:11.308977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.2:40655)
0809 20:12:11.309223 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:11.309242 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:11.309354 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:11.309636 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:11.309641 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:11.310068 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:11.310288 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:11.310300 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:11.311244 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:11.311250 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:11.312866 (+ 1616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:11.312880 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:11.313547 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:11.313553 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:11.313780 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:11.314427 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:11.314452 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:11.318187 (+ 3735us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134}
W20260809 20:12:11.318626 30125 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:11.309106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:40655 (local address 127.14.181.62:40169)
0809 20:12:11.309229 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:11.309233 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:11.309288 (+ 55us) server_negotiation.cc:407] Connection header received
0809 20:12:11.309443 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:11.309447 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:11.309510 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:11.309582 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:11.310423 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:11.311128 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:11.313020 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:11.313415 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:11.313500 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:11.318396 (+ 4896us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.2:40655: BlockingRecv error: recv got EOF from 127.14.181.2:40655 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260809 20:12:11.318727 30122 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 20:12:11.856647 30357 sasl_common.cc:323] Time spent calling sasl_client_start(): real 0.988s user 0.008s sys 0.008s
W20260809 20:12:11.857693 30356 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:10.838098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:37825 (local address 127.14.181.62:40169)
0809 20:12:10.846092 (+ 7994us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:10.846101 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:10.850386 (+ 4285us) server_negotiation.cc:407] Connection header received
0809 20:12:10.850479 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:10.850486 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:10.850585 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:10.850688 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:10.862486 (+ 11798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:10.863784 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:10.866124 (+ 2340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:10.866761 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:10.866872 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:11.857512 (+990640us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.3:37825: BlockingRecv error: recv got EOF from 127.14.181.3:37825 (error 108)
Metrics: {"server-negotiator.queue_time_us":7784,"thread_start_us":11665,"threads_started":1}
I20260809 20:12:11.858177 30357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:10.838783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.3:37825)
0809 20:12:10.847266 (+ 8483us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:10.847321 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:10.850003 (+ 2682us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:10.859408 (+ 9405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:10.859422 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:10.860290 (+ 868us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:10.861216 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:10.861243 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:10.863969 (+ 2726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:10.863975 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:10.865945 (+ 1970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:10.865962 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:10.867238 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:10.867246 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:10.867530 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:10.868239 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:10.868270 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:11.857325 (+989055us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":7590,"thread_start_us":10946,"threads_started":1}
W20260809 20:12:11.859108 30354 heartbeater.cc:644] Failed to heartbeat to 127.14.181.62:40169 (0 consecutive failures): Not authorized: Failed to ping master at 127.14.181.62:40169: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Aug 09 20:12:11 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:11 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:11.870232 30357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:11.859737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.3:34705)
0809 20:12:11.859941 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:11.859961 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:11.860048 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:11.860372 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:11.860376 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:11.860762 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:11.860926 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:11.860935 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:11.861876 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:11.861879 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:11.862876 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:11.862889 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:11.863534 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:11.863538 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:11.863652 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:11.866964 (+ 3312us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:11.866982 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:11.870026 (+ 3044us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":64}
W20260809 20:12:11.870411 30356 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:11.859805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:34705 (local address 127.14.181.62:40169)
0809 20:12:11.859977 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:11.859982 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:11.860011 (+ 29us) server_negotiation.cc:407] Connection header received
0809 20:12:11.860170 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:11.860175 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:11.860245 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:11.860334 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:11.861057 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:11.861767 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:11.862988 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:11.863407 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:11.863500 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:11.870197 (+ 6697us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.3:34705: BlockingRecv error: recv got EOF from 127.14.181.3:34705 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 09 20:12:11 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:11 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:11.878400 30357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:11.870902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.3:53821)
0809 20:12:11.871059 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:11.871078 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:11.871157 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:11.871539 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:11.871544 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:11.871844 (+ 300us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:11.872034 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:11.872044 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:11.873054 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:11.873058 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:11.873965 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:11.873976 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:11.874619 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:11.874623 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:11.874766 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:11.875265 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:11.875281 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:11.878174 (+ 2893us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 20:12:11.878615 30356 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:11.871052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:53821 (local address 127.14.181.62:40169)
0809 20:12:11.871249 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:11.871254 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:11.871280 (+ 26us) server_negotiation.cc:407] Connection header received
0809 20:12:11.871324 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:11.871328 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:11.871403 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:11.871491 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:11.872156 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:11.872930 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:11.874067 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:11.874512 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:11.874599 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:11.878366 (+ 3767us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.3:53821: BlockingRecv error: recv got EOF from 127.14.181.3:53821 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
W20260809 20:12:11.878746 30354 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 09 20:12:11 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:11 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:11.910449 30361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:11.902094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.1:52589)
0809 20:12:11.902570 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:11.902586 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:11.902691 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:11.902936 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:11.902939 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:11.903352 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:11.903496 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:11.903504 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:11.904412 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:11.904416 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:11.905351 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:11.905362 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:11.906045 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:11.906051 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:11.906215 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:11.906821 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:11.906838 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:11.910110 (+ 3272us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":269,"threads_started":1}
W20260809 20:12:11.910558 30356 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:11.902170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:52589 (local address 127.14.181.62:40169)
0809 20:12:11.902404 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:11.902410 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:11.902652 (+ 242us) server_negotiation.cc:407] Connection header received
0809 20:12:11.902771 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:11.902774 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:11.902835 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:11.902908 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:11.903614 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:11.904304 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:11.905449 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:11.905889 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:11.906015 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:11.910312 (+ 4297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.1:52589: BlockingRecv error: recv got EOF from 127.14.181.1:52589 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 09 20:12:12 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:12 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:12.327903 30364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:12.319283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.2:43161)
0809 20:12:12.319804 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:12.319819 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:12.319934 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:12.320194 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:12.320197 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:12.320656 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:12.320814 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:12.320823 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:12.321925 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:12.321930 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:12.322932 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:12.322946 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:12.323677 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:12.323684 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:12.323837 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:12.324412 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:12.324429 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:12.327565 (+ 3136us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":289,"threads_started":1}
W20260809 20:12:12.328001 30356 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:12.319432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:43161 (local address 127.14.181.62:40169)
0809 20:12:12.319609 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:12.319614 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:12.319885 (+ 271us) server_negotiation.cc:407] Connection header received
0809 20:12:12.320020 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:12.320023 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:12.320084 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:12.320161 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:12.320965 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:12.321767 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:12.323076 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:12.323495 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:12.323602 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:12.327782 (+ 4180us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.2:43161: BlockingRecv error: recv got EOF from 127.14.181.2:43161 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 09 20:12:12 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:12 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:12.887980 30365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:12.879239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.3:59789)
0809 20:12:12.879842 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:12.879858 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:12.879965 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:12.880234 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:12.880237 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:12.880631 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:12.880780 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:12.880789 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:12.881750 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:12.881753 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:12.882737 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:12.882749 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:12.883451 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:12.883455 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:12.883568 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:12.884074 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:12.884090 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:12.887662 (+ 3572us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":359,"threads_started":1}
W20260809 20:12:12.888116 30366 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:12.879306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:59789 (local address 127.14.181.62:40169)
0809 20:12:12.879851 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:12.879856 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:12.879921 (+ 65us) server_negotiation.cc:407] Connection header received
0809 20:12:12.880048 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:12.880052 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:12.880111 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:12.880194 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:12.880910 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:12.881655 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:12.882869 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:12.883320 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:12.883411 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:12.887876 (+ 4465us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.3:59789: BlockingRecv error: recv got EOF from 127.14.181.3:59789 (error 108)
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":295,"threads_started":1}
Aug 09 20:12:12 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:12 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:12.919000 30367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:12.911294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.1:52655)
0809 20:12:12.911712 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:12.911728 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:12.911833 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:12.912072 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:12.912075 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:12.912432 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:12.912605 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:12.912615 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:12.913473 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:12.913477 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:12.914417 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:12.914432 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:12.915058 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:12.915061 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:12.915177 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:12.915649 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:12.915666 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:12.918757 (+ 3091us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":223,"threads_started":1}
W20260809 20:12:12.919106 30366 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:12.911334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:52655 (local address 127.14.181.62:40169)
0809 20:12:12.911522 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:12.911529 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:12.911800 (+ 271us) server_negotiation.cc:407] Connection header received
0809 20:12:12.911913 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:12.911916 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:12.911972 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:12.912044 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:12.912705 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:12.913377 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:12.914519 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:12.914949 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:12.915037 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:12.918920 (+ 3883us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.1:52655: BlockingRecv error: recv got EOF from 127.14.181.1:52655 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 09 20:12:13 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:13 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:13.337605 30370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:13.328876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.2:53381)
0809 20:12:13.329347 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:13.329362 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:13.329491 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:13.329797 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:13.329802 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:13.330207 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:13.330429 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:13.330439 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:13.331422 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:13.331426 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:13.332326 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:13.332338 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:13.333013 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:13.333019 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:13.333186 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:13.333838 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:13.333863 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:13.337255 (+ 3392us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":251,"threads_started":1}
W20260809 20:12:13.337697 30366 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:13.328949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:53381 (local address 127.14.181.62:40169)
0809 20:12:13.329142 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:13.329148 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:13.329445 (+ 297us) server_negotiation.cc:407] Connection header received
0809 20:12:13.329602 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:13.329608 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:13.329673 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:13.329752 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:13.330565 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:13.331288 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:13.332458 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:13.332870 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:13.332979 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:13.337455 (+ 4476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.2:53381: BlockingRecv error: recv got EOF from 127.14.181.2:53381 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 09 20:12:13 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:13 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:13.896931 30371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:13.888761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.3:57503)
0809 20:12:13.889215 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:13.889230 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:13.889341 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:13.889762 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:13.889765 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:13.890131 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:13.890324 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:13.890333 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:13.891317 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:13.891321 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:13.892213 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:13.892223 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:13.892790 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:13.892794 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:13.892910 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:13.893424 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:13.893440 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:13.896617 (+ 3177us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":241,"threads_started":1}
W20260809 20:12:13.897212 30372 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:13.888930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:57503 (local address 127.14.181.62:40169)
0809 20:12:13.889517 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:13.889521 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:13.889537 (+ 16us) server_negotiation.cc:407] Connection header received
0809 20:12:13.889589 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:13.889593 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:13.889650 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:13.889735 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:13.890455 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:13.891192 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:13.892314 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:13.892685 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:13.892770 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:13.896844 (+ 4074us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.3:57503: BlockingRecv error: recv got EOF from 127.14.181.3:57503 (error 108)
Metrics: {"server-negotiator.queue_time_us":499,"thread_start_us":364,"threads_started":1}
Aug 09 20:12:13 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:13 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:13.927774 30373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:13.919927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.1:49837)
0809 20:12:13.920458 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:13.920478 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:13.920584 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:13.920897 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:13.920903 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:13.921360 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:13.921533 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:13.921542 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:13.922476 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:13.922480 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:13.923357 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:13.923366 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:13.923942 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:13.923946 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:13.924057 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:13.924523 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:13.924539 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:13.927545 (+ 3006us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":268,"threads_started":1}
W20260809 20:12:13.927879 30372 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:13.920006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:49837 (local address 127.14.181.62:40169)
0809 20:12:13.920197 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:13.920203 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:13.920554 (+ 351us) server_negotiation.cc:407] Connection header received
0809 20:12:13.920676 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:13.920679 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:13.920750 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:13.920850 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:13.921654 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:13.922382 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:13.923452 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:13.923845 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:13.923928 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:13.927692 (+ 3764us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.1:49837: BlockingRecv error: recv got EOF from 127.14.181.1:49837 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 09 20:12:14 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:14 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:14.347357 30374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:14.338574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.2:48923)
0809 20:12:14.339064 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:14.339080 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:14.339210 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:14.339537 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:14.339541 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:14.339931 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:14.340097 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:14.340106 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:14.341125 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:14.341131 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:14.342020 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:14.342032 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:14.342889 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:14.342894 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:14.343060 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:14.343601 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:14.343620 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:14.347125 (+ 3505us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":240,"threads_started":1}
W20260809 20:12:14.347564 30372 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:14.338648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:48923 (local address 127.14.181.62:40169)
0809 20:12:14.338834 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:14.338841 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:14.339156 (+ 315us) server_negotiation.cc:407] Connection header received
0809 20:12:14.339332 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:14.339336 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:14.339411 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:14.339490 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:14.340242 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:14.340968 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:14.342168 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:14.342744 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:14.342863 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:14.347322 (+ 4459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.2:48923: BlockingRecv error: recv got EOF from 127.14.181.2:48923 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 09 20:12:14 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:14 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:14.906049 30375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:14.897696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.3:50543)
0809 20:12:14.898378 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:14.898401 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:14.898529 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:14.898891 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:14.898895 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:14.899317 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:14.899506 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:14.899521 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:14.900480 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:14.900484 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:14.901410 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:14.901422 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:14.902018 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:14.902022 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:14.902145 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:14.902675 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:14.902692 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:14.905830 (+ 3138us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":244,"threads_started":1}
W20260809 20:12:14.906209 30376 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:14.897786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:50543 (local address 127.14.181.62:40169)
0809 20:12:14.898454 (+ 668us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:14.898458 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:14.898474 (+ 16us) server_negotiation.cc:407] Connection header received
0809 20:12:14.898650 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:14.898655 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:14.898732 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:14.898826 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:14.899649 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:14.900367 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:14.901526 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:14.901916 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:14.902002 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:14.906005 (+ 4003us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.3:50543: BlockingRecv error: recv got EOF from 127.14.181.3:50543 (error 108)
Metrics: {"server-negotiator.queue_time_us":576,"thread_start_us":455,"threads_started":1}
Aug 09 20:12:14 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:14 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:14.936430 30377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:14.928560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.1:59215)
0809 20:12:14.928978 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:14.928994 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:14.929093 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:14.929335 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:14.929338 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:14.929662 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:14.929829 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:14.929839 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:14.930743 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:14.930746 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:14.931713 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:14.931724 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:14.932308 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:14.932312 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:14.932428 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:14.932948 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:14.932965 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:14.936161 (+ 3196us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":206,"threads_started":1}
W20260809 20:12:14.936581 30376 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:14.928590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:59215 (local address 127.14.181.62:40169)
0809 20:12:14.928785 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:14.928791 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:14.929058 (+ 267us) server_negotiation.cc:407] Connection header received
0809 20:12:14.929171 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:14.929174 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:14.929228 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:14.929302 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:14.929926 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:14.930638 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:14.931814 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:14.932212 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:14.932295 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:14.936334 (+ 4039us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.1:59215: BlockingRecv error: recv got EOF from 127.14.181.1:59215 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 09 20:12:15 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:15 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:15.356797 30378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:15.348245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.2:37173)
0809 20:12:15.348764 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:15.348779 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:15.348905 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:15.349231 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:15.349235 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:15.349627 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:15.349794 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:15.349804 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:15.350846 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:15.350850 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:15.351857 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:15.351870 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:15.352565 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:15.352571 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:15.352739 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:15.353274 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:15.353291 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:15.356451 (+ 3160us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":283,"threads_started":1}
W20260809 20:12:15.356935 30376 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:15.348341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:37173 (local address 127.14.181.62:40169)
0809 20:12:15.348531 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:15.348538 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:15.348864 (+ 326us) server_negotiation.cc:407] Connection header received
0809 20:12:15.349015 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:15.349020 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:15.349094 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:15.349180 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:15.349934 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:15.350720 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:15.351997 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:15.352428 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:15.352537 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:15.356681 (+ 4144us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.2:37173: BlockingRecv error: recv got EOF from 127.14.181.2:37173 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 09 20:12:15 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:15 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:15.915174 30381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:15.906946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.3:40347)
0809 20:12:15.907455 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:15.907472 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:15.907580 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:15.907837 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:15.907839 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:15.908225 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:15.908390 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:15.908399 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:15.909374 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:15.909379 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:15.910378 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:15.910391 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:15.911004 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:15.911008 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:15.911138 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:15.911659 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:15.911675 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:15.914848 (+ 3173us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":267,"threads_started":1}
W20260809 20:12:15.915311 30384 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:15.907045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:40347 (local address 127.14.181.62:40169)
0809 20:12:15.907479 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:15.907483 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:15.907522 (+ 39us) server_negotiation.cc:407] Connection header received
0809 20:12:15.907665 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:15.907669 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:15.907728 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:15.907815 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:15.908497 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:15.909235 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:15.910501 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:15.910902 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:15.910991 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:15.915057 (+ 4066us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.3:40347: BlockingRecv error: recv got EOF from 127.14.181.3:40347 (error 108)
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":237,"threads_started":1}
Aug 09 20:12:15 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:15 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:15.945462 30385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:15.937392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.1:40717)
0809 20:12:15.937851 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:15.937867 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:15.937971 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:15.938206 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:15.938208 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:15.938668 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:15.938819 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:15.938829 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:15.939753 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:15.939757 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:15.940863 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:15.940876 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:15.941564 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:15.941569 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:15.941731 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:15.942248 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:15.942265 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:15.945236 (+ 2971us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":214,"threads_started":1}
W20260809 20:12:15.945611 30384 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:15.937449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:40717 (local address 127.14.181.62:40169)
0809 20:12:15.937620 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:15.937627 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:15.937933 (+ 306us) server_negotiation.cc:407] Connection header received
0809 20:12:15.938048 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:15.938052 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:15.938106 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:15.938177 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:15.938925 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:15.939637 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:15.940995 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:15.941417 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:15.941525 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:15.945403 (+ 3878us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.1:40717: BlockingRecv error: recv got EOF from 127.14.181.1:40717 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 09 20:12:16 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:16 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:16.366086 30387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:16.357654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.2:48843)
0809 20:12:16.358094 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:16.358109 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:16.358222 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:16.358522 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:16.358525 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:16.358924 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:16.359071 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:16.359079 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:16.359994 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:16.359998 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:16.360901 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:16.360911 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:16.361514 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:16.361518 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:16.361631 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:16.362179 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:16.362196 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:16.365785 (+ 3589us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":224,"threads_started":1}
W20260809 20:12:16.366227 30384 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:16.357823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:48843 (local address 127.14.181.62:40169)
0809 20:12:16.358019 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:16.358025 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:16.358171 (+ 146us) server_negotiation.cc:407] Connection header received
0809 20:12:16.358325 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:16.358329 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:16.358420 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:16.358493 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:16.359188 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:16.359901 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:16.361003 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:16.361415 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:16.361501 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:16.365991 (+ 4490us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.2:48843: BlockingRecv error: recv got EOF from 127.14.181.2:48843 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 09 20:12:16 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:16 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:16.928993 30388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:16.916030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.3:37461)
0809 20:12:16.916518 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:16.916534 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:16.916631 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:16.917007 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:16.917010 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:16.917406 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:16.917549 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:16.917556 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:16.918480 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:16.918484 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:16.919391 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:16.919401 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:16.920002 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:16.920006 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:16.920123 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:16.925157 (+ 5034us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:16.925178 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:16.928680 (+ 3502us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":226,"threads_started":1}
W20260809 20:12:16.929169 30389 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:16.916139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:37461 (local address 127.14.181.62:40169)
0809 20:12:16.916766 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:16.916771 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:16.916786 (+ 15us) server_negotiation.cc:407] Connection header received
0809 20:12:16.916829 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:16.916832 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:16.916895 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:16.916979 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:16.917658 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:16.918379 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:16.919495 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:16.919901 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:16.919989 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:16.928916 (+ 8927us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.3:37461: BlockingRecv error: recv got EOF from 127.14.181.3:37461 (error 108)
Metrics: {"server-negotiator.queue_time_us":540,"thread_start_us":432,"threads_started":1}
Aug 09 20:12:16 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:16 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:16.954144 30391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:16.946195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.1:36223)
0809 20:12:16.946652 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:16.946668 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:16.946772 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:16.947035 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:16.947038 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:16.947417 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:16.947584 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:16.947592 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:16.948500 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:16.948504 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:16.949502 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:16.949520 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:16.950335 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:16.950361 (+ 26us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:16.950514 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:16.950961 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:16.950977 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:16.953929 (+ 2952us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":234,"threads_started":1}
W20260809 20:12:16.954274 30389 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:16.946273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:36223 (local address 127.14.181.62:40169)
0809 20:12:16.946416 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:16.946420 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:16.946726 (+ 306us) server_negotiation.cc:407] Connection header received
0809 20:12:16.946864 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:16.946868 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:16.946925 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:16.946997 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:16.947690 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:16.948388 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:16.949641 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:16.950175 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:16.950292 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:16.954088 (+ 3796us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.1:36223: BlockingRecv error: recv got EOF from 127.14.181.1:36223 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 09 20:12:17 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:17 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:17.375121 30393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:17.366910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.2:56465)
0809 20:12:17.367362 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:17.367378 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:17.367489 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:17.367778 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:17.367782 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:17.368167 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:17.368347 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:17.368355 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:17.369285 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:17.369289 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:17.370186 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:17.370197 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:17.370885 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:17.370890 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:17.371018 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:17.371628 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:17.371652 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:17.374898 (+ 3246us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":234,"threads_started":1}
W20260809 20:12:17.375299 30389 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:17.366978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:56465 (local address 127.14.181.62:40169)
0809 20:12:17.367124 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:17.367130 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:17.367452 (+ 322us) server_negotiation.cc:407] Connection header received
0809 20:12:17.367589 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:17.367593 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:17.367667 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:17.367739 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:17.368468 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:17.369185 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:17.370313 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:17.370739 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:17.370830 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:17.375068 (+ 4238us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.2:56465: BlockingRecv error: recv got EOF from 127.14.181.2:56465 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 09 20:12:17 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:17 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:17.938126 30394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:17.929763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.3:54589)
0809 20:12:17.930216 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:17.930233 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:17.930355 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:17.930614 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:17.930617 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:17.931001 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:17.931173 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:17.931182 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:17.932075 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:17.932078 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:17.933132 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:17.933149 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:17.934056 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:17.934064 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:17.934199 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:17.934707 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:17.934724 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:17.937903 (+ 3179us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":226,"threads_started":1}
W20260809 20:12:17.938364 30395 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:17.929823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:54589 (local address 127.14.181.62:40169)
0809 20:12:17.930267 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:17.930272 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:17.930287 (+ 15us) server_negotiation.cc:407] Connection header received
0809 20:12:17.930443 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:17.930447 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:17.930504 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:17.930584 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:17.931276 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:17.931979 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:17.933280 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:17.933904 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:17.934016 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:17.938121 (+ 4105us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.3:54589: BlockingRecv error: recv got EOF from 127.14.181.3:54589 (error 108)
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":244,"threads_started":1}
Aug 09 20:12:17 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:17 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:17.963102 30398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:17.954959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.1:51241)
0809 20:12:17.955483 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:17.955498 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:17.955615 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:17.955920 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:17.955926 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:17.956406 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:17.956623 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:17.956636 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:17.957702 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:17.957706 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:17.958684 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:17.958695 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:17.959289 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:17.959293 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:17.959404 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:17.959849 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:17.959865 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:17.962775 (+ 2910us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":221,"threads_started":1}
W20260809 20:12:17.963171 30395 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:17.954997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:51241 (local address 127.14.181.62:40169)
0809 20:12:17.955135 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:17.955139 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:17.955577 (+ 438us) server_negotiation.cc:407] Connection header received
0809 20:12:17.955713 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:17.955718 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:17.955792 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:17.955887 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:17.956758 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:17.957582 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:17.958802 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:17.959182 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:17.959269 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:17.962968 (+ 3699us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.1:51241: BlockingRecv error: recv got EOF from 127.14.181.1:51241 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 09 20:12:18 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:18 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:18.384649 30402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:18.375930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.2:39619)
0809 20:12:18.376484 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:18.376500 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:18.376614 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:18.376879 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:18.376882 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:18.377295 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:18.377478 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:18.377487 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:18.378519 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:18.378523 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:18.379695 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:18.379712 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:18.380484 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:18.380491 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:18.380644 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:18.381222 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:18.381240 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:18.384412 (+ 3172us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":268,"threads_started":1}
W20260809 20:12:18.384773 30395 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:18.375986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:39619 (local address 127.14.181.62:40169)
0809 20:12:18.376180 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:18.376185 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:18.376565 (+ 380us) server_negotiation.cc:407] Connection header received
0809 20:12:18.376699 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:18.376702 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:18.376775 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:18.376860 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:18.377584 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:18.378381 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:18.379839 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:18.380317 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:18.380447 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:18.384578 (+ 4131us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.2:39619: BlockingRecv error: recv got EOF from 127.14.181.2:39619 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
Aug 09 20:12:18 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:18 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:18.947728 30405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:18.939013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.3:59073)
0809 20:12:18.939608 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:18.939624 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:18.939736 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:18.940007 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:18.940010 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:18.940417 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:18.940585 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:18.940594 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:18.941537 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:18.941540 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:18.942651 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:18.942665 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:18.943488 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:18.943494 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:18.943662 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:18.944201 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:18.944218 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:18.947509 (+ 3291us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":309,"threads_started":1}
W20260809 20:12:18.947988 30404 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:18.939085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:59073 (local address 127.14.181.62:40169)
0809 20:12:18.939563 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:18.939568 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:18.939690 (+ 122us) server_negotiation.cc:407] Connection header received
0809 20:12:18.939826 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:18.939830 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:18.939891 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:18.939978 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:18.940691 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:18.941432 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:18.942767 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:18.943335 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:18.943444 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:18.947735 (+ 4291us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.3:59073: BlockingRecv error: recv got EOF from 127.14.181.3:59073 (error 108)
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":256,"threads_started":1}
Aug 09 20:12:18 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:18 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:18.972199 30406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:18.963920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.1:52047)
0809 20:12:18.964411 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:18.964427 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:18.964549 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:18.964847 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:18.964853 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:18.965244 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:18.965436 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:18.965446 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:18.966580 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:18.966585 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:18.967549 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:18.967562 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:18.968289 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:18.968295 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:18.968425 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:18.968904 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:18.968920 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:18.971875 (+ 2955us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":245,"threads_started":1}
W20260809 20:12:18.972266 30404 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:18.964073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:52047 (local address 127.14.181.62:40169)
0809 20:12:18.964252 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:18.964258 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:18.964500 (+ 242us) server_negotiation.cc:407] Connection header received
0809 20:12:18.964650 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:18.964655 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:18.964712 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:18.964801 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:18.965569 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:18.966441 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:18.967684 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:18.968111 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:18.968216 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:18.972073 (+ 3857us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.1:52047: BlockingRecv error: recv got EOF from 127.14.181.1:52047 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 09 20:12:19 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:19 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:19.394500 30407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:19.385529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.2:40115)
0809 20:12:19.386008 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:19.386023 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:19.386154 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:19.386502 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:19.386507 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:19.386933 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:19.387102 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:19.387111 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:19.388534 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:19.388538 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:19.389673 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:19.389688 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:19.390380 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:19.390384 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:19.390499 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:19.391003 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:19.391020 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:19.394150 (+ 3130us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":231,"threads_started":1}
W20260809 20:12:19.394626 30404 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:19.385654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:40115 (local address 127.14.181.62:40169)
0809 20:12:19.385850 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:19.385856 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:19.386120 (+ 264us) server_negotiation.cc:407] Connection header received
0809 20:12:19.386268 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:19.386274 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:19.386369 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:19.386450 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:19.387241 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:19.388375 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:19.389804 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:19.390227 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:19.390320 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:19.394380 (+ 4060us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.2:40115: BlockingRecv error: recv got EOF from 127.14.181.2:40115 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 09 20:12:19 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:19 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:19.957293 30408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:19.948694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.3:38067)
0809 20:12:19.949188 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:19.949206 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:19.949311 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:19.949729 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:19.949731 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:19.950140 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:19.950302 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:19.950311 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:19.951272 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:19.951275 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:19.952190 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:19.952201 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:19.952863 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:19.952867 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:19.952981 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:19.953602 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:19.953626 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:19.957039 (+ 3413us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":252,"threads_started":1}
W20260809 20:12:19.957441 30411 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:19.948760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:38067 (local address 127.14.181.62:40169)
0809 20:12:19.949486 (+ 726us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:19.949490 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:19.949505 (+ 15us) server_negotiation.cc:407] Connection header received
0809 20:12:19.949548 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:19.949552 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:19.949617 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:19.949702 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:19.950448 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:19.951167 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:19.952313 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:19.952731 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:19.952820 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:19.957218 (+ 4398us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.3:38067: BlockingRecv error: recv got EOF from 127.14.181.3:38067 (error 108)
Metrics: {"server-negotiator.queue_time_us":637,"thread_start_us":505,"threads_started":1}
Aug 09 20:12:19 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:19 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:19.981642 30415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:19.973033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.1:46195)
0809 20:12:19.973464 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:19.973479 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:19.973581 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:19.973823 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:19.973826 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:19.974182 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:19.974317 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:19.974325 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:19.975410 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:19.975415 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:19.976359 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:19.976371 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:19.977190 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:19.977205 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:19.977501 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:19.978098 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:19.978119 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:19.981343 (+ 3224us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":226,"threads_started":1}
W20260809 20:12:19.981721 30411 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:19.973086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:46195 (local address 127.14.181.62:40169)
0809 20:12:19.973277 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:19.973282 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:19.973545 (+ 263us) server_negotiation.cc:407] Connection header received
0809 20:12:19.973661 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:19.973664 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:19.973717 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:19.973788 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:19.974493 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:19.975263 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:19.976499 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:19.977012 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:19.977134 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:19.981517 (+ 4383us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.1:46195: BlockingRecv error: recv got EOF from 127.14.181.1:46195 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 09 20:12:20 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:20 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:20.403891 30416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:20.395370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.2:55937)
0809 20:12:20.395853 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:20.395867 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:20.395993 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:20.396324 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:20.396328 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:20.396726 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:20.396872 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:20.396882 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:20.397845 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:20.397850 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:20.398830 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:20.398842 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:20.399530 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:20.399536 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:20.399701 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:20.400234 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:20.400252 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:20.403664 (+ 3412us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":259,"threads_started":1}
W20260809 20:12:20.404063 30411 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:20.395436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:55937 (local address 127.14.181.62:40169)
0809 20:12:20.395621 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:20.395628 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:20.395945 (+ 317us) server_negotiation.cc:407] Connection header received
0809 20:12:20.396102 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:20.396106 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:20.396181 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:20.396263 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:20.397010 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:20.397711 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:20.398965 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:20.399389 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:20.399498 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:20.403840 (+ 4342us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.2:55937: BlockingRecv error: recv got EOF from 127.14.181.2:55937 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 09 20:12:20 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:20 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:20.967064 30417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:20.958190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.3:54879)
0809 20:12:20.958711 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:20.958727 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:20.958839 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:20.959456 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:20.959460 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:20.959864 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:20.960039 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:20.960048 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:20.961064 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:20.961068 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:20.962005 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:20.962016 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:20.962670 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:20.962674 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:20.962806 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:20.963330 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:20.963346 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:20.966838 (+ 3492us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":275,"threads_started":1}
W20260809 20:12:20.967233 30418 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:20.958245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:54879 (local address 127.14.181.62:40169)
0809 20:12:20.959190 (+ 945us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:20.959195 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:20.959208 (+ 13us) server_negotiation.cc:407] Connection header received
0809 20:12:20.959249 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:20.959253 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:20.959318 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:20.959400 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:20.960177 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:20.960932 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:20.962106 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:20.962557 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:20.962646 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:20.967018 (+ 4372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.3:54879: BlockingRecv error: recv got EOF from 127.14.181.3:54879 (error 108)
Metrics: {"server-negotiator.queue_time_us":852,"thread_start_us":725,"threads_started":1}
Aug 09 20:12:20 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:20 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:20.990293 30419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:20.982461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.1:38725)
0809 20:12:20.982879 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:20.982895 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:20.982997 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:20.983233 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:20.983236 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:20.983561 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:20.983709 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:20.983718 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:20.984605 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:20.984608 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:20.985547 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:20.985557 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:20.986132 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:20.986136 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:20.986243 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:20.986726 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:20.986742 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:20.990060 (+ 3318us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":218,"threads_started":1}
W20260809 20:12:20.990415 30418 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:20.982498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:38725 (local address 127.14.181.62:40169)
0809 20:12:20.982661 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:20.982667 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:20.982964 (+ 297us) server_negotiation.cc:407] Connection header received
0809 20:12:20.983076 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:20.983079 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:20.983132 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:20.983203 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:20.983817 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:20.984508 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:20.985644 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:20.986030 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:20.986112 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:20.990213 (+ 4101us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.1:38725: BlockingRecv error: recv got EOF from 127.14.181.1:38725 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 09 20:12:21 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:21 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:21.412878 30420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:21.404666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.2:51525)
0809 20:12:21.405174 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:21.405190 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:21.405309 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:21.405579 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:21.405583 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:21.405941 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:21.406094 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:21.406102 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:21.407065 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:21.407069 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:21.408029 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:21.408039 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:21.408826 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:21.408830 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:21.408938 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:21.409434 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:21.409450 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:21.412641 (+ 3191us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":278,"threads_started":1}
W20260809 20:12:21.413144 30418 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:21.404737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:51525 (local address 127.14.181.62:40169)
0809 20:12:21.404889 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:21.404894 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:21.405256 (+ 362us) server_negotiation.cc:407] Connection header received
0809 20:12:21.405406 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:21.405410 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:21.405473 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:21.405552 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:21.406220 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:21.406945 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:21.408177 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:21.408711 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:21.408814 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:21.412827 (+ 4013us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.2:51525: BlockingRecv error: recv got EOF from 127.14.181.2:51525 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 09 20:12:21 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:21 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:21.980134 30421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:21.967861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.3:54129)
0809 20:12:21.968372 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:21.968388 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:21.968487 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:21.968742 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:21.968745 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:21.969100 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:21.969284 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:21.969293 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:21.970221 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:21.970224 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:21.971233 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:21.971245 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:21.971867 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:21.971871 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:21.971972 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:21.976236 (+ 4264us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:21.976255 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:21.979814 (+ 3559us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":292,"threads_started":1}
W20260809 20:12:21.980337 30422 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:21.968024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:54129 (local address 127.14.181.62:40169)
0809 20:12:21.968479 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:21.968484 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:21.968500 (+ 16us) server_negotiation.cc:407] Connection header received
0809 20:12:21.968575 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:21.968579 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:21.968636 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:21.968711 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:21.969394 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:21.970117 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:21.971340 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:21.971757 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:21.971854 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:21.980067 (+ 8213us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.3:54129: BlockingRecv error: recv got EOF from 127.14.181.3:54129 (error 108)
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":237,"threads_started":1}
Aug 09 20:12:21 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:21 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:21.999082 30423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:21.991216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.1:50757)
0809 20:12:21.991695 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:21.991711 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:21.991822 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:21.992069 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:21.992071 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:21.992454 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:21.992628 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:21.992636 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:21.993522 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:21.993526 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:21.994445 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:21.994457 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:21.995105 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:21.995109 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:21.995223 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:21.995725 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:21.995742 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:21.998873 (+ 3131us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":276,"threads_started":1}
W20260809 20:12:21.999303 30422 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:21.991308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:50757 (local address 127.14.181.62:40169)
0809 20:12:21.991445 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:21.991449 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:21.991775 (+ 326us) server_negotiation.cc:407] Connection header received
0809 20:12:21.991902 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:21.991905 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:21.991962 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:21.992040 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:21.992730 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:21.993428 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:21.994576 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:21.994989 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:21.995091 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:21.999057 (+ 3966us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.1:50757: BlockingRecv error: recv got EOF from 127.14.181.1:50757 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 09 20:12:22 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:22 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:22.422443 30425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:22.413908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.2:33319)
0809 20:12:22.414425 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:22.414443 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:22.414576 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:22.414895 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:22.414900 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:22.415391 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:22.415570 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:22.415580 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:22.416630 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:22.416636 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:22.417536 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:22.417548 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:22.418244 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:22.418249 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:22.418464 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:22.419024 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:22.419042 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:22.422191 (+ 3149us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":248,"threads_started":1}
W20260809 20:12:22.422605 30422 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:22.414006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:33319 (local address 127.14.181.62:40169)
0809 20:12:22.414190 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:22.414386 (+ 196us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:22.414519 (+ 133us) server_negotiation.cc:407] Connection header received
0809 20:12:22.414689 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:22.414694 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:22.414768 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:22.414849 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:22.415708 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:22.416510 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:22.417675 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:22.418102 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:22.418210 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:22.422385 (+ 4175us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.2:33319: BlockingRecv error: recv got EOF from 127.14.181.2:33319 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 09 20:12:22 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:22 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:22.989246 30428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:22.981007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.3:45013)
0809 20:12:22.981491 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:22.981507 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:22.981609 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:22.981880 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:22.981883 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:22.982275 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:22.982510 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:22.982520 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:22.983514 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:22.983518 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:22.984422 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:22.984433 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:22.985029 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:22.985033 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:22.985146 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:22.985666 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:22.985682 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:22.989009 (+ 3327us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":263,"threads_started":1}
W20260809 20:12:22.989372 30433 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:22.981074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:45013 (local address 127.14.181.62:40169)
0809 20:12:22.981533 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:22.981537 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:22.981554 (+ 17us) server_negotiation.cc:407] Connection header received
0809 20:12:22.981698 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:22.981702 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:22.981762 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:22.981847 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:22.982654 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:22.983413 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:22.984525 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:22.984923 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:22.985011 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:22.989180 (+ 4169us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.3:45013: BlockingRecv error: recv got EOF from 127.14.181.3:45013 (error 108)
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":252,"threads_started":1}
Aug 09 20:12:23 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:23 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:23.007576 30434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:22.999882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.1:55057)
0809 20:12:23.000418 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:23.000434 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:23.000537 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:23.000772 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:23.000775 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:23.001160 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:23.001332 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:23.001341 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:23.002208 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:23.002211 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:23.003161 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:23.003174 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:23.003808 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:23.003812 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:23.003931 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:23.004426 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:23.004442 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:23.007346 (+ 2904us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":275,"threads_started":1}
W20260809 20:12:23.007669 30433 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:22.999913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:55057 (local address 127.14.181.62:40169)
0809 20:12:23.000062 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:23.000067 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:23.000491 (+ 424us) server_negotiation.cc:407] Connection header received
0809 20:12:23.000612 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:23.000616 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:23.000669 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:23.000741 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:23.001437 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:23.002106 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:23.003278 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:23.003672 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:23.003759 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:23.007510 (+ 3751us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.1:55057: BlockingRecv error: recv got EOF from 127.14.181.1:55057 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 09 20:12:23 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:23 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:23.431600 30435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:23.423349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.2:37669)
0809 20:12:23.423873 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:23.423888 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:23.424000 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:23.424354 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:23.424357 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:23.424749 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:23.424924 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:23.424932 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:23.425885 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:23.425888 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:23.426813 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:23.426825 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:23.427489 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:23.427494 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:23.427623 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:23.428137 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:23.428155 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:23.431368 (+ 3213us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":265,"threads_started":1}
W20260809 20:12:23.431797 30433 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:23.423382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:37669 (local address 127.14.181.62:40169)
0809 20:12:23.423564 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:23.423569 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:23.423961 (+ 392us) server_negotiation.cc:407] Connection header received
0809 20:12:23.424146 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:23.424152 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:23.424226 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:23.424311 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:23.425027 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:23.425776 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:23.426945 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:23.427360 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:23.427451 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:23.431552 (+ 4101us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.2:37669: BlockingRecv error: recv got EOF from 127.14.181.2:37669 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 09 20:12:23 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:23 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:24.000756 30437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:23.990106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.3:46391)
0809 20:12:23.992102 (+ 1996us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:23.992120 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:23.992225 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:23.992887 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:23.992892 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:23.993309 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:23.993486 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:23.993495 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:23.994562 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:23.994567 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:23.995489 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:23.995501 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:23.996227 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:23.996233 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:23.996401 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:23.996977 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:23.996996 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:24.000425 (+ 3429us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1876,"thread_start_us":1727,"threads_started":1}
W20260809 20:12:24.000882 30438 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:23.990178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:46391 (local address 127.14.181.62:40169)
0809 20:12:23.992586 (+ 2408us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:23.992590 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:23.992604 (+ 14us) server_negotiation.cc:407] Connection header received
0809 20:12:23.992645 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:23.992649 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:23.992711 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:23.992803 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:23.993634 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:23.994418 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:23.995633 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:23.996054 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:23.996161 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:24.000623 (+ 4462us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.3:46391: BlockingRecv error: recv got EOF from 127.14.181.3:46391 (error 108)
Metrics: {"server-negotiator.queue_time_us":2317,"thread_start_us":2206,"threads_started":1}
Aug 09 20:12:24 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:24 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:24.016714 30440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:24.008360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.1:56849)
0809 20:12:24.008794 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:24.008810 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:24.008916 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:24.009147 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:24.009150 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:24.009518 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:24.009668 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:24.009677 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:24.010562 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:24.010566 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:24.011746 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:24.011764 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:24.012663 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:24.012668 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:24.012799 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:24.013300 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:24.013317 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:24.016462 (+ 3145us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":230,"threads_started":1}
W20260809 20:12:24.016840 30438 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:24.008412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:56849 (local address 127.14.181.62:40169)
0809 20:12:24.008558 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:24.008562 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:24.008869 (+ 307us) server_negotiation.cc:407] Connection header received
0809 20:12:24.008989 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:24.008993 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:24.009046 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:24.009117 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:24.009770 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:24.010449 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:24.011931 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:24.012525 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:24.012626 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:24.016661 (+ 4035us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.1:56849: BlockingRecv error: recv got EOF from 127.14.181.1:56849 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 09 20:12:24 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:24 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:24.440869 30441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:24.432390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.2:36261)
0809 20:12:24.432839 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:24.432857 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:24.432986 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:24.433310 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:24.433315 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:24.433730 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:24.433885 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:24.433894 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:24.434924 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:24.434930 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:24.435988 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:24.436002 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:24.436761 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:24.436766 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:24.436935 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:24.437478 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:24.437496 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:24.440645 (+ 3149us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":235,"threads_started":1}
W20260809 20:12:24.441035 30438 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:24.432600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:36261 (local address 127.14.181.62:40169)
0809 20:12:24.432792 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:24.432808 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:24.432937 (+ 129us) server_negotiation.cc:407] Connection header received
0809 20:12:24.433096 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:24.433101 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:24.433175 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:24.433253 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:24.434024 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:24.434786 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:24.436121 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:24.436628 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:24.436733 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:24.440829 (+ 4096us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.2:36261: BlockingRecv error: recv got EOF from 127.14.181.2:36261 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 09 20:12:25 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:25 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.3@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:25.010180 30442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:25.001708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.3:52605)
0809 20:12:25.002175 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:25.002192 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:25.002307 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:25.002592 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:25.002595 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:25.002977 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:25.003133 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:25.003141 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:25.004069 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:25.004072 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:25.004963 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:25.004974 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:25.005594 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:25.005598 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:25.005718 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:25.006319 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:25.006361 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:25.009887 (+ 3526us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":232,"threads_started":1}
W20260809 20:12:25.010383 30443 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:25.001778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:52605 (local address 127.14.181.62:40169)
0809 20:12:25.002205 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:25.002209 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:25.002242 (+ 33us) server_negotiation.cc:407] Connection header received
0809 20:12:25.002428 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:25.002432 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:25.002498 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:25.002574 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:25.003240 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:25.003962 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:25.005068 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:25.005480 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:25.005566 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:25.010102 (+ 4536us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.3:52605: BlockingRecv error: recv got EOF from 127.14.181.3:52605 (error 108)
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":232,"threads_started":1}
Aug 09 20:12:25 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:25 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.1@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:25.026182 30444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:25.017712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.1:59545)
0809 20:12:25.018281 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:25.018297 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:25.018428 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:25.018681 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:25.018684 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:25.019033 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:25.019274 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:25.019290 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:25.020513 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:25.020518 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:25.021489 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:25.021501 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:25.022112 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:25.022115 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:25.022236 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:25.022766 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:25.022782 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:25.025858 (+ 3076us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":340,"threads_started":1}
W20260809 20:12:25.026300 30443 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:25.017781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:59545 (local address 127.14.181.62:40169)
0809 20:12:25.018032 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:25.018036 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:25.018371 (+ 335us) server_negotiation.cc:407] Connection header received
0809 20:12:25.018527 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:25.018531 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:25.018587 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:25.018652 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:25.019437 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:25.020352 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:25.021624 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:25.022010 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:25.022098 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:25.026061 (+ 3963us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.1:59545: BlockingRecv error: recv got EOF from 127.14.181.1:59545 (error 108)
Metrics: {"server-negotiator.queue_time_us":164}
Aug 09 20:12:25 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
Aug 09 20:12:25 dist-test-slave-6zbq krb5kdc[28675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.14.181.2@KRBTEST.COM for oryx/127.14.181.62@KRBTEST.COM, Server not found in Kerberos database
I20260809 20:12:25.449838 30447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:25.442008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40169 (local address 127.14.181.2:54699)
0809 20:12:25.442439 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:25.442454 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:25.442557 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:25.442817 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:25.442820 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:25.443188 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:25.443370 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:25.443379 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:25.444268 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:25.444271 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:25.445164 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:25.445175 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:25.445770 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:25.445775 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:25.445909 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:25.446466 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:25.446482 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:25.449589 (+ 3107us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.14.181.62:40169: Server oryx/127.14.181.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":198,"threads_started":1}
W20260809 20:12:25.449990 30443 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:25.442059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:54699 (local address 127.14.181.62:40169)
0809 20:12:25.442243 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:25.442249 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:25.442509 (+ 260us) server_negotiation.cc:407] Connection header received
0809 20:12:25.442635 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:25.442638 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:25.442710 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:25.442787 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:25.443479 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:25.444163 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:25.445262 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:25.445656 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:25.445746 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:25.449770 (+ 4024us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.14.181.2:54699: BlockingRecv error: recv got EOF from 127.14.181.2:54699 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 20:12:25.853813 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 29638
I20260809 20:12:25.865242 30450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:25.854783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51782 (local address 127.14.181.1:33107)
0809 20:12:25.855431 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:25.855439 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:25.855464 (+ 25us) server_negotiation.cc:407] Connection header received
0809 20:12:25.855525 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:25.855531 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:25.855757 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:25.855923 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:25.857253 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:25.858300 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:25.859422 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:25.859953 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:25.860046 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:25.862236 (+ 2190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:25.862244 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:25.862257 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:12:25.862315 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:25.864760 (+ 2445us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.14.181.1@KRBTEST.COM not found in keytab (ticket kvno 2)
0809 20:12:25.865038 (+ 278us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51782: Request ticket server kudu/127.14.181.1@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":338,"threads_started":1}
W20260809 20:12:25.865302 15060 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 29638: Not authorized: Client connection negotiation failed: client connection to 127.14.181.1:33107: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.14.181.1@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260809 20:12:25.865345 30450 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51782: Request ticket server kudu/127.14.181.1@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260809 20:12:25.865478 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 29638
I20260809 20:12:25.887571 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 29896
I20260809 20:12:25.898828 30451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:25.888472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37762 (local address 127.14.181.2:42765)
0809 20:12:25.889053 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:25.889062 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:25.889122 (+ 60us) server_negotiation.cc:407] Connection header received
0809 20:12:25.889198 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:25.889206 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:25.889512 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:25.889699 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:25.890904 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:25.892078 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:25.893191 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:25.893724 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:25.893818 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:25.896032 (+ 2214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:25.896040 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:25.896051 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:12:25.896090 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:25.898310 (+ 2220us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.14.181.2@KRBTEST.COM not found in keytab (ticket kvno 2)
0809 20:12:25.898601 (+ 291us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37762: Request ticket server kudu/127.14.181.2@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":226,"threads_started":1}
W20260809 20:12:25.898911 30451 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37762: Request ticket server kudu/127.14.181.2@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260809 20:12:25.898902 15060 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 29896: Not authorized: Client connection negotiation failed: client connection to 127.14.181.2:42765: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.14.181.2@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260809 20:12:25.899020 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 29896
I20260809 20:12:25.931049 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 30127
I20260809 20:12:25.942739 30452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:25.932010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49442 (local address 127.14.181.3:43891)
0809 20:12:25.932600 (+ 590us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:25.932609 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:25.932639 (+ 30us) server_negotiation.cc:407] Connection header received
0809 20:12:25.932709 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:25.932717 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:25.933009 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:25.933198 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:25.934472 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:25.935651 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:25.936820 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:25.937341 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:25.937438 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:25.939916 (+ 2478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:25.939924 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:25.939937 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:12:25.939988 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:25.942194 (+ 2206us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.14.181.3@KRBTEST.COM not found in keytab (ticket kvno 2)
0809 20:12:25.942505 (+ 311us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49442: Request ticket server kudu/127.14.181.3@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":250,"threads_started":1}
W20260809 20:12:25.942750 15060 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 30127: Not authorized: Client connection negotiation failed: client connection to 127.14.181.3:43891: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.14.181.3@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260809 20:12:25.942823 30452 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49442: Request ticket server kudu/127.14.181.3@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260809 20:12:25.942900 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 30127
I20260809 20:12:25.969059 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 29532
I20260809 20:12:25.970218 29626 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:12:26.085047 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 29532
2026-08-09T20:12:26Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (21198 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-09T20:12:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:12:26Z Disabled control of system clock
I20260809 20:12:26.168284 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:42441
--webserver_interface=127.14.181.62
--webserver_port=0
--builtin_ntp_servers=127.14.181.20:43137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:42441
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 20:12:26.473726 30459 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:12:26.473958 30459 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:12:26.474067 30459 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:12:26.480911 30459 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:12:26.480997 30459 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:12:26.481058 30459 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:12:26.481143 30459 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:12:26.481202 30459 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:12:26.489710 30459 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:43137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:42441
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:42441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:12:26.490808 30459 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:12:26.492395 30459 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:12:26.503134 30474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:26.503234 30473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:26.503144 30477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:12:26.504011 30459 server_base.cc:1034] running on GCE node
I20260809 20:12:26.504707 30459 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:12:26.505923 30459 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:12:26.507115 30459 hybrid_clock.cc:648] HybridClock initialized: now 1786306346507067 us; error 36 us; skew 500 ppm
I20260809 20:12:26.507418 30459 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 20:12:26.509403 30459 webserver.cc:460] Webserver started at http://127.14.181.62:38021/ using document root <none> and password file <none>
I20260809 20:12:26.510026 30459 fs_manager.cc:359] Metadata directory not provided
I20260809 20:12:26.510123 30459 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:12:26.510468 30459 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:12:26.513055 30459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "92eb6adb44204545b86fbbb605267c7c"
format_stamp: "Formatted at 2026-08-09 20:12:26 on dist-test-slave-6zbq"
server_key: "c3404b76573d2b8edbc13503c1d8f1d8"
server_key_iv: "8175a44c84a356f5bed4ed827c76dcee"
server_key_version: "encryptionkey@0"
I20260809 20:12:26.513792 30459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "92eb6adb44204545b86fbbb605267c7c"
format_stamp: "Formatted at 2026-08-09 20:12:26 on dist-test-slave-6zbq"
server_key: "c3404b76573d2b8edbc13503c1d8f1d8"
server_key_iv: "8175a44c84a356f5bed4ed827c76dcee"
server_key_version: "encryptionkey@0"
I20260809 20:12:26.518394 30459 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 20:12:26.521457 30489 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:26.522630 30459 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260809 20:12:26.522778 30459 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "92eb6adb44204545b86fbbb605267c7c"
format_stamp: "Formatted at 2026-08-09 20:12:26 on dist-test-slave-6zbq"
server_key: "c3404b76573d2b8edbc13503c1d8f1d8"
server_key_iv: "8175a44c84a356f5bed4ed827c76dcee"
server_key_version: "encryptionkey@0"
I20260809 20:12:26.522959 30459 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:12:26.535979 30459 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:12:26.536662 30459 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:12:26.536907 30459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:12:26.553233 30459 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:42441
I20260809 20:12:26.553254 30577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:42441 every 8 connection(s)
I20260809 20:12:26.554391 30459 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:12:26.557618 30578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:12:26.564090 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 30459
I20260809 20:12:26.564285 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:12:26.565079 15060 external_mini_cluster.cc:1428] Setting key e96a615c7d1701a4f1eb1f29ebf2dbf2
I20260809 20:12:26.568497 30578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92eb6adb44204545b86fbbb605267c7c: Bootstrap starting.
I20260809 20:12:26.571494 30578 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 92eb6adb44204545b86fbbb605267c7c: Neither blocks nor log segments found. Creating new log.
I20260809 20:12:26.572489 30578 log.cc:824] T 00000000000000000000000000000000 P 92eb6adb44204545b86fbbb605267c7c: Log is configured to *not* fsync() on all Append() calls
I20260809 20:12:26.575198 30578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92eb6adb44204545b86fbbb605267c7c: No bootstrap required, opened a new log
I20260809 20:12:26.577723 30583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:26.567029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59686 (local address 127.14.181.62:42441)
0809 20:12:26.567901 (+ 872us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:26.567911 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:26.567950 (+ 39us) server_negotiation.cc:407] Connection header received
0809 20:12:26.569543 (+ 1593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:26.569564 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:26.569980 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:26.570277 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:26.570918 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:26.572201 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:26.573735 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:26.574400 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:26.574523 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:26.575648 (+ 1125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:26.575656 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:26.575668 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:12:26.576171 (+ 503us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:26.576245 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:12:26.576265 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:26.576353 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:26.576555 (+ 202us) server_negotiation.cc:299] Negotiation successful
0809 20:12:26.576841 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":316,"threads_started":1}
I20260809 20:12:26.583148 30578 raft_consensus.cc:348] T 00000000000000000000000000000000 P 92eb6adb44204545b86fbbb605267c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92eb6adb44204545b86fbbb605267c7c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42441 } }
I20260809 20:12:26.583447 30578 raft_consensus.cc:374] T 00000000000000000000000000000000 P 92eb6adb44204545b86fbbb605267c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:12:26.583529 30578 raft_consensus.cc:729] T 00000000000000000000000000000000 P 92eb6adb44204545b86fbbb605267c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92eb6adb44204545b86fbbb605267c7c, State: Initialized, Role: FOLLOWER
I20260809 20:12:26.583994 30578 consensus_queue.cc:260] T 00000000000000000000000000000000 P 92eb6adb44204545b86fbbb605267c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92eb6adb44204545b86fbbb605267c7c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42441 } }
I20260809 20:12:26.584196 30578 raft_consensus.cc:388] T 00000000000000000000000000000000 P 92eb6adb44204545b86fbbb605267c7c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:12:26.584311 30578 raft_consensus.cc:482] T 00000000000000000000000000000000 P 92eb6adb44204545b86fbbb605267c7c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:12:26.584451 30578 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 92eb6adb44204545b86fbbb605267c7c [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:12:26.586419 30578 raft_consensus.cc:504] T 00000000000000000000000000000000 P 92eb6adb44204545b86fbbb605267c7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92eb6adb44204545b86fbbb605267c7c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42441 } }
I20260809 20:12:26.586848 30578 leader_election.cc:302] T 00000000000000000000000000000000 P 92eb6adb44204545b86fbbb605267c7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 92eb6adb44204545b86fbbb605267c7c; no voters:
I20260809 20:12:26.587343 30578 leader_election.cc:288] T 00000000000000000000000000000000 P 92eb6adb44204545b86fbbb605267c7c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:12:26.587467 30589 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 92eb6adb44204545b86fbbb605267c7c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:12:26.588078 30589 raft_consensus.cc:686] T 00000000000000000000000000000000 P 92eb6adb44204545b86fbbb605267c7c [term 1 LEADER]: Becoming Leader. State: Replica: 92eb6adb44204545b86fbbb605267c7c, State: Running, Role: LEADER
I20260809 20:12:26.588608 30589 consensus_queue.cc:237] T 00000000000000000000000000000000 P 92eb6adb44204545b86fbbb605267c7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92eb6adb44204545b86fbbb605267c7c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42441 } }
I20260809 20:12:26.589109 30578 sys_catalog.cc:564] T 00000000000000000000000000000000 P 92eb6adb44204545b86fbbb605267c7c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:12:26.591503 30592 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92eb6adb44204545b86fbbb605267c7c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 92eb6adb44204545b86fbbb605267c7c. Latest consensus state: current_term: 1 leader_uuid: "92eb6adb44204545b86fbbb605267c7c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92eb6adb44204545b86fbbb605267c7c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42441 } } }
I20260809 20:12:26.591893 30592 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92eb6adb44204545b86fbbb605267c7c [sys.catalog]: This master's current role is: LEADER
I20260809 20:12:26.592337 30591 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92eb6adb44204545b86fbbb605267c7c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "92eb6adb44204545b86fbbb605267c7c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92eb6adb44204545b86fbbb605267c7c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42441 } } }
I20260809 20:12:26.592659 30591 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92eb6adb44204545b86fbbb605267c7c [sys.catalog]: This master's current role is: LEADER
I20260809 20:12:26.593645 30603 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:12:26.597819 30603 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:12:26.605293 30603 catalog_manager.cc:1347] Generated new cluster ID: 6eb834986a964be3a2140b7aa3cf4381
I20260809 20:12:26.605413 30603 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:12:26.642023 30603 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:12:26.643379 30603 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:12:26.648887 30603 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 92eb6adb44204545b86fbbb605267c7c: Generated new TSK 0
I20260809 20:12:26.649562 30603 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:12:26.657069 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:0
--local_ip_for_outbound_sockets=127.14.181.1
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:42441
--builtin_ntp_servers=127.14.181.20:43137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260809 20:12:26.966583 30624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:12:26.966817 30624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:12:26.966933 30624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:12:26.973785 30624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:12:26.973877 30624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:12:26.974006 30624 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:12:26.982523 30624 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:43137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:42441
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:12:26.983541 30624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:12:26.985108 30624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:12:26.996865 30640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:26.997046 30641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:26.997419 30643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:12:26.997879 30624 server_base.cc:1034] running on GCE node
I20260809 20:12:26.998513 30624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:12:26.999367 30624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:12:27.000554 30624 hybrid_clock.cc:648] HybridClock initialized: now 1786306347000515 us; error 34 us; skew 500 ppm
I20260809 20:12:27.000830 30624 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 20:12:27.006326 30624 webserver.cc:460] Webserver started at http://127.14.181.1:36635/ using document root <none> and password file <none>
I20260809 20:12:27.006955 30624 fs_manager.cc:359] Metadata directory not provided
I20260809 20:12:27.007054 30624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:12:27.007360 30624 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:12:27.009997 30624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/data/instance:
uuid: "5d8f2b55054b427da36c130cd6cc88ea"
format_stamp: "Formatted at 2026-08-09 20:12:27 on dist-test-slave-6zbq"
server_key: "8a0cd4de1fe6ebf778d21b8879316167"
server_key_iv: "ca83d56fdcc7b54846461ac0cf8cda7b"
server_key_version: "encryptionkey@0"
I20260809 20:12:27.010740 30624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance:
uuid: "5d8f2b55054b427da36c130cd6cc88ea"
format_stamp: "Formatted at 2026-08-09 20:12:27 on dist-test-slave-6zbq"
server_key: "8a0cd4de1fe6ebf778d21b8879316167"
server_key_iv: "ca83d56fdcc7b54846461ac0cf8cda7b"
server_key_version: "encryptionkey@0"
I20260809 20:12:27.015410 30624 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260809 20:12:27.018533 30650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:27.019696 30624 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:12:27.019841 30624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "5d8f2b55054b427da36c130cd6cc88ea"
format_stamp: "Formatted at 2026-08-09 20:12:27 on dist-test-slave-6zbq"
server_key: "8a0cd4de1fe6ebf778d21b8879316167"
server_key_iv: "ca83d56fdcc7b54846461ac0cf8cda7b"
server_key_version: "encryptionkey@0"
I20260809 20:12:27.020023 30624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:12:27.034058 30624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:12:27.034765 30624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:12:27.035018 30624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:12:27.035837 30624 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:12:27.037099 30624 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:12:27.037190 30624 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:27.037292 30624 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:12:27.037369 30624 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:27.066416 30624 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:37871
I20260809 20:12:27.066494 30841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:37871 every 8 connection(s)
I20260809 20:12:27.067497 30624 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:12:27.069841 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 30624
I20260809 20:12:27.070011 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance
I20260809 20:12:27.070748 15060 external_mini_cluster.cc:1428] Setting key a026fef435ccc1dd52f831a2531b4b4d
I20260809 20:12:27.073812 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:0
--local_ip_for_outbound_sockets=127.14.181.2
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:42441
--builtin_ntp_servers=127.14.181.20:43137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 20:12:27.079944 30583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:27.069666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:51707 (local address 127.14.181.62:42441)
0809 20:12:27.069874 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:27.069881 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:27.071303 (+ 1422us) server_negotiation.cc:407] Connection header received
0809 20:12:27.073303 (+ 2000us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:27.073307 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:27.073373 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:27.073445 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:27.074716 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:27.075412 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:27.077313 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:27.077802 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:27.077901 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:27.079237 (+ 1336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:27.079243 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:27.079247 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:12:27.079266 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:27.079310 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:12:27.079323 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:27.079396 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:27.079588 (+ 192us) server_negotiation.cc:299] Negotiation successful
0809 20:12:27.079671 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 20:12:27.080971 30844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:27.070160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:42441 (local address 127.14.181.1:51707)
0809 20:12:27.071151 (+ 991us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:27.071195 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:27.073016 (+ 1821us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:27.073702 (+ 686us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:27.073712 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:27.073820 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:27.074552 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:27.074577 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:27.075556 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:27.075561 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:27.077189 (+ 1628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:27.077204 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:27.078001 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:27.078007 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:27.078257 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:27.078942 (+ 685us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 20:12:27.078945 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:27.078989 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 20:12:27.079066 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:12:27.079409 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:12:27.079418 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:12:27.079425 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 20:12:27.079568 (+ 143us) client_negotiation.cc:240] Negotiation successful
0809 20:12:27.079882 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":301,"threads_started":1}
I20260809 20:12:27.082314 30842 heartbeater.cc:347] Connected to a master server at 127.14.181.62:42441
I20260809 20:12:27.082592 30842 heartbeater.cc:464] Registering TS with master...
I20260809 20:12:27.083310 30842 heartbeater.cc:511] Master 127.14.181.62:42441 requested a full tablet report, sending...
I20260809 20:12:27.085124 30518 ts_manager.cc:194] Registered new tserver with Master: 5d8f2b55054b427da36c130cd6cc88ea (127.14.181.1:37871)
I20260809 20:12:27.086570 30518 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.181.1:51707
W20260809 20:12:27.388720 30846 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:12:27.388993 30846 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:12:27.389119 30846 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:12:27.396096 30846 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:12:27.396191 30846 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:12:27.396330 30846 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:12:27.404889 30846 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:43137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:42441
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:12:27.406032 30846 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:12:27.407768 30846 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:12:27.419458 30855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:27.419535 30862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:27.419507 30856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:12:27.420559 30846 server_base.cc:1034] running on GCE node
I20260809 20:12:27.421052 30846 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:12:27.421842 30846 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:12:27.423022 30846 hybrid_clock.cc:648] HybridClock initialized: now 1786306347422985 us; error 28 us; skew 500 ppm
I20260809 20:12:27.423273 30846 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 20:12:27.425179 30846 webserver.cc:460] Webserver started at http://127.14.181.2:41611/ using document root <none> and password file <none>
I20260809 20:12:27.425805 30846 fs_manager.cc:359] Metadata directory not provided
I20260809 20:12:27.425889 30846 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:12:27.426139 30846 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:12:27.428799 30846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/data/instance:
uuid: "d09be6b22f974eaa9ed5d6b6194084c2"
format_stamp: "Formatted at 2026-08-09 20:12:27 on dist-test-slave-6zbq"
server_key: "de645f0591170386691e458d47ecb218"
server_key_iv: "04bcd5959286c118f1594e7bfc9410ca"
server_key_version: "encryptionkey@0"
I20260809 20:12:27.429543 30846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance:
uuid: "d09be6b22f974eaa9ed5d6b6194084c2"
format_stamp: "Formatted at 2026-08-09 20:12:27 on dist-test-slave-6zbq"
server_key: "de645f0591170386691e458d47ecb218"
server_key_iv: "04bcd5959286c118f1594e7bfc9410ca"
server_key_version: "encryptionkey@0"
I20260809 20:12:27.434024 30846 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 20:12:27.437059 30874 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:27.438165 30846 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 20:12:27.438297 30846 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "d09be6b22f974eaa9ed5d6b6194084c2"
format_stamp: "Formatted at 2026-08-09 20:12:27 on dist-test-slave-6zbq"
server_key: "de645f0591170386691e458d47ecb218"
server_key_iv: "04bcd5959286c118f1594e7bfc9410ca"
server_key_version: "encryptionkey@0"
I20260809 20:12:27.438519 30846 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:12:27.462824 30846 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:12:27.463502 30846 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:12:27.463768 30846 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:12:27.464591 30846 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:12:27.465866 30846 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:12:27.465951 30846 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:27.466050 30846 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:12:27.466117 30846 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:27.495486 30846 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:36463
I20260809 20:12:27.495579 31055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:36463 every 8 connection(s)
I20260809 20:12:27.496565 30846 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:12:27.498731 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 30846
I20260809 20:12:27.498896 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance
I20260809 20:12:27.499454 15060 external_mini_cluster.cc:1428] Setting key f44e752fbb3d29ac43346fa76dc69832
I20260809 20:12:27.502164 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:0
--local_ip_for_outbound_sockets=127.14.181.3
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:42441
--builtin_ntp_servers=127.14.181.20:43137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 20:12:27.508174 30583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:27.498780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:45211 (local address 127.14.181.62:42441)
0809 20:12:27.498967 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:27.498973 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:27.500513 (+ 1540us) server_negotiation.cc:407] Connection header received
0809 20:12:27.502294 (+ 1781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:27.502300 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:27.502410 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:27.502498 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:27.503473 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:27.504186 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:27.505665 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:27.506072 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:27.506180 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:27.507411 (+ 1231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:27.507418 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:27.507422 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:12:27.507440 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:27.507472 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:12:27.507483 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:27.507554 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:27.507750 (+ 196us) server_negotiation.cc:299] Negotiation successful
0809 20:12:27.507853 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 20:12:27.509013 31059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:27.499390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:42441 (local address 127.14.181.2:45211)
0809 20:12:27.500372 (+ 982us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:27.500414 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:27.502047 (+ 1633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:27.502713 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:27.502721 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:27.502808 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:27.503314 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:27.503331 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:27.504351 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:27.504354 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:27.505523 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:27.505540 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:27.506289 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:27.506298 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:27.506531 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:27.507127 (+ 596us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 20:12:27.507129 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:27.507164 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 20:12:27.507234 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:12:27.507564 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:12:27.507576 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:12:27.507584 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 20:12:27.507727 (+ 143us) client_negotiation.cc:240] Negotiation successful
0809 20:12:27.508072 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":298,"threads_started":1}
I20260809 20:12:27.510298 31056 heartbeater.cc:347] Connected to a master server at 127.14.181.62:42441
I20260809 20:12:27.510599 31056 heartbeater.cc:464] Registering TS with master...
I20260809 20:12:27.511279 31056 heartbeater.cc:511] Master 127.14.181.62:42441 requested a full tablet report, sending...
I20260809 20:12:27.512614 30518 ts_manager.cc:194] Registered new tserver with Master: d09be6b22f974eaa9ed5d6b6194084c2 (127.14.181.2:36463)
I20260809 20:12:27.513633 30518 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.181.2:45211
W20260809 20:12:27.828646 31063 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:12:27.828878 31063 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:12:27.828963 31063 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:12:27.836088 31063 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:12:27.836166 31063 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:12:27.836264 31063 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:12:27.844766 31063 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:43137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:42441
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:12:27.845700 31063 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:12:27.847227 31063 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:12:27.858866 31076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:27.858891 31071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:27.859328 31070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:12:27.859732 31063 server_base.cc:1034] running on GCE node
I20260809 20:12:27.860261 31063 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:12:27.861056 31063 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:12:27.862258 31063 hybrid_clock.cc:648] HybridClock initialized: now 1786306347862216 us; error 33 us; skew 500 ppm
I20260809 20:12:27.862558 31063 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 20:12:27.864470 31063 webserver.cc:460] Webserver started at http://127.14.181.3:46127/ using document root <none> and password file <none>
I20260809 20:12:27.865064 31063 fs_manager.cc:359] Metadata directory not provided
I20260809 20:12:27.865157 31063 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:12:27.865440 31063 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:12:27.868026 31063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/data/instance:
uuid: "fd5b75f809574c748bb59ee0708b09e6"
format_stamp: "Formatted at 2026-08-09 20:12:27 on dist-test-slave-6zbq"
server_key: "443fd7a6e0e8984fa6525afadbf3714f"
server_key_iv: "730db752be38924f4d2e7ad91d48ef1d"
server_key_version: "encryptionkey@0"
I20260809 20:12:27.868757 31063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance:
uuid: "fd5b75f809574c748bb59ee0708b09e6"
format_stamp: "Formatted at 2026-08-09 20:12:27 on dist-test-slave-6zbq"
server_key: "443fd7a6e0e8984fa6525afadbf3714f"
server_key_iv: "730db752be38924f4d2e7ad91d48ef1d"
server_key_version: "encryptionkey@0"
I20260809 20:12:27.873471 31063 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 20:12:27.876552 31089 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:27.877681 31063 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 20:12:27.877833 31063 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "fd5b75f809574c748bb59ee0708b09e6"
format_stamp: "Formatted at 2026-08-09 20:12:27 on dist-test-slave-6zbq"
server_key: "443fd7a6e0e8984fa6525afadbf3714f"
server_key_iv: "730db752be38924f4d2e7ad91d48ef1d"
server_key_version: "encryptionkey@0"
I20260809 20:12:27.878012 31063 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:12:27.888655 31063 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:12:27.889355 31063 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:12:27.889604 31063 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:12:27.890503 31063 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:12:27.891755 31063 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:12:27.891860 31063 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:27.891961 31063 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:12:27.892027 31063 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:27.921198 31063 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:37927
I20260809 20:12:27.921255 31297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:37927 every 8 connection(s)
I20260809 20:12:27.922372 31063 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:12:27.928342 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 31063
I20260809 20:12:27.928484 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance
I20260809 20:12:27.928879 15060 external_mini_cluster.cc:1428] Setting key 6e15fd8ccac2b2658c7870d0f1d95b65
I20260809 20:12:27.934080 30583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:27.924725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:49539 (local address 127.14.181.62:42441)
0809 20:12:27.924894 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:27.924899 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:27.926223 (+ 1324us) server_negotiation.cc:407] Connection header received
0809 20:12:27.927964 (+ 1741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:27.927970 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:27.928068 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:27.928158 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:27.929231 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:27.930162 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:27.931669 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:27.932075 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:27.932183 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:27.933339 (+ 1156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:27.933346 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:27.933349 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:12:27.933365 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:27.933396 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:12:27.933408 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:27.933479 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:27.933684 (+ 205us) server_negotiation.cc:299] Negotiation successful
0809 20:12:27.933784 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 20:12:27.935004 31301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:27.925205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:42441 (local address 127.14.181.3:49539)
0809 20:12:27.926075 (+ 870us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:27.926116 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:27.927701 (+ 1585us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:27.928381 (+ 680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:27.928389 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:27.928484 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:27.929066 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:27.929084 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:27.930315 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:27.930319 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:27.931530 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:27.931543 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:27.932290 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:27.932298 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:27.932505 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:27.933056 (+ 551us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 20:12:27.933058 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:27.933098 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 20:12:27.933165 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:12:27.933492 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:12:27.933503 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:12:27.933511 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 20:12:27.933666 (+ 155us) client_negotiation.cc:240] Negotiation successful
0809 20:12:27.934026 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":250,"threads_started":1}
I20260809 20:12:27.936105 31298 heartbeater.cc:347] Connected to a master server at 127.14.181.62:42441
I20260809 20:12:27.936334 31298 heartbeater.cc:464] Registering TS with master...
I20260809 20:12:27.936960 31298 heartbeater.cc:511] Master 127.14.181.62:42441 requested a full tablet report, sending...
I20260809 20:12:27.938138 30518 ts_manager.cc:194] Registered new tserver with Master: fd5b75f809574c748bb59ee0708b09e6 (127.14.181.3:37927)
I20260809 20:12:27.938908 30518 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.181.3:49539
I20260809 20:12:27.943500 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 20:12:27.949177 30583 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:27.947753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59696 (local address 127.14.181.62:42441)
0809 20:12:27.947918 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:27.947924 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:27.948350 (+ 426us) server_negotiation.cc:407] Connection header received
0809 20:12:27.948464 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:27.948468 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:27.948560 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:27.948635 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:27.948948 (+ 313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59696: BlockingRecv error: recv got EOF from 127.0.0.1:59696 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 20:12:27.949891 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 30624
I20260809 20:12:27.956537 31314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:27.950779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43504 (local address 127.14.181.1:37871)
0809 20:12:27.951292 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:27.951299 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:27.951321 (+ 22us) server_negotiation.cc:407] Connection header received
0809 20:12:27.951378 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:27.951383 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:27.951534 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:27.951647 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:27.951924 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:27.952843 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:27.953963 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:27.954517 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:27.954608 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:27.955440 (+ 832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:27.955447 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:27.955457 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:12:27.955945 (+ 488us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:27.955992 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:12:27.956011 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:27.956091 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:27.956170 (+ 79us) server_negotiation.cc:299] Negotiation successful
0809 20:12:27.956276 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":264,"threads_started":1}
I20260809 20:12:27.957536 30835 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:12:28.036834 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 30624
I20260809 20:12:28.057582 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 30846
I20260809 20:12:28.064560 31316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:28.058377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59834 (local address 127.14.181.2:36463)
0809 20:12:28.058915 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:28.058921 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:28.058948 (+ 27us) server_negotiation.cc:407] Connection header received
0809 20:12:28.059005 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:28.059011 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:28.059216 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:28.059340 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:28.059676 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:28.060623 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:28.061752 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:28.062263 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:28.062523 (+ 260us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:28.063238 (+ 715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:28.063246 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:28.063256 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:12:28.063830 (+ 574us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:28.063875 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:12:28.063894 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:28.063976 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:28.064095 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 20:12:28.064238 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":260,"threads_started":1}
I20260809 20:12:28.065714 31051 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:12:28.143687 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 30846
I20260809 20:12:28.165665 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 31063
I20260809 20:12:28.173095 31319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:28.166619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36620 (local address 127.14.181.3:37927)
0809 20:12:28.167187 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:28.167194 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:28.167224 (+ 30us) server_negotiation.cc:407] Connection header received
0809 20:12:28.167282 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:28.167288 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:28.167494 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:28.167615 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:28.168025 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:28.169053 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:28.170238 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:28.170856 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:28.170946 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:28.171873 (+ 927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:28.171882 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:28.171894 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:12:28.172428 (+ 534us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:28.172475 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:12:28.172495 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:28.172584 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:28.172677 (+ 93us) server_negotiation.cc:299] Negotiation successful
0809 20:12:28.172800 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":273,"threads_started":1}
I20260809 20:12:28.174240 31292 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:12:28.252815 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 31063
I20260809 20:12:28.271031 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 30459
I20260809 20:12:28.272184 30568 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:12:28.368884 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 30459
2026-08-09T20:12:28Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2280 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-09T20:12:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:12:28Z Disabled control of system clock
I20260809 20:12:28.444644 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:39653
--webserver_interface=127.14.181.62
--webserver_port=0
--builtin_ntp_servers=127.14.181.20:46057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:39653
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 20:12:28.755848 31333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:12:28.756106 31333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:12:28.756234 31333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:12:28.763275 31333 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:12:28.763370 31333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:12:28.763433 31333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:12:28.763509 31333 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:12:28.763566 31333 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:12:28.772292 31333 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:46057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:39653
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:39653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:12:28.773425 31333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:12:28.775111 31333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:12:28.786026 31348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:28.785987 31344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:28.786087 31358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:12:28.786635 31333 server_base.cc:1034] running on GCE node
I20260809 20:12:28.787312 31333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:12:28.788492 31333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:12:28.789685 31333 hybrid_clock.cc:648] HybridClock initialized: now 1786306348789641 us; error 39 us; skew 500 ppm
I20260809 20:12:28.789983 31333 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 20:12:28.792002 31333 webserver.cc:460] Webserver started at http://127.14.181.62:35837/ using document root <none> and password file <none>
I20260809 20:12:28.792605 31333 fs_manager.cc:359] Metadata directory not provided
I20260809 20:12:28.792706 31333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:12:28.792994 31333 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:12:28.795717 31333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "765df77f5ecf4f6591608890e0477b0b"
format_stamp: "Formatted at 2026-08-09 20:12:28 on dist-test-slave-6zbq"
server_key: "cdf7d87d7ab61e65d5650d919c34e757"
server_key_iv: "9c95b9bb31c13b0dfb37d6863f68366a"
server_key_version: "encryptionkey@0"
I20260809 20:12:28.796454 31333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "765df77f5ecf4f6591608890e0477b0b"
format_stamp: "Formatted at 2026-08-09 20:12:28 on dist-test-slave-6zbq"
server_key: "cdf7d87d7ab61e65d5650d919c34e757"
server_key_iv: "9c95b9bb31c13b0dfb37d6863f68366a"
server_key_version: "encryptionkey@0"
I20260809 20:12:28.801008 31333 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260809 20:12:28.804057 31367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:28.805189 31333 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 20:12:28.805338 31333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "765df77f5ecf4f6591608890e0477b0b"
format_stamp: "Formatted at 2026-08-09 20:12:28 on dist-test-slave-6zbq"
server_key: "cdf7d87d7ab61e65d5650d919c34e757"
server_key_iv: "9c95b9bb31c13b0dfb37d6863f68366a"
server_key_version: "encryptionkey@0"
I20260809 20:12:28.805517 31333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:12:28.810632 31333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:12:28.811347 31333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:12:28.811605 31333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:12:28.827384 31333 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:39653
I20260809 20:12:28.827423 31440 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:39653 every 8 connection(s)
I20260809 20:12:28.828470 31333 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:12:28.831655 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 31333
I20260809 20:12:28.831844 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:12:28.831842 31441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:12:28.832428 15060 external_mini_cluster.cc:1428] Setting key e7ddf257509c344fff4f27bbb61ecd7d
I20260809 20:12:28.840261 31446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:28.834165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39438 (local address 127.14.181.62:39653)
0809 20:12:28.835144 (+ 979us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:28.835155 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:28.835196 (+ 41us) server_negotiation.cc:407] Connection header received
0809 20:12:28.837173 (+ 1977us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:28.837193 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:28.837560 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:28.837857 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:28.838890 (+ 1033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:28.838897 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:28.838908 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:12:28.838921 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:28.838981 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:12:28.838996 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:28.839163 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:28.839268 (+ 105us) server_negotiation.cc:299] Negotiation successful
0809 20:12:28.839483 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":582,"thread_start_us":379,"threads_started":1}
I20260809 20:12:28.843894 31441 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 765df77f5ecf4f6591608890e0477b0b: Bootstrap starting.
I20260809 20:12:28.846571 31441 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 765df77f5ecf4f6591608890e0477b0b: Neither blocks nor log segments found. Creating new log.
I20260809 20:12:28.847600 31441 log.cc:824] T 00000000000000000000000000000000 P 765df77f5ecf4f6591608890e0477b0b: Log is configured to *not* fsync() on all Append() calls
I20260809 20:12:28.849862 31441 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 765df77f5ecf4f6591608890e0477b0b: No bootstrap required, opened a new log
I20260809 20:12:28.856833 31441 raft_consensus.cc:348] T 00000000000000000000000000000000 P 765df77f5ecf4f6591608890e0477b0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "765df77f5ecf4f6591608890e0477b0b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39653 } }
I20260809 20:12:28.857133 31441 raft_consensus.cc:374] T 00000000000000000000000000000000 P 765df77f5ecf4f6591608890e0477b0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:12:28.857214 31441 raft_consensus.cc:729] T 00000000000000000000000000000000 P 765df77f5ecf4f6591608890e0477b0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765df77f5ecf4f6591608890e0477b0b, State: Initialized, Role: FOLLOWER
I20260809 20:12:28.857656 31441 consensus_queue.cc:260] T 00000000000000000000000000000000 P 765df77f5ecf4f6591608890e0477b0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "765df77f5ecf4f6591608890e0477b0b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39653 } }
I20260809 20:12:28.857846 31441 raft_consensus.cc:388] T 00000000000000000000000000000000 P 765df77f5ecf4f6591608890e0477b0b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:12:28.857940 31441 raft_consensus.cc:482] T 00000000000000000000000000000000 P 765df77f5ecf4f6591608890e0477b0b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:12:28.858052 31441 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 765df77f5ecf4f6591608890e0477b0b [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:12:28.860095 31441 raft_consensus.cc:504] T 00000000000000000000000000000000 P 765df77f5ecf4f6591608890e0477b0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "765df77f5ecf4f6591608890e0477b0b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39653 } }
I20260809 20:12:28.860522 31441 leader_election.cc:302] T 00000000000000000000000000000000 P 765df77f5ecf4f6591608890e0477b0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 765df77f5ecf4f6591608890e0477b0b; no voters:
I20260809 20:12:28.860989 31441 leader_election.cc:288] T 00000000000000000000000000000000 P 765df77f5ecf4f6591608890e0477b0b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:12:28.861122 31449 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 765df77f5ecf4f6591608890e0477b0b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:12:28.861835 31449 raft_consensus.cc:686] T 00000000000000000000000000000000 P 765df77f5ecf4f6591608890e0477b0b [term 1 LEADER]: Becoming Leader. State: Replica: 765df77f5ecf4f6591608890e0477b0b, State: Running, Role: LEADER
I20260809 20:12:28.862360 31449 consensus_queue.cc:237] T 00000000000000000000000000000000 P 765df77f5ecf4f6591608890e0477b0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "765df77f5ecf4f6591608890e0477b0b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39653 } }
I20260809 20:12:28.862933 31441 sys_catalog.cc:564] T 00000000000000000000000000000000 P 765df77f5ecf4f6591608890e0477b0b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:12:28.864950 31452 sys_catalog.cc:455] T 00000000000000000000000000000000 P 765df77f5ecf4f6591608890e0477b0b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "765df77f5ecf4f6591608890e0477b0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "765df77f5ecf4f6591608890e0477b0b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39653 } } }
I20260809 20:12:28.865087 31454 sys_catalog.cc:455] T 00000000000000000000000000000000 P 765df77f5ecf4f6591608890e0477b0b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 765df77f5ecf4f6591608890e0477b0b. Latest consensus state: current_term: 1 leader_uuid: "765df77f5ecf4f6591608890e0477b0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "765df77f5ecf4f6591608890e0477b0b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39653 } } }
I20260809 20:12:28.865368 31452 sys_catalog.cc:458] T 00000000000000000000000000000000 P 765df77f5ecf4f6591608890e0477b0b [sys.catalog]: This master's current role is: LEADER
I20260809 20:12:28.865437 31454 sys_catalog.cc:458] T 00000000000000000000000000000000 P 765df77f5ecf4f6591608890e0477b0b [sys.catalog]: This master's current role is: LEADER
I20260809 20:12:28.867458 31459 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:12:28.872525 31459 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:12:28.880695 31459 catalog_manager.cc:1347] Generated new cluster ID: 978a22cca79c4dacbd91fde729ec856e
I20260809 20:12:28.880791 31459 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:12:28.898892 31459 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:12:28.899241 31459 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:12:28.907286 31459 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 765df77f5ecf4f6591608890e0477b0b: Generated new TSK 0
I20260809 20:12:28.907907 31459 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:12:28.921728 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:0
--local_ip_for_outbound_sockets=127.14.181.1
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39653
--builtin_ntp_servers=127.14.181.20:46057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 20:12:29.261459 31481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:12:29.261704 31481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:12:29.261797 31481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:12:29.268846 31481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:12:29.268929 31481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:12:29.269037 31481 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:12:29.277592 31481 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:46057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39653
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:12:29.278710 31481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:12:29.280259 31481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:12:29.291992 31490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:29.292066 31495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:29.292034 31491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:12:29.292979 31481 server_base.cc:1034] running on GCE node
I20260809 20:12:29.293509 31481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:12:29.294333 31481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:12:29.295557 31481 hybrid_clock.cc:648] HybridClock initialized: now 1786306349295505 us; error 45 us; skew 500 ppm
I20260809 20:12:29.295832 31481 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 20:12:29.297835 31481 webserver.cc:460] Webserver started at http://127.14.181.1:38609/ using document root <none> and password file <none>
I20260809 20:12:29.298539 31481 fs_manager.cc:359] Metadata directory not provided
I20260809 20:12:29.298641 31481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:12:29.298941 31481 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:12:29.301569 31481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/data/instance:
uuid: "2ec11b5169334badae1952e0f6ba2980"
format_stamp: "Formatted at 2026-08-09 20:12:29 on dist-test-slave-6zbq"
server_key: "1d76bdaafc06660a6995795da90c4981"
server_key_iv: "801b332442a8b06385ef0b1a74e47da3"
server_key_version: "encryptionkey@0"
I20260809 20:12:29.302372 31481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance:
uuid: "2ec11b5169334badae1952e0f6ba2980"
format_stamp: "Formatted at 2026-08-09 20:12:29 on dist-test-slave-6zbq"
server_key: "1d76bdaafc06660a6995795da90c4981"
server_key_iv: "801b332442a8b06385ef0b1a74e47da3"
server_key_version: "encryptionkey@0"
I20260809 20:12:29.307068 31481 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 20:12:29.310297 31505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:29.311524 31481 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 20:12:29.311663 31481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "2ec11b5169334badae1952e0f6ba2980"
format_stamp: "Formatted at 2026-08-09 20:12:29 on dist-test-slave-6zbq"
server_key: "1d76bdaafc06660a6995795da90c4981"
server_key_iv: "801b332442a8b06385ef0b1a74e47da3"
server_key_version: "encryptionkey@0"
I20260809 20:12:29.311858 31481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:12:29.318296 31481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:12:29.319331 31481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:12:29.319622 31481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:12:29.320747 31481 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:12:29.322499 31481 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:12:29.322599 31481 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:29.322700 31481 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:12:29.322765 31481 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:29.362062 31481 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:46813
I20260809 20:12:29.362110 31690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:46813 every 8 connection(s)
I20260809 20:12:29.363447 31481 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:12:29.369397 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 31481
I20260809 20:12:29.369590 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance
I20260809 20:12:29.370198 15060 external_mini_cluster.cc:1428] Setting key 375c9780d62c4c2043bf5377832663ab
I20260809 20:12:29.372685 31695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:29.366558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:57657 (local address 127.14.181.62:39653)
0809 20:12:29.367026 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:29.367031 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:29.368533 (+ 1502us) server_negotiation.cc:407] Connection header received
0809 20:12:29.370328 (+ 1795us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:29.370334 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:29.370420 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:29.370516 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:29.371825 (+ 1309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:29.371830 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:29.371833 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:12:29.371850 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:29.371904 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:12:29.371921 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:29.372029 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:29.372266 (+ 237us) server_negotiation.cc:299] Negotiation successful
0809 20:12:29.372330 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":237,"threads_started":1}
I20260809 20:12:29.373171 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:0
--local_ip_for_outbound_sockets=127.14.181.2
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39653
--builtin_ntp_servers=127.14.181.20:46057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 20:12:29.373498 31696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:29.367300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39653 (local address 127.14.181.1:57657)
0809 20:12:29.368376 (+ 1076us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:29.368428 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:29.370063 (+ 1635us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:29.370767 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:29.370775 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:29.370862 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:29.371489 (+ 627us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 20:12:29.371492 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:29.371540 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 20:12:29.371647 (+ 107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:12:29.372026 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:12:29.372037 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:12:29.372044 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 20:12:29.372318 (+ 274us) client_negotiation.cc:240] Negotiation successful
0809 20:12:29.372509 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":320,"threads_started":1}
I20260809 20:12:29.374956 31693 heartbeater.cc:347] Connected to a master server at 127.14.181.62:39653
I20260809 20:12:29.375222 31693 heartbeater.cc:464] Registering TS with master...
I20260809 20:12:29.375792 31693 heartbeater.cc:511] Master 127.14.181.62:39653 requested a full tablet report, sending...
I20260809 20:12:29.377846 31395 ts_manager.cc:194] Registered new tserver with Master: 2ec11b5169334badae1952e0f6ba2980 (127.14.181.1:46813)
W20260809 20:12:29.681710 31697 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:12:29.681941 31697 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:12:29.682067 31697 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:12:29.688927 31697 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:12:29.689013 31697 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:12:29.689157 31697 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:12:29.697616 31697 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:46057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39653
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:12:29.698676 31697 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:12:29.700248 31697 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:12:29.712085 31702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:29.712109 31703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:29.712790 31710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:12:29.714102 31697 server_base.cc:1034] running on GCE node
I20260809 20:12:29.714663 31697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:12:29.715505 31697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:12:29.716679 31697 hybrid_clock.cc:648] HybridClock initialized: now 1786306349716631 us; error 41 us; skew 500 ppm
I20260809 20:12:29.716948 31697 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 20:12:29.718886 31697 webserver.cc:460] Webserver started at http://127.14.181.2:42771/ using document root <none> and password file <none>
I20260809 20:12:29.719473 31697 fs_manager.cc:359] Metadata directory not provided
I20260809 20:12:29.719558 31697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:12:29.719801 31697 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:12:29.722373 31697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/data/instance:
uuid: "98099528b9b144a5892d74755d0b1fdb"
format_stamp: "Formatted at 2026-08-09 20:12:29 on dist-test-slave-6zbq"
server_key: "d51f67de1521ab47259d3d1823d07b40"
server_key_iv: "9feddc60850dc97fcd7b0c17a3315514"
server_key_version: "encryptionkey@0"
I20260809 20:12:29.723071 31697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance:
uuid: "98099528b9b144a5892d74755d0b1fdb"
format_stamp: "Formatted at 2026-08-09 20:12:29 on dist-test-slave-6zbq"
server_key: "d51f67de1521ab47259d3d1823d07b40"
server_key_iv: "9feddc60850dc97fcd7b0c17a3315514"
server_key_version: "encryptionkey@0"
I20260809 20:12:29.727562 31697 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260809 20:12:29.730626 31722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:29.731787 31697 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260809 20:12:29.731910 31697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "98099528b9b144a5892d74755d0b1fdb"
format_stamp: "Formatted at 2026-08-09 20:12:29 on dist-test-slave-6zbq"
server_key: "d51f67de1521ab47259d3d1823d07b40"
server_key_iv: "9feddc60850dc97fcd7b0c17a3315514"
server_key_version: "encryptionkey@0"
I20260809 20:12:29.732072 31697 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:12:29.737100 31697 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:12:29.737753 31697 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:12:29.737957 31697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:12:29.738773 31697 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:12:29.740017 31697 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:12:29.740100 31697 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:29.740175 31697 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:12:29.740234 31697 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:29.769304 31697 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:43313
I20260809 20:12:29.769363 31915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:43313 every 8 connection(s)
I20260809 20:12:29.770465 31697 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:12:29.776058 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 31697
I20260809 20:12:29.776221 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance
I20260809 20:12:29.776619 15060 external_mini_cluster.cc:1428] Setting key ff354df43f0b816d0fb7173209fa516a
I20260809 20:12:29.778045 31695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:29.772714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:34757 (local address 127.14.181.62:39653)
0809 20:12:29.772883 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:29.772888 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:29.774195 (+ 1307us) server_negotiation.cc:407] Connection header received
0809 20:12:29.775823 (+ 1628us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:29.775829 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:29.775891 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:29.775979 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:29.777277 (+ 1298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:29.777282 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:29.777285 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:12:29.777303 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:29.777337 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:12:29.777349 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:29.777452 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:29.777674 (+ 222us) server_negotiation.cc:299] Negotiation successful
0809 20:12:29.777747 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 20:12:29.778815 31919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:29.773159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39653 (local address 127.14.181.2:34757)
0809 20:12:29.774034 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:29.774068 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:29.775555 (+ 1487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:29.776219 (+ 664us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:29.776228 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:29.776325 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:29.776966 (+ 641us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 20:12:29.776968 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:29.777009 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 20:12:29.777100 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:12:29.777450 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:12:29.777462 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:12:29.777469 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 20:12:29.777719 (+ 250us) client_negotiation.cc:240] Negotiation successful
0809 20:12:29.777898 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":271,"threads_started":1}
I20260809 20:12:29.779469 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:0
--local_ip_for_outbound_sockets=127.14.181.3
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39653
--builtin_ntp_servers=127.14.181.20:46057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 20:12:29.780011 31916 heartbeater.cc:347] Connected to a master server at 127.14.181.62:39653
I20260809 20:12:29.780251 31916 heartbeater.cc:464] Registering TS with master...
I20260809 20:12:29.780763 31916 heartbeater.cc:511] Master 127.14.181.62:39653 requested a full tablet report, sending...
I20260809 20:12:29.782047 31395 ts_manager.cc:194] Registered new tserver with Master: 98099528b9b144a5892d74755d0b1fdb (127.14.181.2:43313)
W20260809 20:12:30.088479 31920 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:12:30.088721 31920 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:12:30.088812 31920 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:12:30.095683 31920 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:12:30.095767 31920 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:12:30.095867 31920 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:12:30.104311 31920 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:46057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39653
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:12:30.105336 31920 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:12:30.106946 31920 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:12:30.118780 31929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:30.118829 31933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:30.118876 31930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:12:30.119555 31920 server_base.cc:1034] running on GCE node
I20260809 20:12:30.120067 31920 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:12:30.120875 31920 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:12:30.122074 31920 hybrid_clock.cc:648] HybridClock initialized: now 1786306350122027 us; error 41 us; skew 500 ppm
I20260809 20:12:30.122329 31920 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 20:12:30.124315 31920 webserver.cc:460] Webserver started at http://127.14.181.3:46591/ using document root <none> and password file <none>
I20260809 20:12:30.124866 31920 fs_manager.cc:359] Metadata directory not provided
I20260809 20:12:30.124946 31920 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:12:30.125201 31920 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:12:30.127797 31920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/data/instance:
uuid: "7c8355af5b4640209c8a8085a55fdf5c"
format_stamp: "Formatted at 2026-08-09 20:12:30 on dist-test-slave-6zbq"
server_key: "85dc0f49f141c8a709a093d97069d122"
server_key_iv: "16677f2f0688a5a6d3ccc9c8a59c04fb"
server_key_version: "encryptionkey@0"
I20260809 20:12:30.128495 31920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance:
uuid: "7c8355af5b4640209c8a8085a55fdf5c"
format_stamp: "Formatted at 2026-08-09 20:12:30 on dist-test-slave-6zbq"
server_key: "85dc0f49f141c8a709a093d97069d122"
server_key_iv: "16677f2f0688a5a6d3ccc9c8a59c04fb"
server_key_version: "encryptionkey@0"
I20260809 20:12:30.133009 31920 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260809 20:12:30.136062 31943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:30.137253 31920 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 20:12:30.137380 31920 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "7c8355af5b4640209c8a8085a55fdf5c"
format_stamp: "Formatted at 2026-08-09 20:12:30 on dist-test-slave-6zbq"
server_key: "85dc0f49f141c8a709a093d97069d122"
server_key_iv: "16677f2f0688a5a6d3ccc9c8a59c04fb"
server_key_version: "encryptionkey@0"
I20260809 20:12:30.137547 31920 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:12:30.142619 31920 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:12:30.143286 31920 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:12:30.143496 31920 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:12:30.144289 31920 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:12:30.145510 31920 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:12:30.145598 31920 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:30.145676 31920 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:12:30.145730 31920 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:30.174811 31920 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:33045
I20260809 20:12:30.174878 32124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:33045 every 8 connection(s)
I20260809 20:12:30.175994 31920 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:12:30.182014 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 31920
I20260809 20:12:30.182197 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance
I20260809 20:12:30.182637 15060 external_mini_cluster.cc:1428] Setting key aff62563db6be28d238ab9f35a43fb08
I20260809 20:12:30.183496 31695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:30.178259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:33903 (local address 127.14.181.62:39653)
0809 20:12:30.178445 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:30.178450 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:30.179705 (+ 1255us) server_negotiation.cc:407] Connection header received
0809 20:12:30.181296 (+ 1591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:30.181301 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:30.181356 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:30.181430 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:30.182726 (+ 1296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:30.182734 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:30.182739 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:12:30.182761 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:30.182798 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:12:30.182812 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:30.182929 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:30.183159 (+ 230us) server_negotiation.cc:299] Negotiation successful
0809 20:12:30.183234 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 20:12:30.184345 32128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:30.178725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39653 (local address 127.14.181.3:33903)
0809 20:12:30.179565 (+ 840us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:30.179598 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:30.181038 (+ 1440us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:30.181599 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:30.181606 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:30.181686 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:30.182407 (+ 721us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 20:12:30.182409 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:30.182447 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 20:12:30.182530 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:12:30.182903 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:12:30.182914 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:12:30.182922 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 20:12:30.183205 (+ 283us) client_negotiation.cc:240] Negotiation successful
0809 20:12:30.183409 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":256,"threads_started":1}
I20260809 20:12:30.185627 32125 heartbeater.cc:347] Connected to a master server at 127.14.181.62:39653
I20260809 20:12:30.185909 32125 heartbeater.cc:464] Registering TS with master...
I20260809 20:12:30.186460 32125 heartbeater.cc:511] Master 127.14.181.62:39653 requested a full tablet report, sending...
I20260809 20:12:30.187704 31395 ts_manager.cc:194] Registered new tserver with Master: 7c8355af5b4640209c8a8085a55fdf5c (127.14.181.3:33045)
I20260809 20:12:30.197883 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 20:12:30.203713 31695 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:12:30.202209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39446 (local address 127.14.181.62:39653)
0809 20:12:30.202409 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:30.202415 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:30.202912 (+ 497us) server_negotiation.cc:407] Connection header received
0809 20:12:30.203043 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:30.203046 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:30.203094 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:30.203174 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:30.203484 (+ 310us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39446: BlockingRecv error: recv got EOF from 127.0.0.1:39446 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 20:12:30.204526 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 31481
I20260809 20:12:30.207552 32136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:30.205397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55564 (local address 127.14.181.1:46813)
0809 20:12:30.205888 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:30.205894 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:30.205918 (+ 24us) server_negotiation.cc:407] Connection header received
0809 20:12:30.205970 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:30.205976 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:30.206137 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:30.206251 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:30.207007 (+ 756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:30.207013 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:30.207023 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:12:30.207040 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:30.207078 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:12:30.207091 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:30.207191 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:30.207246 (+ 55us) server_negotiation.cc:299] Negotiation successful
0809 20:12:30.207327 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":228,"threads_started":1}
I20260809 20:12:30.208632 31686 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:12:30.287422 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 31481
I20260809 20:12:30.307536 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 31697
I20260809 20:12:30.311167 32139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:30.308450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43388 (local address 127.14.181.2:43313)
0809 20:12:30.308960 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:30.308967 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:30.308993 (+ 26us) server_negotiation.cc:407] Connection header received
0809 20:12:30.309055 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:30.309062 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:30.309285 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:30.309427 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:30.310430 (+ 1003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:30.310436 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:30.310447 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:12:30.310467 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:30.310513 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:12:30.310528 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:30.310658 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:30.310785 (+ 127us) server_negotiation.cc:299] Negotiation successful
0809 20:12:30.310889 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":251,"threads_started":1}
I20260809 20:12:30.312336 31909 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:12:30.391492 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 31697
I20260809 20:12:30.411463 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 31920
I20260809 20:12:30.415300 32146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:30.412457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45388 (local address 127.14.181.3:33045)
0809 20:12:30.413145 (+ 688us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:30.413152 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:30.413183 (+ 31us) server_negotiation.cc:407] Connection header received
0809 20:12:30.413246 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:30.413253 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:30.413483 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:30.413599 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:30.414622 (+ 1023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:30.414628 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:30.414639 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:12:30.414655 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:30.414694 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:12:30.414707 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:30.414850 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:30.414901 (+ 51us) server_negotiation.cc:299] Negotiation successful
0809 20:12:30.414996 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":373,"threads_started":1}
I20260809 20:12:30.416471 32120 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:12:30.494922 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 31920
I20260809 20:12:30.517021 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 31333
I20260809 20:12:30.518101 31436 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:12:30.619496 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 31333
2026-08-09T20:12:30Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2247 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:12:30 dist-test-slave-6zbq krb5kdc[32153](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:12:30 dist-test-slave-6zbq krb5kdc[32153](info): set up 2 sockets
Aug 09 20:12:30 dist-test-slave-6zbq krb5kdc[32153](info): commencing operation
krb5kdc: starting...
W20260809 20:12:31.809876 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.149s user 0.000s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:12:31 dist-test-slave-6zbq krb5kdc[32153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306351, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:12:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:12:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:12:32.042703 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:42055
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:34163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:42055
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:12:32.355829 32172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:12:32.356142 32172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:12:32.356426 32172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:12:32.363677 32172 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:12:32.363803 32172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:12:32.363881 32172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:12:32.363960 32172 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:12:32.364019 32172 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:12:32.373843 32172 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:34163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:42055
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:42055
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:12:32.375161 32172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:12:32.376444 32172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:12:32.387756 32187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:32.387802 32185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:32.387832 32184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:12:32.388809 32172 server_base.cc:1034] running on GCE node
I20260809 20:12:32.389475 32172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:12:32.390806 32172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:12:32.392004 32172 hybrid_clock.cc:648] HybridClock initialized: now 1786306352391964 us; error 27 us; skew 500 ppm
I20260809 20:12:32.392302 32172 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:12:32 dist-test-slave-6zbq krb5kdc[32153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306352, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:12:32.398593 32172 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:12:32.399976 32172 webserver.cc:460] Webserver started at http://127.14.181.62:41487/ using document root <none> and password file <none>
I20260809 20:12:32.400604 32172 fs_manager.cc:359] Metadata directory not provided
I20260809 20:12:32.400712 32172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:12:32.401005 32172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:12:32.403934 32172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "30825779b00b439f8f629549e8e15ad2"
format_stamp: "Formatted at 2026-08-09 20:12:32 on dist-test-slave-6zbq"
server_key: "8894f0a682c0d744b8497d3aca1dec1b"
server_key_iv: "dd080fd93ef3b3d517cda997b7681c2d"
server_key_version: "encryptionkey@0"
I20260809 20:12:32.404656 32172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "30825779b00b439f8f629549e8e15ad2"
format_stamp: "Formatted at 2026-08-09 20:12:32 on dist-test-slave-6zbq"
server_key: "8894f0a682c0d744b8497d3aca1dec1b"
server_key_iv: "dd080fd93ef3b3d517cda997b7681c2d"
server_key_version: "encryptionkey@0"
I20260809 20:12:32.409451 32172 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 20:12:32.412623 32197 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:32.413798 32172 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 20:12:32.413954 32172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "30825779b00b439f8f629549e8e15ad2"
format_stamp: "Formatted at 2026-08-09 20:12:32 on dist-test-slave-6zbq"
server_key: "8894f0a682c0d744b8497d3aca1dec1b"
server_key_iv: "dd080fd93ef3b3d517cda997b7681c2d"
server_key_version: "encryptionkey@0"
I20260809 20:12:32.414116 32172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:12:32.433861 32172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:12:32.437803 32172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:12:32.438052 32172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:12:32.454962 32172 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:42055
I20260809 20:12:32.455008 32278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:42055 every 8 connection(s)
I20260809 20:12:32.456229 32172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:12:32.459699 32280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:12:32.462956 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 32172
I20260809 20:12:32.463192 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:12:32.463810 15060 external_mini_cluster.cc:1428] Setting key a2beda8ca8eafd6e92635710e037c631
I20260809 20:12:32.472117 32280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30825779b00b439f8f629549e8e15ad2: Bootstrap starting.
I20260809 20:12:32.475347 32280 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 30825779b00b439f8f629549e8e15ad2: Neither blocks nor log segments found. Creating new log.
I20260809 20:12:32.476263 32280 log.cc:824] T 00000000000000000000000000000000 P 30825779b00b439f8f629549e8e15ad2: Log is configured to *not* fsync() on all Append() calls
Aug 09 20:12:32 dist-test-slave-6zbq krb5kdc[32153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306351, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:12:32.479277 32280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30825779b00b439f8f629549e8e15ad2: No bootstrap required, opened a new log
I20260809 20:12:32.485513 32284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:32.465690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36172 (local address 127.14.181.62:42055)
0809 20:12:32.466477 (+ 787us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:32.466492 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:32.466541 (+ 49us) server_negotiation.cc:407] Connection header received
0809 20:12:32.468155 (+ 1614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:32.468182 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:32.468672 (+ 490us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:32.469104 (+ 432us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:32.470433 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:32.472337 (+ 1904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:32.473569 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:32.474585 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:32.474767 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:32.478753 (+ 3986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:32.478761 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:32.478777 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:12:32.478817 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:32.481763 (+ 2946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:32.482551 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:32.482557 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:32.482563 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:32.482737 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:32.483127 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:32.483130 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:32.483132 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:32.483604 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:32.483850 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:32.484225 (+ 375us) server_negotiation.cc:299] Negotiation successful
0809 20:12:32.484545 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":318,"threads_started":1}
I20260809 20:12:32.488080 32280 raft_consensus.cc:348] T 00000000000000000000000000000000 P 30825779b00b439f8f629549e8e15ad2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30825779b00b439f8f629549e8e15ad2" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42055 } }
I20260809 20:12:32.488425 32280 raft_consensus.cc:374] T 00000000000000000000000000000000 P 30825779b00b439f8f629549e8e15ad2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:12:32.488507 32280 raft_consensus.cc:729] T 00000000000000000000000000000000 P 30825779b00b439f8f629549e8e15ad2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30825779b00b439f8f629549e8e15ad2, State: Initialized, Role: FOLLOWER
I20260809 20:12:32.488992 32280 consensus_queue.cc:260] T 00000000000000000000000000000000 P 30825779b00b439f8f629549e8e15ad2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30825779b00b439f8f629549e8e15ad2" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42055 } }
I20260809 20:12:32.489208 32280 raft_consensus.cc:388] T 00000000000000000000000000000000 P 30825779b00b439f8f629549e8e15ad2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:12:32.489327 32280 raft_consensus.cc:482] T 00000000000000000000000000000000 P 30825779b00b439f8f629549e8e15ad2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:12:32.489470 32280 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 30825779b00b439f8f629549e8e15ad2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:12:32.491494 32280 raft_consensus.cc:504] T 00000000000000000000000000000000 P 30825779b00b439f8f629549e8e15ad2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30825779b00b439f8f629549e8e15ad2" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42055 } }
I20260809 20:12:32.491925 32280 leader_election.cc:302] T 00000000000000000000000000000000 P 30825779b00b439f8f629549e8e15ad2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 30825779b00b439f8f629549e8e15ad2; no voters:
I20260809 20:12:32.492455 32280 leader_election.cc:288] T 00000000000000000000000000000000 P 30825779b00b439f8f629549e8e15ad2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:12:32.492537 32287 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 30825779b00b439f8f629549e8e15ad2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:12:32.493784 32287 raft_consensus.cc:686] T 00000000000000000000000000000000 P 30825779b00b439f8f629549e8e15ad2 [term 1 LEADER]: Becoming Leader. State: Replica: 30825779b00b439f8f629549e8e15ad2, State: Running, Role: LEADER
I20260809 20:12:32.494261 32287 consensus_queue.cc:237] T 00000000000000000000000000000000 P 30825779b00b439f8f629549e8e15ad2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30825779b00b439f8f629549e8e15ad2" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42055 } }
I20260809 20:12:32.494499 32280 sys_catalog.cc:564] T 00000000000000000000000000000000 P 30825779b00b439f8f629549e8e15ad2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:12:32.496920 32290 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30825779b00b439f8f629549e8e15ad2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "30825779b00b439f8f629549e8e15ad2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30825779b00b439f8f629549e8e15ad2" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42055 } } }
I20260809 20:12:32.497257 32290 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30825779b00b439f8f629549e8e15ad2 [sys.catalog]: This master's current role is: LEADER
I20260809 20:12:32.497483 32291 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30825779b00b439f8f629549e8e15ad2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 30825779b00b439f8f629549e8e15ad2. Latest consensus state: current_term: 1 leader_uuid: "30825779b00b439f8f629549e8e15ad2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30825779b00b439f8f629549e8e15ad2" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42055 } } }
I20260809 20:12:32.497885 32291 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30825779b00b439f8f629549e8e15ad2 [sys.catalog]: This master's current role is: LEADER
I20260809 20:12:32.499279 32300 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:12:32.503336 32300 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:12:32.510902 32300 catalog_manager.cc:1347] Generated new cluster ID: d174f999162c45b4bd586b798fa84b34
I20260809 20:12:32.510999 32300 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:12:32.534011 32300 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:12:32.535279 32300 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:12:32.544809 32300 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 30825779b00b439f8f629549e8e15ad2: Generated new TSK 0
I20260809 20:12:32.545547 32300 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.181.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
I20260809 20:12:32.607546 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:0
--local_ip_for_outbound_sockets=127.14.181.1
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:42055
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:34163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:12:32.922842 32317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:12:32.923105 32317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:12:32.923243 32317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:12:32.930136 32317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:12:32.930244 32317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:12:32.930425 32317 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:12:32.939512 32317 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:34163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:42055
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:12:32.940621 32317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:12:32.941988 32317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:12:32.953958 32330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:32.953962 32332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:32.954277 32329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:12:32.954865 32317 server_base.cc:1034] running on GCE node
I20260809 20:12:32.955396 32317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:12:32.956176 32317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:12:32.957356 32317 hybrid_clock.cc:648] HybridClock initialized: now 1786306352957311 us; error 44 us; skew 500 ppm
I20260809 20:12:32.957602 32317 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:12:32 dist-test-slave-6zbq krb5kdc[32153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306352, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:12:32.960517 32317 init.cc:377] Logged in from keytab as kudu/127.14.181.1@KRBTEST.COM (short username kudu)
I20260809 20:12:32.961771 32317 webserver.cc:460] Webserver started at http://127.14.181.1:46819/ using document root <none> and password file <none>
I20260809 20:12:32.962378 32317 fs_manager.cc:359] Metadata directory not provided
I20260809 20:12:32.962481 32317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:12:32.962720 32317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:12:32.965323 32317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/data/instance:
uuid: "a7deab548f004981820842dd0277110a"
format_stamp: "Formatted at 2026-08-09 20:12:32 on dist-test-slave-6zbq"
server_key: "fb5192293fcb14e186da2d3ab36f7a8f"
server_key_iv: "645e6d72e21c13b003740431c0bc0089"
server_key_version: "encryptionkey@0"
I20260809 20:12:32.965978 32317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance:
uuid: "a7deab548f004981820842dd0277110a"
format_stamp: "Formatted at 2026-08-09 20:12:32 on dist-test-slave-6zbq"
server_key: "fb5192293fcb14e186da2d3ab36f7a8f"
server_key_iv: "645e6d72e21c13b003740431c0bc0089"
server_key_version: "encryptionkey@0"
I20260809 20:12:32.970610 32317 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 20:12:32.973615 32342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:32.974799 32317 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:12:32.974921 32317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "a7deab548f004981820842dd0277110a"
format_stamp: "Formatted at 2026-08-09 20:12:32 on dist-test-slave-6zbq"
server_key: "fb5192293fcb14e186da2d3ab36f7a8f"
server_key_iv: "645e6d72e21c13b003740431c0bc0089"
server_key_version: "encryptionkey@0"
I20260809 20:12:32.975075 32317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:12:32.991204 32317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:12:32.994620 32317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:12:32.994901 32317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:12:32.995774 32317 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:12:32.996977 32317 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:12:32.997046 32317 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:32.997135 32317 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:12:32.997179 32317 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:33.025372 32317 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:46579
I20260809 20:12:33.025415 32531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:46579 every 8 connection(s)
I20260809 20:12:33.026567 32317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:12:33.030963 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 32317
I20260809 20:12:33.031153 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance
I20260809 20:12:33.031757 15060 external_mini_cluster.cc:1428] Setting key d17bb80315e13ecbacf00710994550a5
Aug 09 20:12:33 dist-test-slave-6zbq krb5kdc[32153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306352, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:12:33.045220 32535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:33.028862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:43335 (local address 127.14.181.62:42055)
0809 20:12:33.029283 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:33.029287 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:33.030087 (+ 800us) server_negotiation.cc:407] Connection header received
0809 20:12:33.031906 (+ 1819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:33.031911 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:33.031991 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:33.032089 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:33.033914 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:33.034708 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:33.036174 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:33.036560 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:33.036678 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:33.039844 (+ 3166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:33.039850 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:33.039853 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:12:33.039883 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:33.042263 (+ 2380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:33.042918 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:33.042923 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:33.042927 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:33.043042 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:33.043447 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:33.043451 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:33.043453 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:33.043728 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:33.043863 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:33.044491 (+ 628us) server_negotiation.cc:299] Negotiation successful
0809 20:12:33.044751 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":219,"threads_started":1}
I20260809 20:12:33.045908 32536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:33.029285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:42055 (local address 127.14.181.1:43335)
0809 20:12:33.029938 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:33.029979 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:33.031646 (+ 1667us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:33.032369 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:33.032380 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:33.033015 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:33.033749 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:33.033774 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:33.034856 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:33.034862 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:33.036034 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:33.036046 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:33.036771 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:33.036778 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:33.037008 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:33.037605 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:33.037630 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:33.039653 (+ 2023us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:12:33.042405 (+ 2752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:12:33.042414 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:12:33.042428 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:12:33.042807 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:12:33.043154 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:12:33.043158 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:12:33.043162 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:12:33.043332 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:12:33.043851 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:12:33.043858 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:12:33.044155 (+ 297us) client_negotiation.cc:769] Sending connection context
0809 20:12:33.044374 (+ 219us) client_negotiation.cc:240] Negotiation successful
0809 20:12:33.044826 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":262,"threads_started":1}
I20260809 20:12:33.047366 32533 heartbeater.cc:347] Connected to a master server at 127.14.181.62:42055
I20260809 20:12:33.047693 32533 heartbeater.cc:464] Registering TS with master...
I20260809 20:12:33.048501 32533 heartbeater.cc:511] Master 127.14.181.62:42055 requested a full tablet report, sending...
I20260809 20:12:33.050765 32223 ts_manager.cc:194] Registered new tserver with Master: a7deab548f004981820842dd0277110a (127.14.181.1:46579)
I20260809 20:12:33.052594 32223 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.1@KRBTEST.COM'} at 127.14.181.1:43335
WARNING: no policy specified for kudu/127.14.181.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
I20260809 20:12:33.083674 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:0
--local_ip_for_outbound_sockets=127.14.181.2
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:42055
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:34163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:12:33.399271 32543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:12:33.399514 32543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:12:33.399614 32543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:12:33.406518 32543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:12:33.406610 32543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:12:33.406723 32543 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:12:33.415799 32543 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:34163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:42055
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:12:33.416873 32543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:12:33.418097 32543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:12:33.430209 32549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:33.430126 32550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:33.430255 32555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:12:33.431114 32543 server_base.cc:1034] running on GCE node
I20260809 20:12:33.431674 32543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:12:33.432492 32543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:12:33.433681 32543 hybrid_clock.cc:648] HybridClock initialized: now 1786306353433628 us; error 44 us; skew 500 ppm
I20260809 20:12:33.433959 32543 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:12:33 dist-test-slave-6zbq krb5kdc[32153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306353, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:12:33.436798 32543 init.cc:377] Logged in from keytab as kudu/127.14.181.2@KRBTEST.COM (short username kudu)
I20260809 20:12:33.438045 32543 webserver.cc:460] Webserver started at http://127.14.181.2:46013/ using document root <none> and password file <none>
I20260809 20:12:33.438697 32543 fs_manager.cc:359] Metadata directory not provided
I20260809 20:12:33.438814 32543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:12:33.439081 32543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:12:33.441757 32543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/data/instance:
uuid: "94c32693b7cf458c9d96b44f48c8b824"
format_stamp: "Formatted at 2026-08-09 20:12:33 on dist-test-slave-6zbq"
server_key: "883020b854647ea0713a2f23d8aeaef5"
server_key_iv: "665bf000adf098800f116c7b6b6524d1"
server_key_version: "encryptionkey@0"
I20260809 20:12:33.442508 32543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance:
uuid: "94c32693b7cf458c9d96b44f48c8b824"
format_stamp: "Formatted at 2026-08-09 20:12:33 on dist-test-slave-6zbq"
server_key: "883020b854647ea0713a2f23d8aeaef5"
server_key_iv: "665bf000adf098800f116c7b6b6524d1"
server_key_version: "encryptionkey@0"
I20260809 20:12:33.447072 32543 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260809 20:12:33.450132 32567 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:33.451370 32543 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 20:12:33.451514 32543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "94c32693b7cf458c9d96b44f48c8b824"
format_stamp: "Formatted at 2026-08-09 20:12:33 on dist-test-slave-6zbq"
server_key: "883020b854647ea0713a2f23d8aeaef5"
server_key_iv: "665bf000adf098800f116c7b6b6524d1"
server_key_version: "encryptionkey@0"
I20260809 20:12:33.451675 32543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:12:33.472640 32543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:12:33.476099 32543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:12:33.476339 32543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:12:33.477144 32543 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:12:33.478582 32543 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:12:33.478668 32543 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:33.478783 32543 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:12:33.478835 32543 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:33.506803 32543 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:44347
I20260809 20:12:33.506862 32749 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:44347 every 8 connection(s)
I20260809 20:12:33.507933 32543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:12:33.511809 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 32543
I20260809 20:12:33.512012 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance
I20260809 20:12:33.512562 15060 external_mini_cluster.cc:1428] Setting key a21a0a927e4e548a5b100509f28484df
Aug 09 20:12:33 dist-test-slave-6zbq krb5kdc[32153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306353, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:12:33.527704 32535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:33.510137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:33331 (local address 127.14.181.62:42055)
0809 20:12:33.510368 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:33.510374 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:33.511457 (+ 1083us) server_negotiation.cc:407] Connection header received
0809 20:12:33.513661 (+ 2204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:33.513668 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:33.513749 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:33.513836 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:33.515624 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:33.516347 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:33.518320 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:33.518851 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:33.518951 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:33.522501 (+ 3550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:33.522506 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:33.522510 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:12:33.522540 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:33.524900 (+ 2360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:33.525563 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:33.525567 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:33.525569 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:33.525707 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:33.526101 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:33.526106 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:33.526108 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:33.526382 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:33.526522 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:33.527137 (+ 615us) server_negotiation.cc:299] Negotiation successful
0809 20:12:33.527357 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 20:12:33.528533 32752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:33.510637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:42055 (local address 127.14.181.2:33331)
0809 20:12:33.511312 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:33.511347 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:33.513406 (+ 2059us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:33.514065 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:33.514073 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:33.514726 (+ 653us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:33.515454 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:33.515482 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:33.516497 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:33.516503 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:33.518201 (+ 1698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:33.518216 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:33.519059 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:33.519065 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:33.519319 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:33.519964 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:33.519991 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:33.522284 (+ 2293us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:12:33.525026 (+ 2742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:12:33.525035 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:12:33.525049 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:12:33.525444 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:12:33.525808 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:12:33.525813 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:12:33.525817 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:12:33.525987 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:12:33.526498 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:12:33.526506 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:12:33.526801 (+ 295us) client_negotiation.cc:769] Sending connection context
0809 20:12:33.527014 (+ 213us) client_negotiation.cc:240] Negotiation successful
0809 20:12:33.527489 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":251,"threads_started":1}
I20260809 20:12:33.529763 32750 heartbeater.cc:347] Connected to a master server at 127.14.181.62:42055
I20260809 20:12:33.530025 32750 heartbeater.cc:464] Registering TS with master...
I20260809 20:12:33.530715 32750 heartbeater.cc:511] Master 127.14.181.62:42055 requested a full tablet report, sending...
I20260809 20:12:33.532048 32223 ts_manager.cc:194] Registered new tserver with Master: 94c32693b7cf458c9d96b44f48c8b824 (127.14.181.2:44347)
I20260809 20:12:33.533030 32223 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.2@KRBTEST.COM'} at 127.14.181.2:33331
WARNING: no policy specified for kudu/127.14.181.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
I20260809 20:12:33.566550 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:0
--local_ip_for_outbound_sockets=127.14.181.3
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:42055
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:34163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:12:33.877043 32755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:12:33.877296 32755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:12:33.877440 32755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:12:33.884603 32755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:12:33.884713 32755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:12:33.884832 32755 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:12:33.894033 32755 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:34163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:42055
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:12:33.895249 32755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:12:33.896422 32755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:12:33.908183 32762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:33.908250 32761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:12:33.908214 32764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:12:33.909039 32755 server_base.cc:1034] running on GCE node
I20260809 20:12:33.909554 32755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:12:33.910382 32755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:12:33.911576 32755 hybrid_clock.cc:648] HybridClock initialized: now 1786306353911533 us; error 39 us; skew 500 ppm
I20260809 20:12:33.911852 32755 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:12:33 dist-test-slave-6zbq krb5kdc[32153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306353, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:12:33.914729 32755 init.cc:377] Logged in from keytab as kudu/127.14.181.3@KRBTEST.COM (short username kudu)
I20260809 20:12:33.915951 32755 webserver.cc:460] Webserver started at http://127.14.181.3:46625/ using document root <none> and password file <none>
I20260809 20:12:33.916553 32755 fs_manager.cc:359] Metadata directory not provided
I20260809 20:12:33.916663 32755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:12:33.916927 32755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:12:33.919768 32755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/data/instance:
uuid: "5b1183422601417eb6be672f7b533c1e"
format_stamp: "Formatted at 2026-08-09 20:12:33 on dist-test-slave-6zbq"
server_key: "9820ebf4aeaf5475f0465cbccf4fe966"
server_key_iv: "4890a42fdf08ad8def50770c813981a7"
server_key_version: "encryptionkey@0"
I20260809 20:12:33.920462 32755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance:
uuid: "5b1183422601417eb6be672f7b533c1e"
format_stamp: "Formatted at 2026-08-09 20:12:33 on dist-test-slave-6zbq"
server_key: "9820ebf4aeaf5475f0465cbccf4fe966"
server_key_iv: "4890a42fdf08ad8def50770c813981a7"
server_key_version: "encryptionkey@0"
I20260809 20:12:33.925148 32755 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 20:12:33.928316 305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:33.929437 32755 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 20:12:33.929584 32755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "5b1183422601417eb6be672f7b533c1e"
format_stamp: "Formatted at 2026-08-09 20:12:33 on dist-test-slave-6zbq"
server_key: "9820ebf4aeaf5475f0465cbccf4fe966"
server_key_iv: "4890a42fdf08ad8def50770c813981a7"
server_key_version: "encryptionkey@0"
I20260809 20:12:33.929762 32755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:12:33.945564 32755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:12:33.948951 32755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:12:33.949191 32755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:12:33.949990 32755 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:12:33.951185 32755 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:12:33.951260 32755 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:33.951383 32755 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:12:33.951435 32755 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:12:33.980566 32755 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:35823
I20260809 20:12:33.980619 489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:35823 every 8 connection(s)
I20260809 20:12:33.981688 32755 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:12:33.985813 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 32755
I20260809 20:12:33.985976 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance
I20260809 20:12:33.986405 15060 external_mini_cluster.cc:1428] Setting key b20ac1de84857e5fda6c7696e565c34c
Aug 09 20:12:33 dist-test-slave-6zbq krb5kdc[32153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306353, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:12:34.000425 32535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:33.983894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:44331 (local address 127.14.181.62:42055)
0809 20:12:33.984070 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:33.984076 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:33.985170 (+ 1094us) server_negotiation.cc:407] Connection header received
0809 20:12:33.987034 (+ 1864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:33.987038 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:33.987123 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:33.987228 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:33.989016 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:33.989918 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:33.991574 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:33.991971 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:33.992063 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:33.995313 (+ 3250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:33.995319 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:33.995322 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:12:33.995356 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:33.997606 (+ 2250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:33.998220 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:33.998223 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:33.998226 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:33.998372 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:33.998761 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:33.998764 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:33.998766 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:33.999046 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:33.999161 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:33.999849 (+ 688us) server_negotiation.cc:299] Negotiation successful
0809 20:12:34.000038 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 20:12:34.001478 495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:33.984295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:42055 (local address 127.14.181.3:44331)
0809 20:12:33.984988 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:33.985041 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:33.986741 (+ 1700us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:33.987497 (+ 756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:33.987508 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:33.988094 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:12:33.988828 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:33.988855 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:33.990067 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:33.990071 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:33.991453 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:33.991466 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:33.992175 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:33.992180 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:33.992373 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:33.992961 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:12:33.992982 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:12:33.995103 (+ 2121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:12:33.997723 (+ 2620us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:12:33.997732 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:12:33.997744 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:12:33.998126 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:12:33.998448 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:12:33.998451 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:12:33.998453 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:12:33.998674 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:12:33.999192 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:12:33.999198 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:12:33.999493 (+ 295us) client_negotiation.cc:769] Sending connection context
0809 20:12:33.999726 (+ 233us) client_negotiation.cc:240] Negotiation successful
0809 20:12:34.000168 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":276,"threads_started":1}
I20260809 20:12:34.002772 490 heartbeater.cc:347] Connected to a master server at 127.14.181.62:42055
I20260809 20:12:34.003024 490 heartbeater.cc:464] Registering TS with master...
I20260809 20:12:34.003692 490 heartbeater.cc:511] Master 127.14.181.62:42055 requested a full tablet report, sending...
I20260809 20:12:34.005014 32223 ts_manager.cc:194] Registered new tserver with Master: 5b1183422601417eb6be672f7b533c1e (127.14.181.3:35823)
I20260809 20:12:34.005792 32223 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.3@KRBTEST.COM'} at 127.14.181.3:44331
I20260809 20:12:34.014006 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 20:12:34.030611 32535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:34.018235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36180 (local address 127.14.181.62:42055)
0809 20:12:34.018434 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:34.018440 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:34.018937 (+ 497us) server_negotiation.cc:407] Connection header received
0809 20:12:34.019075 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:34.019078 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:34.019134 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:34.019211 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:34.020491 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.021199 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.022306 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.022741 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.022834 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:34.024849 (+ 2015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:34.024855 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:34.024859 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:12:34.024895 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:34.028081 (+ 3186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:34.028691 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:34.028697 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:34.028700 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:34.028863 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:34.029180 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:34.029185 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:34.029188 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:34.029557 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:34.029788 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:34.030059 (+ 271us) server_negotiation.cc:299] Negotiation successful
0809 20:12:34.030264 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 20:12:34.034202 32223 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36180:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 20:12:34.040722 32223 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 20:12:34.055810 32533 heartbeater.cc:503] Master 127.14.181.62:42055 was elected leader, sending a full tablet report...
I20260809 20:12:34.072780 515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:34.051774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54286 (local address 127.14.181.1:46579)
0809 20:12:34.063776 (+ 12002us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:34.063785 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:34.064542 (+ 757us) server_negotiation.cc:407] Connection header received
0809 20:12:34.064633 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:34.064640 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:34.064883 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:34.065061 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:12:34.066451 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.067931 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.069995 (+ 2064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.071348 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.071483 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:34.071701 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:34.072331 (+ 630us) server_negotiation.cc:299] Negotiation successful
0809 20:12:34.072488 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11833,"thread_start_us":11661,"threads_started":1}
I20260809 20:12:34.072876 519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:34.052329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33132 (local address 127.14.181.3:35823)
0809 20:12:34.063100 (+ 10771us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:34.063109 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:34.064310 (+ 1201us) server_negotiation.cc:407] Connection header received
0809 20:12:34.064608 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:34.064616 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:34.064839 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:34.065007 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:12:34.066164 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.067826 (+ 1662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.070332 (+ 2506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.071697 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.071824 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:34.072030 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:34.072373 (+ 343us) server_negotiation.cc:299] Negotiation successful
0809 20:12:34.072525 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10577,"thread_start_us":10769,"threads_started":1}
I20260809 20:12:34.073172 514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:34.051538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:46579 (local address 127.0.0.1:54286)
0809 20:12:34.064144 (+ 12606us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:34.064192 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:34.064357 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:34.065140 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:34.065160 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:34.065188 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:12:34.066201 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:34.066215 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.068038 (+ 1823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.068044 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:34.069845 (+ 1801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:34.069858 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.071851 (+ 1993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.071858 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:34.072052 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:34.072154 (+ 102us) client_negotiation.cc:769] Sending connection context
0809 20:12:34.072262 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 20:12:34.072441 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12370,"mutex_wait_us":547,"thread_start_us":12232,"threads_started":1}
I20260809 20:12:34.073642 517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:34.051840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:35823 (local address 127.0.0.1:33132)
0809 20:12:34.064187 (+ 12347us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:34.064211 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:34.064416 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:34.065346 (+ 930us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:34.065352 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:34.065379 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:12:34.065890 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:34.065905 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.067995 (+ 2090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.068000 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:34.070161 (+ 2161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:34.070176 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.071906 (+ 1730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.071913 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:34.072114 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:34.072170 (+ 56us) client_negotiation.cc:769] Sending connection context
0809 20:12:34.072266 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 20:12:34.073146 (+ 880us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12230,"mutex_wait_us":87,"thread_start_us":12107,"threads_started":1}
I20260809 20:12:34.073684 525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:34.065395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:44347 (local address 127.0.0.1:40010)
0809 20:12:34.066162 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:34.066180 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:34.066289 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:34.066742 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:34.066746 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:34.066778 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:12:34.067103 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:34.067115 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.068949 (+ 1834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.068954 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:34.071032 (+ 2078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:34.071046 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.072891 (+ 1845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.072898 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:34.073051 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:34.073081 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 20:12:34.073196 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 20:12:34.073306 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":605,"mutex_wait_us":1,"thread_start_us":448,"threads_started":1}
I20260809 20:12:34.073719 521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:34.064764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40010 (local address 127.14.181.2:44347)
0809 20:12:34.065776 (+ 1012us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:34.065786 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:34.066280 (+ 494us) server_negotiation.cc:407] Connection header received
0809 20:12:34.066438 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:34.066444 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:34.066584 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:34.066737 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:12:34.067281 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.068745 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.071220 (+ 2475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.072445 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.072563 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:34.072731 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:34.073261 (+ 530us) server_negotiation.cc:299] Negotiation successful
0809 20:12:34.073433 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":843,"thread_start_us":744,"threads_started":1}
I20260809 20:12:34.076923 395 tablet_service.cc:1467] Processing CreateTablet for tablet d833afc30d74451db395a0294f13c610 (DEFAULT_TABLE table=test-table [id=d8d2d6c993284fb096075ac256ad9031]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:12:34.077100 32641 tablet_service.cc:1467] Processing CreateTablet for tablet d833afc30d74451db395a0294f13c610 (DEFAULT_TABLE table=test-table [id=d8d2d6c993284fb096075ac256ad9031]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:12:34.077100 32436 tablet_service.cc:1467] Processing CreateTablet for tablet d833afc30d74451db395a0294f13c610 (DEFAULT_TABLE table=test-table [id=d8d2d6c993284fb096075ac256ad9031]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:12:34.078115 395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d833afc30d74451db395a0294f13c610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:12:34.078419 32641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d833afc30d74451db395a0294f13c610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:12:34.078430 32436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d833afc30d74451db395a0294f13c610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:12:34.088907 527 tablet_bootstrap.cc:492] T d833afc30d74451db395a0294f13c610 P 5b1183422601417eb6be672f7b533c1e: Bootstrap starting.
I20260809 20:12:34.092016 528 tablet_bootstrap.cc:492] T d833afc30d74451db395a0294f13c610 P 94c32693b7cf458c9d96b44f48c8b824: Bootstrap starting.
I20260809 20:12:34.092183 527 tablet_bootstrap.cc:654] T d833afc30d74451db395a0294f13c610 P 5b1183422601417eb6be672f7b533c1e: Neither blocks nor log segments found. Creating new log.
I20260809 20:12:34.094568 527 log.cc:824] T d833afc30d74451db395a0294f13c610 P 5b1183422601417eb6be672f7b533c1e: Log is configured to *not* fsync() on all Append() calls
I20260809 20:12:34.095463 528 tablet_bootstrap.cc:654] T d833afc30d74451db395a0294f13c610 P 94c32693b7cf458c9d96b44f48c8b824: Neither blocks nor log segments found. Creating new log.
I20260809 20:12:34.095928 529 tablet_bootstrap.cc:492] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a: Bootstrap starting.
I20260809 20:12:34.096647 528 log.cc:824] T d833afc30d74451db395a0294f13c610 P 94c32693b7cf458c9d96b44f48c8b824: Log is configured to *not* fsync() on all Append() calls
I20260809 20:12:34.097697 527 tablet_bootstrap.cc:492] T d833afc30d74451db395a0294f13c610 P 5b1183422601417eb6be672f7b533c1e: No bootstrap required, opened a new log
I20260809 20:12:34.098024 527 ts_tablet_manager.cc:1397] T d833afc30d74451db395a0294f13c610 P 5b1183422601417eb6be672f7b533c1e: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260809 20:12:34.099583 529 tablet_bootstrap.cc:654] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a: Neither blocks nor log segments found. Creating new log.
I20260809 20:12:34.099627 528 tablet_bootstrap.cc:492] T d833afc30d74451db395a0294f13c610 P 94c32693b7cf458c9d96b44f48c8b824: No bootstrap required, opened a new log
I20260809 20:12:34.099869 528 ts_tablet_manager.cc:1397] T d833afc30d74451db395a0294f13c610 P 94c32693b7cf458c9d96b44f48c8b824: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 20:12:34.100783 529 log.cc:824] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a: Log is configured to *not* fsync() on all Append() calls
I20260809 20:12:34.105544 527 raft_consensus.cc:348] T d833afc30d74451db395a0294f13c610 P 5b1183422601417eb6be672f7b533c1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7deab548f004981820842dd0277110a" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 46579 } } peers { permanent_uuid: "5b1183422601417eb6be672f7b533c1e" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35823 } } peers { permanent_uuid: "94c32693b7cf458c9d96b44f48c8b824" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 44347 } }
I20260809 20:12:34.105871 527 raft_consensus.cc:374] T d833afc30d74451db395a0294f13c610 P 5b1183422601417eb6be672f7b533c1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:12:34.105965 527 raft_consensus.cc:729] T d833afc30d74451db395a0294f13c610 P 5b1183422601417eb6be672f7b533c1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b1183422601417eb6be672f7b533c1e, State: Initialized, Role: FOLLOWER
I20260809 20:12:34.106683 527 consensus_queue.cc:260] T d833afc30d74451db395a0294f13c610 P 5b1183422601417eb6be672f7b533c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7deab548f004981820842dd0277110a" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 46579 } } peers { permanent_uuid: "5b1183422601417eb6be672f7b533c1e" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35823 } } peers { permanent_uuid: "94c32693b7cf458c9d96b44f48c8b824" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 44347 } }
I20260809 20:12:34.107673 490 heartbeater.cc:503] Master 127.14.181.62:42055 was elected leader, sending a full tablet report...
I20260809 20:12:34.108430 529 tablet_bootstrap.cc:492] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a: No bootstrap required, opened a new log
I20260809 20:12:34.108675 529 ts_tablet_manager.cc:1397] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.005s
I20260809 20:12:34.109221 527 ts_tablet_manager.cc:1428] T d833afc30d74451db395a0294f13c610 P 5b1183422601417eb6be672f7b533c1e: Time spent starting tablet: real 0.011s user 0.009s sys 0.000s
I20260809 20:12:34.109879 528 raft_consensus.cc:348] T d833afc30d74451db395a0294f13c610 P 94c32693b7cf458c9d96b44f48c8b824 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7deab548f004981820842dd0277110a" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 46579 } } peers { permanent_uuid: "5b1183422601417eb6be672f7b533c1e" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35823 } } peers { permanent_uuid: "94c32693b7cf458c9d96b44f48c8b824" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 44347 } }
I20260809 20:12:34.110281 528 raft_consensus.cc:374] T d833afc30d74451db395a0294f13c610 P 94c32693b7cf458c9d96b44f48c8b824 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:12:34.110396 528 raft_consensus.cc:729] T d833afc30d74451db395a0294f13c610 P 94c32693b7cf458c9d96b44f48c8b824 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94c32693b7cf458c9d96b44f48c8b824, State: Initialized, Role: FOLLOWER
I20260809 20:12:34.110968 528 consensus_queue.cc:260] T d833afc30d74451db395a0294f13c610 P 94c32693b7cf458c9d96b44f48c8b824 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7deab548f004981820842dd0277110a" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 46579 } } peers { permanent_uuid: "5b1183422601417eb6be672f7b533c1e" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35823 } } peers { permanent_uuid: "94c32693b7cf458c9d96b44f48c8b824" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 44347 } }
I20260809 20:12:34.114202 32750 heartbeater.cc:503] Master 127.14.181.62:42055 was elected leader, sending a full tablet report...
I20260809 20:12:34.114518 528 ts_tablet_manager.cc:1428] T d833afc30d74451db395a0294f13c610 P 94c32693b7cf458c9d96b44f48c8b824: Time spent starting tablet: real 0.015s user 0.012s sys 0.004s
I20260809 20:12:34.117302 529 raft_consensus.cc:348] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7deab548f004981820842dd0277110a" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 46579 } } peers { permanent_uuid: "5b1183422601417eb6be672f7b533c1e" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35823 } } peers { permanent_uuid: "94c32693b7cf458c9d96b44f48c8b824" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 44347 } }
I20260809 20:12:34.117660 529 raft_consensus.cc:374] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:12:34.117754 529 raft_consensus.cc:729] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7deab548f004981820842dd0277110a, State: Initialized, Role: FOLLOWER
I20260809 20:12:34.118212 529 consensus_queue.cc:260] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7deab548f004981820842dd0277110a" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 46579 } } peers { permanent_uuid: "5b1183422601417eb6be672f7b533c1e" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35823 } } peers { permanent_uuid: "94c32693b7cf458c9d96b44f48c8b824" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 44347 } }
I20260809 20:12:34.119666 529 ts_tablet_manager.cc:1428] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a: Time spent starting tablet: real 0.011s user 0.003s sys 0.008s
W20260809 20:12:34.233166 493 tablet.cc:2369] T d833afc30d74451db395a0294f13c610 P 5b1183422601417eb6be672f7b533c1e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 20:12:34.259672 32751 tablet.cc:2369] T d833afc30d74451db395a0294f13c610 P 94c32693b7cf458c9d96b44f48c8b824: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 20:12:34.278723 32534 tablet.cc:2369] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:12:34.296022 536 raft_consensus.cc:482] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:12:34.296281 536 raft_consensus.cc:504] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7deab548f004981820842dd0277110a" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 46579 } } peers { permanent_uuid: "5b1183422601417eb6be672f7b533c1e" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35823 } } peers { permanent_uuid: "94c32693b7cf458c9d96b44f48c8b824" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 44347 } }
I20260809 20:12:34.297881 536 leader_election.cc:288] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b1183422601417eb6be672f7b533c1e (127.14.181.3:35823), 94c32693b7cf458c9d96b44f48c8b824 (127.14.181.2:44347)
I20260809 20:12:34.305493 519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:34.298309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:50691 (local address 127.14.181.3:35823)
0809 20:12:34.298509 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:34.298514 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:34.299017 (+ 503us) server_negotiation.cc:407] Connection header received
0809 20:12:34.299244 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:34.299249 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:34.299332 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:34.299431 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:12:34.300160 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.301231 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.303731 (+ 2500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.304509 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.304651 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:34.304724 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:34.305127 (+ 403us) server_negotiation.cc:299] Negotiation successful
0809 20:12:34.305253 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 20:12:34.305514 521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:34.299390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:49669 (local address 127.14.181.2:44347)
0809 20:12:34.299585 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:34.299590 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:34.299756 (+ 166us) server_negotiation.cc:407] Connection header received
0809 20:12:34.299948 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:34.299951 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:34.300007 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:34.300076 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:12:34.300549 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.301494 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.303809 (+ 2315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.304568 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.304724 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:34.304804 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:34.305145 (+ 341us) server_negotiation.cc:299] Negotiation successful
0809 20:12:34.305269 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 20:12:34.305625 538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:34.298237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:35823 (local address 127.14.181.1:50691)
0809 20:12:34.298930 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:34.298948 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:34.299088 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:34.299571 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:34.299576 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:34.299610 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:12:34.300018 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:34.300029 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.301351 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.301355 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:34.303545 (+ 2190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:34.303566 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.304740 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.304746 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:34.304960 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:34.304997 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 20:12:34.305068 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 20:12:34.305188 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"mutex_wait_us":43,"thread_start_us":384,"threads_started":1}
I20260809 20:12:34.305675 541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:34.299070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:44347 (local address 127.14.181.1:49669)
0809 20:12:34.299669 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0809 20:12:34.299685 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:12:34.299835 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:12:34.300119 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:12:34.300124 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:12:34.300149 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:12:34.300409 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:34.300416 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.301618 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.301623 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:34.303655 (+ 2032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:12:34.303667 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.304802 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.304808 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:12:34.304974 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:34.305014 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 20:12:34.305110 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 20:12:34.305240 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"mutex_wait_us":58,"spinlock_wait_cycles":26368,"thread_start_us":273,"threads_started":1}
I20260809 20:12:34.306636 426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d833afc30d74451db395a0294f13c610" candidate_uuid: "a7deab548f004981820842dd0277110a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b1183422601417eb6be672f7b533c1e" is_pre_election: true
I20260809 20:12:34.306638 32681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d833afc30d74451db395a0294f13c610" candidate_uuid: "a7deab548f004981820842dd0277110a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94c32693b7cf458c9d96b44f48c8b824" is_pre_election: true
I20260809 20:12:34.307096 32681 raft_consensus.cc:2454] T d833afc30d74451db395a0294f13c610 P 94c32693b7cf458c9d96b44f48c8b824 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7deab548f004981820842dd0277110a in term 0.
I20260809 20:12:34.307104 426 raft_consensus.cc:2454] T d833afc30d74451db395a0294f13c610 P 5b1183422601417eb6be672f7b533c1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7deab548f004981820842dd0277110a in term 0.
I20260809 20:12:34.307704 32347 leader_election.cc:302] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b1183422601417eb6be672f7b533c1e, a7deab548f004981820842dd0277110a; no voters:
I20260809 20:12:34.308049 536 raft_consensus.cc:2781] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:12:34.308225 536 raft_consensus.cc:482] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:12:34.308338 536 raft_consensus.cc:3037] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:12:34.310899 536 raft_consensus.cc:504] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7deab548f004981820842dd0277110a" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 46579 } } peers { permanent_uuid: "5b1183422601417eb6be672f7b533c1e" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35823 } } peers { permanent_uuid: "94c32693b7cf458c9d96b44f48c8b824" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 44347 } }
I20260809 20:12:34.311430 536 leader_election.cc:288] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a [CANDIDATE]: Term 1 election: Requested vote from peers 5b1183422601417eb6be672f7b533c1e (127.14.181.3:35823), 94c32693b7cf458c9d96b44f48c8b824 (127.14.181.2:44347)
I20260809 20:12:34.311898 426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d833afc30d74451db395a0294f13c610" candidate_uuid: "a7deab548f004981820842dd0277110a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b1183422601417eb6be672f7b533c1e"
I20260809 20:12:34.311942 32681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d833afc30d74451db395a0294f13c610" candidate_uuid: "a7deab548f004981820842dd0277110a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94c32693b7cf458c9d96b44f48c8b824"
I20260809 20:12:34.312110 32681 raft_consensus.cc:3037] T d833afc30d74451db395a0294f13c610 P 94c32693b7cf458c9d96b44f48c8b824 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:12:34.312120 426 raft_consensus.cc:3037] T d833afc30d74451db395a0294f13c610 P 5b1183422601417eb6be672f7b533c1e [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:12:34.315191 426 raft_consensus.cc:2454] T d833afc30d74451db395a0294f13c610 P 5b1183422601417eb6be672f7b533c1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7deab548f004981820842dd0277110a in term 1.
I20260809 20:12:34.315183 32681 raft_consensus.cc:2454] T d833afc30d74451db395a0294f13c610 P 94c32693b7cf458c9d96b44f48c8b824 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7deab548f004981820842dd0277110a in term 1.
I20260809 20:12:34.315588 32347 leader_election.cc:302] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94c32693b7cf458c9d96b44f48c8b824, a7deab548f004981820842dd0277110a; no voters:
I20260809 20:12:34.315845 536 raft_consensus.cc:2781] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:12:34.316277 536 raft_consensus.cc:686] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a [term 1 LEADER]: Becoming Leader. State: Replica: a7deab548f004981820842dd0277110a, State: Running, Role: LEADER
I20260809 20:12:34.316787 536 consensus_queue.cc:237] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7deab548f004981820842dd0277110a" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 46579 } } peers { permanent_uuid: "5b1183422601417eb6be672f7b533c1e" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35823 } } peers { permanent_uuid: "94c32693b7cf458c9d96b44f48c8b824" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 44347 } }
I20260809 20:12:34.321327 32223 catalog_manager.cc:5495] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a reported cstate change: term changed from 0 to 1, leader changed from <none> to a7deab548f004981820842dd0277110a (127.14.181.1). New cstate: current_term: 1 leader_uuid: "a7deab548f004981820842dd0277110a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7deab548f004981820842dd0277110a" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 46579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b1183422601417eb6be672f7b533c1e" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94c32693b7cf458c9d96b44f48c8b824" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260809 20:12:34.363456 515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:34.358623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54292 (local address 127.14.181.1:46579)
0809 20:12:34.358863 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:34.358868 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:34.358886 (+ 18us) server_negotiation.cc:407] Connection header received
0809 20:12:34.359032 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:34.359036 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:34.359112 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:34.359230 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:12:34.359503 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.360197 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.361566 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.361952 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.362038 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:34.362498 (+ 460us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:12:34.362974 (+ 476us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:12:34.363080 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:34.363153 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 20:12:34.363215 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 20:12:34.371048 426 raft_consensus.cc:1261] T d833afc30d74451db395a0294f13c610 P 5b1183422601417eb6be672f7b533c1e [term 1 FOLLOWER]: Refusing update from remote peer a7deab548f004981820842dd0277110a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:12:34.371147 32681 raft_consensus.cc:1261] T d833afc30d74451db395a0294f13c610 P 94c32693b7cf458c9d96b44f48c8b824 [term 1 FOLLOWER]: Refusing update from remote peer a7deab548f004981820842dd0277110a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:12:34.371989 546 consensus_queue.cc:1035] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b1183422601417eb6be672f7b533c1e" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:12:34.372339 536 consensus_queue.cc:1035] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a [LEADER]: Connected to new peer: Peer: permanent_uuid: "94c32693b7cf458c9d96b44f48c8b824" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:12:34.396384 32223 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36180:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:12:34.396618 32223 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36180:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:12:34.399966 32223 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 30825779b00b439f8f629549e8e15ad2: Sending DeleteTablet for 3 replicas of tablet d833afc30d74451db395a0294f13c610
I20260809 20:12:34.401005 32436 tablet_service.cc:1514] Processing DeleteTablet for tablet d833afc30d74451db395a0294f13c610 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:12:34 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:54286
I20260809 20:12:34.401403 32641 tablet_service.cc:1514] Processing DeleteTablet for tablet d833afc30d74451db395a0294f13c610 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:12:34 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:40010
I20260809 20:12:34.401443 395 tablet_service.cc:1514] Processing DeleteTablet for tablet d833afc30d74451db395a0294f13c610 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:12:34 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:33132
I20260809 20:12:34.404551 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 32317
I20260809 20:12:34.414077 563 tablet_replica.cc:330] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a: stopping tablet replica
I20260809 20:12:34.415400 563 raft_consensus.cc:2229] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a [term 1 LEADER]: Raft consensus shutting down.
I20260809 20:12:34.416149 563 raft_consensus.cc:2258] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:12:34.420151 563 ts_tablet_manager.cc:1905] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:12:34.425778 564 tablet_replica.cc:330] T d833afc30d74451db395a0294f13c610 P 94c32693b7cf458c9d96b44f48c8b824: stopping tablet replica
I20260809 20:12:34.426184 564 raft_consensus.cc:2229] T d833afc30d74451db395a0294f13c610 P 94c32693b7cf458c9d96b44f48c8b824 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:12:34.426748 564 raft_consensus.cc:2258] T d833afc30d74451db395a0294f13c610 P 94c32693b7cf458c9d96b44f48c8b824 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:12:34.427485 566 tablet_replica.cc:330] T d833afc30d74451db395a0294f13c610 P 5b1183422601417eb6be672f7b533c1e: stopping tablet replica
I20260809 20:12:34.427929 566 raft_consensus.cc:2229] T d833afc30d74451db395a0294f13c610 P 5b1183422601417eb6be672f7b533c1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:12:34.428318 566 raft_consensus.cc:2258] T d833afc30d74451db395a0294f13c610 P 5b1183422601417eb6be672f7b533c1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:12:34.428915 563 ts_tablet_manager.cc:1918] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:12:34.429106 563 log.cc:1196] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-0/wal/wals/d833afc30d74451db395a0294f13c610
I20260809 20:12:34.429678 563 ts_tablet_manager.cc:1939] T d833afc30d74451db395a0294f13c610 P a7deab548f004981820842dd0277110a: Deleting consensus metadata
I20260809 20:12:34.431298 566 ts_tablet_manager.cc:1905] T d833afc30d74451db395a0294f13c610 P 5b1183422601417eb6be672f7b533c1e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:12:34.431717 564 ts_tablet_manager.cc:1905] T d833afc30d74451db395a0294f13c610 P 94c32693b7cf458c9d96b44f48c8b824: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:12:34.431957 32198 catalog_manager.cc:4841] TS a7deab548f004981820842dd0277110a (127.14.181.1:46579): tablet d833afc30d74451db395a0294f13c610 (table test-table [id=d8d2d6c993284fb096075ac256ad9031]) successfully deleted
Aug 09 20:12:34 dist-test-slave-6zbq krb5kdc[32153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306351, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.1@KRBTEST.COM
I20260809 20:12:34.438335 566 ts_tablet_manager.cc:1918] T d833afc30d74451db395a0294f13c610 P 5b1183422601417eb6be672f7b533c1e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:12:34.438335 564 ts_tablet_manager.cc:1918] T d833afc30d74451db395a0294f13c610 P 94c32693b7cf458c9d96b44f48c8b824: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:12:34.438676 566 log.cc:1196] T d833afc30d74451db395a0294f13c610 P 5b1183422601417eb6be672f7b533c1e: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-2/wal/wals/d833afc30d74451db395a0294f13c610
I20260809 20:12:34.438714 564 log.cc:1196] T d833afc30d74451db395a0294f13c610 P 94c32693b7cf458c9d96b44f48c8b824: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786306256699363-15060-0/minicluster-data/ts-1/wal/wals/d833afc30d74451db395a0294f13c610
I20260809 20:12:34.439252 564 ts_tablet_manager.cc:1939] T d833afc30d74451db395a0294f13c610 P 94c32693b7cf458c9d96b44f48c8b824: Deleting consensus metadata
I20260809 20:12:34.440343 566 ts_tablet_manager.cc:1939] T d833afc30d74451db395a0294f13c610 P 5b1183422601417eb6be672f7b533c1e: Deleting consensus metadata
I20260809 20:12:34.441129 32199 catalog_manager.cc:4841] TS 94c32693b7cf458c9d96b44f48c8b824 (127.14.181.2:44347): tablet d833afc30d74451db395a0294f13c610 (table test-table [id=d8d2d6c993284fb096075ac256ad9031]) successfully deleted
I20260809 20:12:34.442055 32199 catalog_manager.cc:4841] TS 5b1183422601417eb6be672f7b533c1e (127.14.181.3:35823): tablet d833afc30d74451db395a0294f13c610 (table test-table [id=d8d2d6c993284fb096075ac256ad9031]) successfully deleted
I20260809 20:12:34.446009 515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:34.406682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54308 (local address 127.14.181.1:46579)
0809 20:12:34.406878 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:34.406884 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:34.419110 (+ 12226us) server_negotiation.cc:407] Connection header received
0809 20:12:34.419643 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:34.419650 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:34.419787 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:34.419873 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:34.421812 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.423249 (+ 1437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.428680 (+ 5431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.429389 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.429496 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:34.438879 (+ 9383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:34.438900 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:34.438920 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:12:34.438974 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:34.443166 (+ 4192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:34.443864 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:34.443873 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:34.443878 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:34.444065 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:34.444401 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:34.444406 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:34.444409 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:34.444877 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:34.445186 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:34.445393 (+ 207us) server_negotiation.cc:299] Negotiation successful
0809 20:12:34.445639 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 20:12:34.446808 32525 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:12:34.542974 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 32317
I20260809 20:12:34.565665 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 32543
Aug 09 20:12:34 dist-test-slave-6zbq krb5kdc[32153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306351, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.2@KRBTEST.COM
I20260809 20:12:34.579874 521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:34.566477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40014 (local address 127.14.181.2:44347)
0809 20:12:34.566673 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:34.566679 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:34.566710 (+ 31us) server_negotiation.cc:407] Connection header received
0809 20:12:34.566776 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:34.566782 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:34.566847 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:34.566941 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:34.568150 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.568915 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.570247 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.570727 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.570841 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:34.574764 (+ 3923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:34.574777 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:34.574793 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:12:34.574825 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:34.577225 (+ 2400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:34.577826 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:34.577833 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:34.577836 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:34.577955 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:34.578305 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:34.578309 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:34.578311 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:34.578762 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:34.579054 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:34.579346 (+ 292us) server_negotiation.cc:299] Negotiation successful
0809 20:12:34.579552 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 20:12:34.580575 32742 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:12:34.672600 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 32543
I20260809 20:12:34.696485 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 32755
Aug 09 20:12:34 dist-test-slave-6zbq krb5kdc[32153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306351, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.3@KRBTEST.COM
I20260809 20:12:34.710836 519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:12:34.697265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33138 (local address 127.14.181.3:35823)
0809 20:12:34.697452 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 20:12:34.697458 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:12:34.697479 (+ 21us) server_negotiation.cc:407] Connection header received
0809 20:12:34.697615 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:12:34.697619 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:12:34.697693 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:12:34.697778 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:12:34.699127 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.699887 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.701099 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:12:34.701503 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:12:34.701613 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:12:34.705707 (+ 4094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:12:34.705721 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:12:34.705738 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:12:34.705771 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:12:34.708231 (+ 2460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:34.708865 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:34.708873 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:34.708875 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:34.709008 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:12:34.709346 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:12:34.709350 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:12:34.709352 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:12:34.709711 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:12:34.709982 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0809 20:12:34.710292 (+ 310us) server_negotiation.cc:299] Negotiation successful
0809 20:12:34.710521 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 20:12:34.711504 484 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:12:34.799396 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 32755
I20260809 20:12:34.816910 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 32172
I20260809 20:12:34.818094 32270 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:12:34.922778 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 32172
2026-08-09T20:12:34Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4307 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:12:35 dist-test-slave-6zbq krb5kdc[579](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:12:35 dist-test-slave-6zbq krb5kdc[579](info): set up 2 sockets
Aug 09 20:12:35 dist-test-slave-6zbq krb5kdc[579](info): commencing operation
krb5kdc: starting...
W20260809 20:12:36.130184 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.161s user 0.001s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:12:36 dist-test-slave-6zbq krb5kdc[579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306356, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:12:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:12:36Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.14.181.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.14.181.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.14.181.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/rangeradmin_127.14.181.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.14.181.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/rangeradmin_127.14.181.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.14.181.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.14.181.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.14.181.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/rangerlookup_127.14.181.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.14.181.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/rangerlookup_127.14.181.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.14.181.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.14.181.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.14.181.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/HTTP_127.14.181.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.14.181.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/HTTP_127.14.181.20@KRBTEST.COM.keytab.
I20260809 20:12:36.510762 15060 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskpWWQ8t/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/postgres -l logfile start
2026-08-09 20:12:38.587 UTC [629] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 20:12:38.587 UTC [629] LOG: listening on IPv4 address "127.14.181.20", port 47097
2026-08-09 20:12:38.590 UTC [629] LOG: listening on Unix socket "/tmp/.s.PGSQL.47097"
2026-08-09 20:12:38.611 UTC [632] LOG: database system was shut down at 2026-08-09 20:12:37 UTC
2026-08-09 20:12:38.614 UTC [629] LOG: database system is ready to accept connections
I20260809 20:12:39.695304 15060 mini_postgres.cc:96] Postgres bound to 47097
2026-08-09 20:12:39.716 UTC [644] FATAL: database "slave" does not exist
127.14.181.20:47097 - accepting connections
I20260809 20:12:39.717689 15060 mini_ranger.cc:161] Starting Ranger...
I20260809 20:12:39.745466 15060 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 20:12:40.117353 15060 mini_ranger.cc:87] Created ranger Postgres database
I20260809 20:12:40.117478 15060 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ranger-admin
2026-08-09 20:12:40,456 [I] DB FLAVOR :POSTGRES
2026-08-09 20:12:40,456 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 20:12:40,457 [I] Checking connection..
2026-08-09 20:12:40,457 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:47097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 20:12:40,721 [I] Checking connection passed.
2026-08-09 20:12:40,721 [I] --------- Verifying version history table ---------
2026-08-09 20:12:40,721 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:47097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 20:12:40,974 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 20:12:40,974 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:47097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 20:12:41,227 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 20:12:41,227 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 20:12:41,227 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:47097/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 20:12:41.473 UTC [753] WARNING: there is no transaction in progress
2026-08-09 20:12:41,481 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 20:12:41,481 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:47097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 20:12:41,708 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 20:12:41,708 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 20:12:41,708 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:47097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 20:12:41,954 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:47097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 20:12:42,189 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:47097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-6zbq.c.gcp-upstream.internal','N') ;"
2026-08-09 20:12:42,424 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:47097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 20:12:42,677 [I] Table x_portal_user does not exist in database ranger
2026-08-09 20:12:42,677 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:47097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 20:12:42,901 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 20:12:42,902 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:47097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 20:12:43,148 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:47097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 20:12:43,393 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 20:12:43,393 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:47097/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 20:12:44.236 UTC [912] WARNING: there is no transaction in progress
2026-08-09 20:12:44.250 UTC [912] WARNING: there is no transaction in progress
2026-08-09 20:12:44.263 UTC [912] WARNING: there is no transaction in progress
2026-08-09 20:12:44.276 UTC [912] WARNING: there is no transaction in progress
2026-08-09 20:12:44.289 UTC [912] WARNING: there is no transaction in progress
2026-08-09 20:12:44.307 UTC [912] WARNING: there is no transaction in progress
2026-08-09 20:12:44.354 UTC [912] WARNING: there is no transaction in progress
2026-08-09 20:12:44.359 UTC [912] WARNING: there is no transaction in progress
2026-08-09 20:12:44.371 UTC [912] WARNING: there is no transaction in progress
2026-08-09 20:12:44.380 UTC [912] WARNING: there is no transaction in progress
2026-08-09 20:12:44.389 UTC [912] WARNING: there is no transaction in progress
2026-08-09 20:12:44.401 UTC [912] WARNING: there is no transaction in progress
2026-08-09 20:12:44.409 UTC [912] WARNING: there is no transaction in progress
2026-08-09 20:12:44.414 UTC [912] WARNING: there is no transaction in progress
2026-08-09 20:12:44.419 UTC [912] WARNING: there is no transaction in progress
2026-08-09 20:12:44.424 UTC [912] WARNING: there is no transaction in progress
2026-08-09 20:12:44,919 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 20:12:44,920 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:47097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 20:12:45,160 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 20:12:45,160 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:47097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 20:12:45,400 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 20:12:45,400 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:47097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 20:12:45,649 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 20:12:45,649 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:47097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 20:12:45,882 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:47097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 20:12:46,107 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:47097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-6zbq.c.gcp-upstream.internal';"
2026-08-09 20:12:46,333 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 20:12:46,333 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:47097/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 20:12:46,582 [I] DB_PATCHES have already been applied
I20260809 20:12:46.588585 15060 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ranger-admin:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskpWWQ8t/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 20:12:46.588666 15060 mini_ranger.cc:193] Using host: 127.14.181.20
I20260809 20:12:46.609297 15060 mini_ranger.cc:227] Ranger admin URL: http://127.14.181.20:51369
Aug 09, 2026 8:12:46 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 8:12:46 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 8:12:47 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 8:12:47 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 8:12:47 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 8:12:47 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 8:12:47 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 20:12:47.843829 15060 mini_ranger.cc:160] Time spent starting Ranger: real 8.126s user 0.006s sys 0.048s
Aug 09, 2026 8:13:07 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 8:13:07 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 09, 2026 8:13:07 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 8:13:07 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 8:13:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 8:13:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 8:13:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 8:13:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 8:13:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 8:13:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 8:13:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 8:13:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 8:13:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 8:13:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 8:13:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 8:13:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 8:13:07 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 8:13:08 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 20:13:08.534567 15060 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.14.181.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.14.181.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.14.181.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/rangerkms_127.14.181.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.14.181.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/rangerkms_127.14.181.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.14.181.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.14.181.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.14.181.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/HTTP_127.14.181.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.14.181.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/HTTP_127.14.181.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 20:13:08 dist-test-slave-6zbq krb5kdc[579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306388, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 20:13:08.692817 15060 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 20:13:08.713768 15060 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 20:13:09.340713 15060 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 20:13:09.340852 15060 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ranger-kms
I20260809 20:13:09.340978 15060 mini_ranger_kms.cc:227] Using postgres at 127.14.181.20:47097
2026-08-09 20:13:09,783 [I] DB FLAVOR :POSTGRES
2026-08-09 20:13:09,783 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 20:13:09,783 [I] Checking connection
2026-08-09 20:13:09,783 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:47097/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 20:13:10,005 [I] connection success
2026-08-09 20:13:10,005 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 20:13:10,005 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 20:13:10,005 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:47097/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 20:13:10,229 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 20:13:10,229 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 20:13:10,229 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 20:13:10,230 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:47097/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 20:13:10,478 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 20:13:10.919474 15060 mini_ranger_kms.cc:310] Created kms service
I20260809 20:13:11.110877 15060 mini_ranger_kms.cc:326] Created kudu user
I20260809 20:13:11.151924 15060 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 20:13:11 dist-test-slave-6zbq krb5kdc[579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306388, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.14.181.20@KRBTEST.COM
I20260809 20:13:11.564667 15060 mini_ranger_kms.cc:384] Added ranger policy
I20260809 20:13:11.565900 15060 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ranger-kms:/tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 20:13:11.565953 15060 mini_ranger_kms.cc:240] Using host: 127.14.181.20
I20260809 20:13:11.589370 15060 mini_ranger_kms.cc:276] Ranger KMS PID: 1171
I20260809 20:13:11.589534 15060 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.14.181.20:41727
Aug 09, 2026 8:13:12 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 8:13:12 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 8:13:12 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 8:13:12 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 8:13:13 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 8:13:13 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 20:13:13 dist-test-slave-6zbq krb5kdc[579](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786306393, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.181.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:13:14.065335 15060 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.373s user 0.130s sys 0.342s
I20260809 20:13:14.065694 15060 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 20:13:14.065894 15060 mini_ranger_kms.cc:401] 127.14.181.20:41727/kms/v1/keys
Aug 09 20:13:14 dist-test-slave-6zbq krb5kdc[579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306393, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.181.20@KRBTEST.COM for HTTP/127.14.181.20@KRBTEST.COM
Aug 09 20:13:14 dist-test-slave-6zbq krb5kdc[579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306393, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.181.20@KRBTEST.COM for HTTP/127.14.181.20@KRBTEST.COM
Aug 09 20:13:16 dist-test-slave-6zbq krb5kdc[579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306396, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:13:16.899668 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:46665
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:44539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:46665
--ranger_config_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.181.20:41727/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:13:17.258548 1261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:13:17.258787 1261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:13:17.258879 1261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:13:17.265781 1261 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:13:17.265872 1261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:13:17.265925 1261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:13:17.265980 1261 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:13:17.266026 1261 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:13:17.275527 1261 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:44539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/master-0/wal
--ranger_kms_url=127.14.181.20:41727/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:46665
--ranger_config_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:46665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:13:17.276576 1261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:13:17.277712 1261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:13:17.288808 1271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:13:17.288813 1270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:13:17.288867 1275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:13:17.289458 1261 server_base.cc:1034] running on GCE node
I20260809 20:13:17.290135 1261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:13:17.291443 1261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:13:17.292636 1261 hybrid_clock.cc:648] HybridClock initialized: now 1786306397292594 us; error 37 us; skew 500 ppm
I20260809 20:13:17.292948 1261 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:13:17 dist-test-slave-6zbq krb5kdc[579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306397, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:13:17.299983 1261 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:13:17.301348 1261 webserver.cc:460] Webserver started at http://127.14.181.62:33835/ using document root <none> and password file <none>
I20260809 20:13:17.301895 1261 fs_manager.cc:359] Metadata directory not provided
I20260809 20:13:17.301990 1261 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:13:17.302240 1261 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 20:13:17 dist-test-slave-6zbq krb5kdc[579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306397, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for HTTP/127.14.181.20@KRBTEST.COM
I20260809 20:13:17.360387 1261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "320f6b2841ad43629dd321d17b70699d"
format_stamp: "Formatted at 2026-08-09 20:13:17 on dist-test-slave-6zbq"
server_key: "aaae920b1d9d01806e20756ddf345df7"
server_key_iv: "23c579aac6884d87730228d8c1c8ce0c"
server_key_version: "kuduclusterkey@0"
I20260809 20:13:17.361340 1261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "320f6b2841ad43629dd321d17b70699d"
format_stamp: "Formatted at 2026-08-09 20:13:17 on dist-test-slave-6zbq"
server_key: "aaae920b1d9d01806e20756ddf345df7"
server_key_iv: "23c579aac6884d87730228d8c1c8ce0c"
server_key_version: "kuduclusterkey@0"
I20260809 20:13:17.366681 1261 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 20:13:17.386937 1284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:13:17.388340 1261 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.001s
I20260809 20:13:17.388509 1261 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "320f6b2841ad43629dd321d17b70699d"
format_stamp: "Formatted at 2026-08-09 20:13:17 on dist-test-slave-6zbq"
server_key: "aaae920b1d9d01806e20756ddf345df7"
server_key_iv: "23c579aac6884d87730228d8c1c8ce0c"
server_key_version: "kuduclusterkey@0"
I20260809 20:13:17.388716 1261 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:13:17.407474 1261 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:13:17.411128 1261 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:13:17.411386 1261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:13:17.429689 1261 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:46665
I20260809 20:13:17.429698 1361 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:46665 every 8 connection(s)
I20260809 20:13:17.431002 1261 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:13:17.432928 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 1261
I20260809 20:13:17.433126 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:13:17.433954 15060 external_mini_cluster.cc:1428] Setting key 8084b82137b72baa440a5f47f51e77dd
I20260809 20:13:17.435429 1362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:13:17.450279 1362 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 320f6b2841ad43629dd321d17b70699d: Bootstrap starting.
I20260809 20:13:17.453792 1362 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 320f6b2841ad43629dd321d17b70699d: Neither blocks nor log segments found. Creating new log.
I20260809 20:13:17.454830 1362 log.cc:824] T 00000000000000000000000000000000 P 320f6b2841ad43629dd321d17b70699d: Log is configured to *not* fsync() on all Append() calls
I20260809 20:13:17.458628 1362 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 320f6b2841ad43629dd321d17b70699d: No bootstrap required, opened a new log
Aug 09 20:13:17 dist-test-slave-6zbq krb5kdc[579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306396, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:13:17.467999 1362 raft_consensus.cc:348] T 00000000000000000000000000000000 P 320f6b2841ad43629dd321d17b70699d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "320f6b2841ad43629dd321d17b70699d" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 46665 } }
I20260809 20:13:17.468421 1362 raft_consensus.cc:374] T 00000000000000000000000000000000 P 320f6b2841ad43629dd321d17b70699d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:13:17.468536 1362 raft_consensus.cc:729] T 00000000000000000000000000000000 P 320f6b2841ad43629dd321d17b70699d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 320f6b2841ad43629dd321d17b70699d, State: Initialized, Role: FOLLOWER
I20260809 20:13:17.469152 1362 consensus_queue.cc:260] T 00000000000000000000000000000000 P 320f6b2841ad43629dd321d17b70699d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "320f6b2841ad43629dd321d17b70699d" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 46665 } }
I20260809 20:13:17.469424 1362 raft_consensus.cc:388] T 00000000000000000000000000000000 P 320f6b2841ad43629dd321d17b70699d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:13:17.469579 1362 raft_consensus.cc:482] T 00000000000000000000000000000000 P 320f6b2841ad43629dd321d17b70699d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:13:17.469864 1362 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 320f6b2841ad43629dd321d17b70699d [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:13:17.471486 1367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:13:17.436015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56106 (local address 127.14.181.62:46665)
0809 20:13:17.447588 (+ 11573us) server_negotiation.cc:206] Beginning negotiation
0809 20:13:17.447604 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 20:13:17.447656 (+ 52us) server_negotiation.cc:407] Connection header received
0809 20:13:17.450064 (+ 2408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:13:17.450092 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:13:17.450598 (+ 506us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:13:17.450992 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:13:17.452622 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:13:17.454663 (+ 2041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:13:17.456176 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:13:17.457186 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:13:17.457365 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:13:17.462853 (+ 5488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:13:17.462864 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:13:17.462882 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:13:17.462928 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:13:17.466775 (+ 3847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:13:17.467549 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:13:17.467557 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:13:17.467565 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:13:17.467738 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:13:17.468136 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:13:17.468141 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:13:17.468144 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:13:17.468813 (+ 669us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:13:17.469098 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0809 20:13:17.469802 (+ 704us) server_negotiation.cc:299] Negotiation successful
0809 20:13:17.470187 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11312,"thread_start_us":11090,"threads_started":1}
I20260809 20:13:17.472347 1362 raft_consensus.cc:504] T 00000000000000000000000000000000 P 320f6b2841ad43629dd321d17b70699d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "320f6b2841ad43629dd321d17b70699d" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 46665 } }
I20260809 20:13:17.472841 1362 leader_election.cc:302] T 00000000000000000000000000000000 P 320f6b2841ad43629dd321d17b70699d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 320f6b2841ad43629dd321d17b70699d; no voters:
I20260809 20:13:17.473495 1362 leader_election.cc:288] T 00000000000000000000000000000000 P 320f6b2841ad43629dd321d17b70699d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:13:17.473590 1373 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 320f6b2841ad43629dd321d17b70699d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:13:17.478065 1373 raft_consensus.cc:686] T 00000000000000000000000000000000 P 320f6b2841ad43629dd321d17b70699d [term 1 LEADER]: Becoming Leader. State: Replica: 320f6b2841ad43629dd321d17b70699d, State: Running, Role: LEADER
I20260809 20:13:17.478715 1373 consensus_queue.cc:237] T 00000000000000000000000000000000 P 320f6b2841ad43629dd321d17b70699d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "320f6b2841ad43629dd321d17b70699d" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 46665 } }
I20260809 20:13:17.478941 1362 sys_catalog.cc:564] T 00000000000000000000000000000000 P 320f6b2841ad43629dd321d17b70699d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:13:17.484812 1374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 320f6b2841ad43629dd321d17b70699d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "320f6b2841ad43629dd321d17b70699d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "320f6b2841ad43629dd321d17b70699d" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 46665 } } }
I20260809 20:13:17.485132 1374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 320f6b2841ad43629dd321d17b70699d [sys.catalog]: This master's current role is: LEADER
I20260809 20:13:17.485554 1375 sys_catalog.cc:455] T 00000000000000000000000000000000 P 320f6b2841ad43629dd321d17b70699d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 320f6b2841ad43629dd321d17b70699d. Latest consensus state: current_term: 1 leader_uuid: "320f6b2841ad43629dd321d17b70699d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "320f6b2841ad43629dd321d17b70699d" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 46665 } } }
I20260809 20:13:17.485780 1375 sys_catalog.cc:458] T 00000000000000000000000000000000 P 320f6b2841ad43629dd321d17b70699d [sys.catalog]: This master's current role is: LEADER
I20260809 20:13:17.499568 1385 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:13:17.505209 1385 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:13:17.518610 1385 catalog_manager.cc:1347] Generated new cluster ID: 2872e533b6c949f9a9af084cc428c5d1
I20260809 20:13:17.518723 1385 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:13:17.533622 1362 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 20:13:17.534024 1385 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:13:17.535424 1385 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:13:17.561517 1385 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 320f6b2841ad43629dd321d17b70699d: Generated new TSK 0
I20260809 20:13:17.562690 1385 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.181.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
I20260809 20:13:18.226418 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.181.20:41727/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:0
--local_ip_for_outbound_sockets=127.14.181.1
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:46665
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:44539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 20:13:18 dist-test-slave-6zbq krb5kdc[579](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786306398, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 20:13:18.627976 1448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:13:18.628225 1448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:13:18.628350 1448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:13:18.635440 1448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:13:18.635535 1448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:13:18.635674 1448 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:13:18.647143 1448 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:44539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.14.181.20:41727/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:46665
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:13:18.648617 1448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:13:18.650238 1448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:13:18.669296 1465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:13:18.671216 1466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:13:18.677932 1470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:13:18.678222 1448 server_base.cc:1034] running on GCE node
I20260809 20:13:18.679101 1448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:13:18.680460 1448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:13:18.681847 1448 hybrid_clock.cc:648] HybridClock initialized: now 1786306398681778 us; error 53 us; skew 500 ppm
I20260809 20:13:18.682205 1448 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:13:18 dist-test-slave-6zbq krb5kdc[579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306398, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:13:18.686161 1448 init.cc:377] Logged in from keytab as kudu/127.14.181.1@KRBTEST.COM (short username kudu)
I20260809 20:13:18.694561 1448 webserver.cc:460] Webserver started at http://127.14.181.1:39449/ using document root <none> and password file <none>
I20260809 20:13:18.695402 1448 fs_manager.cc:359] Metadata directory not provided
I20260809 20:13:18.695598 1448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:13:18.695981 1448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 20:13:18 dist-test-slave-6zbq krb5kdc[579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306398, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for HTTP/127.14.181.20@KRBTEST.COM
I20260809 20:13:18.717854 1448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-0/data/instance:
uuid: "85a31143ef754eb1835ee83fc6fe4b1a"
format_stamp: "Formatted at 2026-08-09 20:13:18 on dist-test-slave-6zbq"
server_key: "18c6e60fb93ab7610c80b594c8a49c23"
server_key_iv: "dd4f780baff4344f404f3b73b4fb50b2"
server_key_version: "kuduclusterkey@0"
I20260809 20:13:18.718978 1448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance:
uuid: "85a31143ef754eb1835ee83fc6fe4b1a"
format_stamp: "Formatted at 2026-08-09 20:13:18 on dist-test-slave-6zbq"
server_key: "18c6e60fb93ab7610c80b594c8a49c23"
server_key_iv: "dd4f780baff4344f404f3b73b4fb50b2"
server_key_version: "kuduclusterkey@0"
I20260809 20:13:18.739838 1448 fs_manager.cc:691] Time spent creating directory manager: real 0.020s user 0.010s sys 0.009s
I20260809 20:13:18.766100 1479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:13:18.768150 1448 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.008s sys 0.002s
I20260809 20:13:18.768397 1448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "85a31143ef754eb1835ee83fc6fe4b1a"
format_stamp: "Formatted at 2026-08-09 20:13:18 on dist-test-slave-6zbq"
server_key: "18c6e60fb93ab7610c80b594c8a49c23"
server_key_iv: "dd4f780baff4344f404f3b73b4fb50b2"
server_key_version: "kuduclusterkey@0"
I20260809 20:13:18.768762 1448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:13:18.788358 1448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:13:18.792089 1448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:13:18.792436 1448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:13:18.793431 1448 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:13:18.794845 1448 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:13:18.794924 1448 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:13:18.795068 1448 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:13:18.795128 1448 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:13:18.857440 1448 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:45953
I20260809 20:13:18.859134 1448 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:13:18.859578 1660 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:45953 every 8 connection(s)
I20260809 20:13:18.862936 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 1448
I20260809 20:13:18.863127 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance
I20260809 20:13:18.863937 15060 external_mini_cluster.cc:1428] Setting key 32eccc2593109d4b26aa9fbee28eb609
Aug 09 20:13:18 dist-test-slave-6zbq krb5kdc[579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306398, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.14.181.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.2@KRBTEST.COM" created.
I20260809 20:13:18.917098 1669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:13:18.863881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:35619 (local address 127.14.181.62:46665)
0809 20:13:18.891796 (+ 27915us) server_negotiation.cc:206] Beginning negotiation
0809 20:13:18.891803 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:13:18.894425 (+ 2622us) server_negotiation.cc:407] Connection header received
0809 20:13:18.896486 (+ 2061us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:13:18.896492 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:13:18.896588 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:13:18.896673 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:13:18.899575 (+ 2902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:13:18.900824 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:13:18.904487 (+ 3663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:13:18.905107 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:13:18.905204 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:13:18.909506 (+ 4302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:13:18.909513 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:13:18.909518 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:13:18.909558 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:13:18.913010 (+ 3452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:13:18.913856 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:13:18.913862 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:13:18.913866 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:13:18.914015 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:13:18.914580 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:13:18.914586 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:13:18.914589 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:13:18.914953 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:13:18.915099 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 20:13:18.916508 (+ 1409us) server_negotiation.cc:299] Negotiation successful
0809 20:13:18.916738 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27753,"thread_start_us":27964,"threads_started":1}
I20260809 20:13:18.919296 1667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:13:18.863221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:46665 (local address 127.14.181.1:35619)
0809 20:13:18.892524 (+ 29303us) negotiation.cc:107] Waiting for socket to connect
0809 20:13:18.892588 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0809 20:13:18.895336 (+ 2748us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:13:18.897189 (+ 1853us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:13:18.897202 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:13:18.897914 (+ 712us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:13:18.898729 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:13:18.898752 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:13:18.901017 (+ 2265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:13:18.901021 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:13:18.904339 (+ 3318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:13:18.904354 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:13:18.905691 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:13:18.905698 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:13:18.905955 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:13:18.906709 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:13:18.906739 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:13:18.909250 (+ 2511us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:13:18.913217 (+ 3967us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:13:18.913226 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:13:18.913243 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:13:18.913718 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:13:18.914173 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:13:18.914177 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:13:18.914181 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:13:18.914445 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:13:18.915208 (+ 763us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:13:18.915215 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:13:18.915644 (+ 429us) client_negotiation.cc:769] Sending connection context
0809 20:13:18.917351 (+ 1707us) client_negotiation.cc:240] Negotiation successful
0809 20:13:18.917920 (+ 569us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28974,"thread_start_us":32295,"threads_started":1}
I20260809 20:13:18.921468 1662 heartbeater.cc:347] Connected to a master server at 127.14.181.62:46665
I20260809 20:13:18.921797 1662 heartbeater.cc:464] Registering TS with master...
I20260809 20:13:18.922644 1662 heartbeater.cc:511] Master 127.14.181.62:46665 requested a full tablet report, sending...
I20260809 20:13:18.925021 1307 ts_manager.cc:194] Registered new tserver with Master: 85a31143ef754eb1835ee83fc6fe4b1a (127.14.181.1:45953)
I20260809 20:13:18.926836 1307 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.1@KRBTEST.COM'} at 127.14.181.1:35619
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
I20260809 20:13:18.951736 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.181.20:41727/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:0
--local_ip_for_outbound_sockets=127.14.181.2
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:46665
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:44539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 20:13:19 dist-test-slave-6zbq krb5kdc[579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306398, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for HTTP/127.14.181.20@KRBTEST.COM
Aug 09 20:13:19 dist-test-slave-6zbq krb5kdc[579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306398, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for HTTP/127.14.181.20@KRBTEST.COM
W20260809 20:13:19.382153 1674 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:13:19.382642 1674 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:13:19.382838 1674 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:13:19.393572 1674 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:13:19.393698 1674 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:13:19.393860 1674 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:13:19.408897 1674 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:44539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.14.181.20:41727/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:46665
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:13:19.410758 1674 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:13:19.412400 1674 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:13:19.454957 1686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:13:19.455008 1687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:13:19.460662 1674 server_base.cc:1034] running on GCE node
W20260809 20:13:19.460939 1689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:13:19.461594 1674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:13:19.462591 1674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:13:19.463871 1674 hybrid_clock.cc:648] HybridClock initialized: now 1786306399463799 us; error 51 us; skew 500 ppm
I20260809 20:13:19.464282 1674 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:13:19 dist-test-slave-6zbq krb5kdc[579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306399, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:13:19.468698 1674 init.cc:377] Logged in from keytab as kudu/127.14.181.2@KRBTEST.COM (short username kudu)
I20260809 20:13:19.484625 1674 webserver.cc:460] Webserver started at http://127.14.181.2:36599/ using document root <none> and password file <none>
I20260809 20:13:19.485543 1674 fs_manager.cc:359] Metadata directory not provided
I20260809 20:13:19.485693 1674 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:13:19.486081 1674 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 20:13:19 dist-test-slave-6zbq krb5kdc[579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306399, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for HTTP/127.14.181.20@KRBTEST.COM
I20260809 20:13:19.513072 1674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-1/data/instance:
uuid: "bca6a9e650bd4a5a81a93396c73d8349"
format_stamp: "Formatted at 2026-08-09 20:13:19 on dist-test-slave-6zbq"
server_key: "e9ddc36ac95f16923458acbc90d09d3b"
server_key_iv: "e7fda1571e29d78ad7a2705477d84736"
server_key_version: "kuduclusterkey@0"
I20260809 20:13:19.514212 1674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance:
uuid: "bca6a9e650bd4a5a81a93396c73d8349"
format_stamp: "Formatted at 2026-08-09 20:13:19 on dist-test-slave-6zbq"
server_key: "e9ddc36ac95f16923458acbc90d09d3b"
server_key_iv: "e7fda1571e29d78ad7a2705477d84736"
server_key_version: "kuduclusterkey@0"
I20260809 20:13:19.540143 1674 fs_manager.cc:691] Time spent creating directory manager: real 0.025s user 0.004s sys 0.020s
I20260809 20:13:19.575212 1697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:13:19.576999 1674 fs_manager.cc:725] Time spent opening block manager: real 0.015s user 0.003s sys 0.008s
I20260809 20:13:19.577255 1674 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "bca6a9e650bd4a5a81a93396c73d8349"
format_stamp: "Formatted at 2026-08-09 20:13:19 on dist-test-slave-6zbq"
server_key: "e9ddc36ac95f16923458acbc90d09d3b"
server_key_iv: "e7fda1571e29d78ad7a2705477d84736"
server_key_version: "kuduclusterkey@0"
I20260809 20:13:19.577610 1674 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:13:19.611388 1674 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:13:19.618826 1674 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:13:19.619195 1674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:13:19.620482 1674 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:13:19.628388 1674 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:13:19.628530 1674 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:13:19.628690 1674 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:13:19.628783 1674 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:13:19.695322 1674 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:34559
I20260809 20:13:19.695328 1882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:34559 every 8 connection(s)
I20260809 20:13:19.696810 1674 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:13:19.697810 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 1674
I20260809 20:13:19.698005 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance
I20260809 20:13:19.698683 15060 external_mini_cluster.cc:1428] Setting key c3f7e940e3753cb81e728696bafab711
Aug 09 20:13:19 dist-test-slave-6zbq krb5kdc[579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306399, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:13:19.726943 1888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:13:19.700756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:42881 (local address 127.14.181.62:46665)
0809 20:13:19.712952 (+ 12196us) server_negotiation.cc:206] Beginning negotiation
0809 20:13:19.712959 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:13:19.712977 (+ 18us) server_negotiation.cc:407] Connection header received
0809 20:13:19.713029 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:13:19.713034 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:13:19.713102 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:13:19.713201 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:13:19.715120 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:13:19.715949 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:13:19.717634 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:13:19.718090 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:13:19.718198 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:13:19.721497 (+ 3299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:13:19.721502 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:13:19.721505 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:13:19.721536 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:13:19.724053 (+ 2517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:13:19.724711 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:13:19.724716 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:13:19.724718 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:13:19.724840 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:13:19.725242 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:13:19.725246 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:13:19.725248 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:13:19.725522 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:13:19.725663 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 20:13:19.726301 (+ 638us) server_negotiation.cc:299] Negotiation successful
0809 20:13:19.726557 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12071,"thread_start_us":12555,"threads_started":1}
I20260809 20:13:19.727916 1886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:13:19.700177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:46665 (local address 127.14.181.2:42881)
0809 20:13:19.702583 (+ 2406us) negotiation.cc:107] Waiting for socket to connect
0809 20:13:19.702629 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 20:13:19.704937 (+ 2308us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:13:19.713456 (+ 8519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:13:19.713468 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:13:19.714122 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:13:19.714928 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:13:19.714953 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:13:19.716105 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:13:19.716109 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:13:19.717496 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:13:19.717510 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:13:19.718318 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:13:19.718326 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:13:19.718732 (+ 406us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:13:19.719323 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:13:19.719345 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:13:19.721305 (+ 1960us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:13:19.724182 (+ 2877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:13:19.724191 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:13:19.724208 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:13:19.724595 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:13:19.724940 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:13:19.724945 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:13:19.724949 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:13:19.725131 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:13:19.725646 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:13:19.725653 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:13:19.725957 (+ 304us) client_negotiation.cc:769] Sending connection context
0809 20:13:19.726175 (+ 218us) client_negotiation.cc:240] Negotiation successful
0809 20:13:19.726751 (+ 576us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2091,"thread_start_us":1854,"threads_started":1}
I20260809 20:13:19.729228 1883 heartbeater.cc:347] Connected to a master server at 127.14.181.62:46665
I20260809 20:13:19.729521 1883 heartbeater.cc:464] Registering TS with master...
I20260809 20:13:19.730165 1883 heartbeater.cc:511] Master 127.14.181.62:46665 requested a full tablet report, sending...
I20260809 20:13:19.731580 1307 ts_manager.cc:194] Registered new tserver with Master: bca6a9e650bd4a5a81a93396c73d8349 (127.14.181.2:34559)
WARNING: no policy specified for kudu/127.14.181.3@KRBTEST.COM; defaulting to no policy
I20260809 20:13:19.732371 1307 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.2@KRBTEST.COM'} at 127.14.181.2:42881
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
I20260809 20:13:19.765163 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.181.20:41727/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:0
--local_ip_for_outbound_sockets=127.14.181.3
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:46665
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:44539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 20:13:19.930127 1662 heartbeater.cc:503] Master 127.14.181.62:46665 was elected leader, sending a full tablet report...
W20260809 20:13:20.093402 1891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:13:20.093653 1891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:13:20.093786 1891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:13:20.101881 1891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:13:20.101972 1891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:13:20.102118 1891 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:13:20.111223 1891 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:44539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.14.181.20:41727/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:46665
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:13:20.112227 1891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:13:20.113343 1891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:13:20.125370 1902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:13:20.125337 1905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:13:20.125305 1903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:13:20.126392 1891 server_base.cc:1034] running on GCE node
I20260809 20:13:20.126951 1891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:13:20.127813 1891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:13:20.129016 1891 hybrid_clock.cc:648] HybridClock initialized: now 1786306400128976 us; error 35 us; skew 500 ppm
I20260809 20:13:20.129308 1891 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:13:20 dist-test-slave-6zbq krb5kdc[579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306400, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:13:20.132230 1891 init.cc:377] Logged in from keytab as kudu/127.14.181.3@KRBTEST.COM (short username kudu)
I20260809 20:13:20.133517 1891 webserver.cc:460] Webserver started at http://127.14.181.3:43869/ using document root <none> and password file <none>
I20260809 20:13:20.134136 1891 fs_manager.cc:359] Metadata directory not provided
I20260809 20:13:20.134253 1891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:13:20.134565 1891 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 20:13:20 dist-test-slave-6zbq krb5kdc[579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306400, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for HTTP/127.14.181.20@KRBTEST.COM
I20260809 20:13:20.149410 1891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-2/data/instance:
uuid: "2a94e4e676a0443a8f911d5b4be365ea"
format_stamp: "Formatted at 2026-08-09 20:13:20 on dist-test-slave-6zbq"
server_key: "6f1d938ad67a3bdc9f99148d70d82d56"
server_key_iv: "0456fe933f7553e4f9f540dcd82e2582"
server_key_version: "kuduclusterkey@0"
I20260809 20:13:20.150274 1891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance:
uuid: "2a94e4e676a0443a8f911d5b4be365ea"
format_stamp: "Formatted at 2026-08-09 20:13:20 on dist-test-slave-6zbq"
server_key: "6f1d938ad67a3bdc9f99148d70d82d56"
server_key_iv: "0456fe933f7553e4f9f540dcd82e2582"
server_key_version: "kuduclusterkey@0"
I20260809 20:13:20.155761 1891 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 20:13:20.171387 1913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:13:20.172756 1891 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 20:13:20.172910 1891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "2a94e4e676a0443a8f911d5b4be365ea"
format_stamp: "Formatted at 2026-08-09 20:13:20 on dist-test-slave-6zbq"
server_key: "6f1d938ad67a3bdc9f99148d70d82d56"
server_key_iv: "0456fe933f7553e4f9f540dcd82e2582"
server_key_version: "kuduclusterkey@0"
I20260809 20:13:20.173096 1891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:13:20.186537 1891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:13:20.190181 1891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:13:20.190493 1891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:13:20.191354 1891 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:13:20.192691 1891 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:13:20.192764 1891 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:13:20.192876 1891 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:13:20.192934 1891 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:13:20.222842 1891 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:36191
I20260809 20:13:20.222900 2093 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:36191 every 8 connection(s)
I20260809 20:13:20.223984 1891 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:13:20.229421 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 1891
I20260809 20:13:20.229591 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance
I20260809 20:13:20.230123 15060 external_mini_cluster.cc:1428] Setting key 4537b9a0fc5011f6b5b33ea75af2077c
Aug 09 20:13:20 dist-test-slave-6zbq krb5kdc[579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306400, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:13:20.242185 1888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:13:20.226227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:50079 (local address 127.14.181.62:46665)
0809 20:13:20.226471 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0809 20:13:20.226477 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:13:20.227623 (+ 1146us) server_negotiation.cc:407] Connection header received
0809 20:13:20.229579 (+ 1956us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:13:20.229583 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:13:20.229687 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:13:20.229770 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:13:20.231481 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.232327 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.233996 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.234447 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.234541 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:13:20.237407 (+ 2866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:13:20.237412 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:13:20.237416 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:13:20.237446 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:13:20.239942 (+ 2496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:13:20.240505 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:13:20.240509 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:13:20.240511 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:13:20.240625 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:13:20.240954 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:13:20.240957 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:13:20.240959 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:13:20.241210 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:13:20.241341 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 20:13:20.241815 (+ 474us) server_negotiation.cc:299] Negotiation successful
0809 20:13:20.241968 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 20:13:20.242983 2097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:13:20.226798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:46665 (local address 127.14.181.3:50079)
0809 20:13:20.227477 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0809 20:13:20.227513 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 20:13:20.229285 (+ 1772us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:13:20.230037 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:13:20.230047 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:13:20.230646 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:13:20.231313 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:13:20.231333 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.232479 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.232483 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:13:20.233868 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:13:20.233881 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.234608 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.234612 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:13:20.234819 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:13:20.235351 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:13:20.235372 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:13:20.237210 (+ 1838us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:13:20.240036 (+ 2826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:13:20.240042 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:13:20.240051 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:13:20.240421 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:13:20.240699 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:13:20.240701 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:13:20.240704 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:13:20.240880 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:13:20.241301 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:13:20.241306 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:13:20.241540 (+ 234us) client_negotiation.cc:769] Sending connection context
0809 20:13:20.241747 (+ 207us) client_negotiation.cc:240] Negotiation successful
0809 20:13:20.242058 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":279,"threads_started":1}
I20260809 20:13:20.244233 2095 heartbeater.cc:347] Connected to a master server at 127.14.181.62:46665
I20260809 20:13:20.244500 2095 heartbeater.cc:464] Registering TS with master...
I20260809 20:13:20.245199 2095 heartbeater.cc:511] Master 127.14.181.62:46665 requested a full tablet report, sending...
I20260809 20:13:20.246469 1307 ts_manager.cc:194] Registered new tserver with Master: 2a94e4e676a0443a8f911d5b4be365ea (127.14.181.3:36191)
I20260809 20:13:20.247233 1307 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.3@KRBTEST.COM'} at 127.14.181.3:50079
I20260809 20:13:20.256965 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 20:13:20.273365 1888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:13:20.261509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56116 (local address 127.14.181.62:46665)
0809 20:13:20.261666 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 20:13:20.261672 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:13:20.262057 (+ 385us) server_negotiation.cc:407] Connection header received
0809 20:13:20.262205 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:13:20.262210 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:13:20.262284 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:13:20.262379 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:13:20.263778 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.264455 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.265899 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.266316 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.266449 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:13:20.268622 (+ 2173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:13:20.268628 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:13:20.268631 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:13:20.268659 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:13:20.270987 (+ 2328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:13:20.271609 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:13:20.271614 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:13:20.271616 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:13:20.271736 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:13:20.272086 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:13:20.272091 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:13:20.272095 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:13:20.272317 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:13:20.272567 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0809 20:13:20.272861 (+ 294us) server_negotiation.cc:299] Negotiation successful
0809 20:13:20.273045 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 20:13:20.276994 1307 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56116:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 20:13:20.284169 1307 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 20:13:20.318823 2120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:13:20.296082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34772 (local address 127.14.181.2:34559)
0809 20:13:20.307994 (+ 11912us) server_negotiation.cc:206] Beginning negotiation
0809 20:13:20.308005 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 20:13:20.308886 (+ 881us) server_negotiation.cc:407] Connection header received
0809 20:13:20.309173 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:13:20.309181 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:13:20.309428 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:13:20.309652 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:13:20.310370 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.312830 (+ 2460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.315863 (+ 3033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.317295 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.317424 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:13:20.317619 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0809 20:13:20.318282 (+ 663us) server_negotiation.cc:299] Negotiation successful
0809 20:13:20.318473 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11735,"thread_start_us":11607,"threads_started":1}
I20260809 20:13:20.318842 2113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:13:20.295472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:34559 (local address 127.0.0.1:34772)
0809 20:13:20.308734 (+ 13262us) negotiation.cc:107] Waiting for socket to connect
0809 20:13:20.308769 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 20:13:20.308936 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:13:20.309649 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:13:20.309657 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:13:20.309686 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:13:20.310143 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:13:20.310158 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.313009 (+ 2851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.313016 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:13:20.315634 (+ 2618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:13:20.315652 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.317825 (+ 2173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.317831 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:13:20.318025 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:13:20.318074 (+ 49us) client_negotiation.cc:769] Sending connection context
0809 20:13:20.318214 (+ 140us) client_negotiation.cc:240] Negotiation successful
0809 20:13:20.318409 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13023,"mutex_wait_us":25,"thread_start_us":12874,"threads_started":1}
I20260809 20:13:20.319406 2116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:13:20.295730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:36191 (local address 127.0.0.1:48232)
0809 20:13:20.309308 (+ 13578us) negotiation.cc:107] Waiting for socket to connect
0809 20:13:20.309322 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 20:13:20.309431 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:13:20.310659 (+ 1228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:13:20.310664 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:13:20.310693 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:13:20.311145 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:13:20.311156 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.314449 (+ 3293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.314456 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:13:20.316690 (+ 2234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:13:20.316705 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.318628 (+ 1923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.318634 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:13:20.318812 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:13:20.318848 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 20:13:20.318931 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 20:13:20.319048 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13482,"mutex_wait_us":28,"thread_start_us":13341,"threads_started":1}
I20260809 20:13:20.319945 2119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:13:20.295924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48232 (local address 127.14.181.3:36191)
0809 20:13:20.308544 (+ 12620us) server_negotiation.cc:206] Beginning negotiation
0809 20:13:20.308553 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 20:13:20.309916 (+ 1363us) server_negotiation.cc:407] Connection header received
0809 20:13:20.310022 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:13:20.310030 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:13:20.310263 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:13:20.310468 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:13:20.311980 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.313605 (+ 1625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.316919 (+ 3314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.318134 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.318253 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:13:20.318483 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0809 20:13:20.319495 (+ 1012us) server_negotiation.cc:299] Negotiation successful
0809 20:13:20.319643 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12455,"thread_start_us":12632,"threads_started":1}
I20260809 20:13:20.323441 2121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:13:20.309451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:45953 (local address 127.0.0.1:34752)
0809 20:13:20.315960 (+ 6509us) negotiation.cc:107] Waiting for socket to connect
0809 20:13:20.315976 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:13:20.316083 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:13:20.317246 (+ 1163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:13:20.317250 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:13:20.317276 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:13:20.317665 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:13:20.317677 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.319720 (+ 2043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.319725 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:13:20.321446 (+ 1721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:13:20.321459 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.322728 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.322734 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:13:20.322905 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:13:20.322936 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 20:13:20.323012 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 20:13:20.323128 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6395,"thread_start_us":6693,"threads_started":1}
I20260809 20:13:20.323559 2124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:13:20.309808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34752 (local address 127.14.181.1:45953)
0809 20:13:20.316714 (+ 6906us) server_negotiation.cc:206] Beginning negotiation
0809 20:13:20.316722 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:13:20.316747 (+ 25us) server_negotiation.cc:407] Connection header received
0809 20:13:20.316843 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:13:20.316850 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:13:20.317048 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:13:20.317853 (+ 805us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:13:20.318086 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.319560 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.321617 (+ 2057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.322543 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.322657 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:13:20.322862 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0809 20:13:20.323075 (+ 213us) server_negotiation.cc:299] Negotiation successful
0809 20:13:20.323221 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6736,"thread_start_us":6601,"threads_started":1}
I20260809 20:13:20.323099 1783 tablet_service.cc:1467] Processing CreateTablet for tablet a0e32f41ea4d4d538ffa62b088cbd975 (DEFAULT_TABLE table=test-table [id=f6d717d1784d46289025737e37dc7b6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:13:20.323365 1998 tablet_service.cc:1467] Processing CreateTablet for tablet a0e32f41ea4d4d538ffa62b088cbd975 (DEFAULT_TABLE table=test-table [id=f6d717d1784d46289025737e37dc7b6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:13:20.324638 1783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0e32f41ea4d4d538ffa62b088cbd975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:13:20.324635 1998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0e32f41ea4d4d538ffa62b088cbd975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:13:20.326937 1559 tablet_service.cc:1467] Processing CreateTablet for tablet a0e32f41ea4d4d538ffa62b088cbd975 (DEFAULT_TABLE table=test-table [id=f6d717d1784d46289025737e37dc7b6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:13:20.328063 1559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0e32f41ea4d4d538ffa62b088cbd975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:13:20.338027 2125 tablet_bootstrap.cc:492] T a0e32f41ea4d4d538ffa62b088cbd975 P 85a31143ef754eb1835ee83fc6fe4b1a: Bootstrap starting.
I20260809 20:13:20.341210 2125 tablet_bootstrap.cc:654] T a0e32f41ea4d4d538ffa62b088cbd975 P 85a31143ef754eb1835ee83fc6fe4b1a: Neither blocks nor log segments found. Creating new log.
I20260809 20:13:20.342010 2128 tablet_bootstrap.cc:492] T a0e32f41ea4d4d538ffa62b088cbd975 P 2a94e4e676a0443a8f911d5b4be365ea: Bootstrap starting.
I20260809 20:13:20.343155 2127 tablet_bootstrap.cc:492] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349: Bootstrap starting.
I20260809 20:13:20.342484 2125 log.cc:824] T a0e32f41ea4d4d538ffa62b088cbd975 P 85a31143ef754eb1835ee83fc6fe4b1a: Log is configured to *not* fsync() on all Append() calls
I20260809 20:13:20.345566 2128 tablet_bootstrap.cc:654] T a0e32f41ea4d4d538ffa62b088cbd975 P 2a94e4e676a0443a8f911d5b4be365ea: Neither blocks nor log segments found. Creating new log.
I20260809 20:13:20.346115 2127 tablet_bootstrap.cc:654] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349: Neither blocks nor log segments found. Creating new log.
I20260809 20:13:20.346709 2125 tablet_bootstrap.cc:492] T a0e32f41ea4d4d538ffa62b088cbd975 P 85a31143ef754eb1835ee83fc6fe4b1a: No bootstrap required, opened a new log
I20260809 20:13:20.346810 2128 log.cc:824] T a0e32f41ea4d4d538ffa62b088cbd975 P 2a94e4e676a0443a8f911d5b4be365ea: Log is configured to *not* fsync() on all Append() calls
I20260809 20:13:20.346977 2125 ts_tablet_manager.cc:1397] T a0e32f41ea4d4d538ffa62b088cbd975 P 85a31143ef754eb1835ee83fc6fe4b1a: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260809 20:13:20.347095 2127 log.cc:824] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349: Log is configured to *not* fsync() on all Append() calls
I20260809 20:13:20.349573 2128 tablet_bootstrap.cc:492] T a0e32f41ea4d4d538ffa62b088cbd975 P 2a94e4e676a0443a8f911d5b4be365ea: No bootstrap required, opened a new log
I20260809 20:13:20.349833 2128 ts_tablet_manager.cc:1397] T a0e32f41ea4d4d538ffa62b088cbd975 P 2a94e4e676a0443a8f911d5b4be365ea: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.005s
I20260809 20:13:20.349942 2127 tablet_bootstrap.cc:492] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349: No bootstrap required, opened a new log
I20260809 20:13:20.350190 2127 ts_tablet_manager.cc:1397] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260809 20:13:20.353976 2125 raft_consensus.cc:348] T a0e32f41ea4d4d538ffa62b088cbd975 P 85a31143ef754eb1835ee83fc6fe4b1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bca6a9e650bd4a5a81a93396c73d8349" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 34559 } } peers { permanent_uuid: "2a94e4e676a0443a8f911d5b4be365ea" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36191 } } peers { permanent_uuid: "85a31143ef754eb1835ee83fc6fe4b1a" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45953 } }
I20260809 20:13:20.354305 2125 raft_consensus.cc:374] T a0e32f41ea4d4d538ffa62b088cbd975 P 85a31143ef754eb1835ee83fc6fe4b1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:13:20.354429 2125 raft_consensus.cc:729] T a0e32f41ea4d4d538ffa62b088cbd975 P 85a31143ef754eb1835ee83fc6fe4b1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85a31143ef754eb1835ee83fc6fe4b1a, State: Initialized, Role: FOLLOWER
I20260809 20:13:20.354940 2125 consensus_queue.cc:260] T a0e32f41ea4d4d538ffa62b088cbd975 P 85a31143ef754eb1835ee83fc6fe4b1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bca6a9e650bd4a5a81a93396c73d8349" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 34559 } } peers { permanent_uuid: "2a94e4e676a0443a8f911d5b4be365ea" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36191 } } peers { permanent_uuid: "85a31143ef754eb1835ee83fc6fe4b1a" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45953 } }
I20260809 20:13:20.357590 2125 ts_tablet_manager.cc:1428] T a0e32f41ea4d4d538ffa62b088cbd975 P 85a31143ef754eb1835ee83fc6fe4b1a: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260809 20:13:20.359834 2128 raft_consensus.cc:348] T a0e32f41ea4d4d538ffa62b088cbd975 P 2a94e4e676a0443a8f911d5b4be365ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bca6a9e650bd4a5a81a93396c73d8349" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 34559 } } peers { permanent_uuid: "2a94e4e676a0443a8f911d5b4be365ea" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36191 } } peers { permanent_uuid: "85a31143ef754eb1835ee83fc6fe4b1a" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45953 } }
I20260809 20:13:20.359918 2127 raft_consensus.cc:348] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bca6a9e650bd4a5a81a93396c73d8349" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 34559 } } peers { permanent_uuid: "2a94e4e676a0443a8f911d5b4be365ea" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36191 } } peers { permanent_uuid: "85a31143ef754eb1835ee83fc6fe4b1a" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45953 } }
I20260809 20:13:20.360230 2128 raft_consensus.cc:374] T a0e32f41ea4d4d538ffa62b088cbd975 P 2a94e4e676a0443a8f911d5b4be365ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:13:20.360294 2127 raft_consensus.cc:374] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:13:20.360347 2128 raft_consensus.cc:729] T a0e32f41ea4d4d538ffa62b088cbd975 P 2a94e4e676a0443a8f911d5b4be365ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a94e4e676a0443a8f911d5b4be365ea, State: Initialized, Role: FOLLOWER
I20260809 20:13:20.360388 2127 raft_consensus.cc:729] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bca6a9e650bd4a5a81a93396c73d8349, State: Initialized, Role: FOLLOWER
I20260809 20:13:20.360916 2128 consensus_queue.cc:260] T a0e32f41ea4d4d538ffa62b088cbd975 P 2a94e4e676a0443a8f911d5b4be365ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bca6a9e650bd4a5a81a93396c73d8349" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 34559 } } peers { permanent_uuid: "2a94e4e676a0443a8f911d5b4be365ea" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36191 } } peers { permanent_uuid: "85a31143ef754eb1835ee83fc6fe4b1a" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45953 } }
I20260809 20:13:20.360903 2127 consensus_queue.cc:260] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bca6a9e650bd4a5a81a93396c73d8349" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 34559 } } peers { permanent_uuid: "2a94e4e676a0443a8f911d5b4be365ea" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36191 } } peers { permanent_uuid: "85a31143ef754eb1835ee83fc6fe4b1a" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45953 } }
I20260809 20:13:20.362421 1883 heartbeater.cc:503] Master 127.14.181.62:46665 was elected leader, sending a full tablet report...
I20260809 20:13:20.362519 2128 ts_tablet_manager.cc:1428] T a0e32f41ea4d4d538ffa62b088cbd975 P 2a94e4e676a0443a8f911d5b4be365ea: Time spent starting tablet: real 0.013s user 0.010s sys 0.005s
I20260809 20:13:20.362910 2127 ts_tablet_manager.cc:1428] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260809 20:13:20.363776 2095 heartbeater.cc:503] Master 127.14.181.62:46665 was elected leader, sending a full tablet report...
W20260809 20:13:20.403258 1666 tablet.cc:2369] T a0e32f41ea4d4d538ffa62b088cbd975 P 85a31143ef754eb1835ee83fc6fe4b1a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 20:13:20.464499 1885 tablet.cc:2369] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 20:13:20.475416 2096 tablet.cc:2369] T a0e32f41ea4d4d538ffa62b088cbd975 P 2a94e4e676a0443a8f911d5b4be365ea: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:13:20.517102 2135 raft_consensus.cc:482] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:13:20.517364 2135 raft_consensus.cc:504] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bca6a9e650bd4a5a81a93396c73d8349" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 34559 } } peers { permanent_uuid: "2a94e4e676a0443a8f911d5b4be365ea" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36191 } } peers { permanent_uuid: "85a31143ef754eb1835ee83fc6fe4b1a" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45953 } }
I20260809 20:13:20.519117 2135 leader_election.cc:288] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a94e4e676a0443a8f911d5b4be365ea (127.14.181.3:36191), 85a31143ef754eb1835ee83fc6fe4b1a (127.14.181.1:45953)
I20260809 20:13:20.526170 2119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:13:20.519510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:56451 (local address 127.14.181.3:36191)
0809 20:13:20.519693 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 20:13:20.519697 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:13:20.520200 (+ 503us) server_negotiation.cc:407] Connection header received
0809 20:13:20.520422 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:13:20.520427 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:13:20.520512 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:13:20.520611 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:13:20.521479 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.522327 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.524310 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.525169 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.525320 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:13:20.525394 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 20:13:20.525811 (+ 417us) server_negotiation.cc:299] Negotiation successful
0809 20:13:20.525934 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 20:13:20.526288 2138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:13:20.519423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:36191 (local address 127.14.181.2:56451)
0809 20:13:20.520085 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0809 20:13:20.520103 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 20:13:20.520258 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:13:20.520795 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:13:20.520799 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:13:20.520821 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:13:20.521286 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:13:20.521301 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.522468 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.522474 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:13:20.524151 (+ 1677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:13:20.524164 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.525459 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.525469 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:13:20.525653 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:13:20.525680 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 20:13:20.525767 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 20:13:20.525899 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"mutex_wait_us":78,"spinlock_wait_cycles":20736,"thread_start_us":354,"threads_started":1}
I20260809 20:13:20.526307 2124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:13:20.520524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:41857 (local address 127.14.181.1:45953)
0809 20:13:20.520721 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 20:13:20.520726 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:13:20.520947 (+ 221us) server_negotiation.cc:407] Connection header received
0809 20:13:20.521143 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:13:20.521148 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:13:20.521223 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:13:20.521331 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:13:20.521891 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.522786 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.524506 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.525392 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.525541 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:13:20.525608 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 20:13:20.525977 (+ 369us) server_negotiation.cc:299] Negotiation successful
0809 20:13:20.526112 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 20:13:20.526862 2139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:13:20.520196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:45953 (local address 127.14.181.2:41857)
0809 20:13:20.520848 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0809 20:13:20.520863 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:13:20.520990 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:13:20.521369 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:13:20.521374 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:13:20.521396 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:13:20.521754 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:13:20.521767 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.522923 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.522927 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:13:20.524365 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:13:20.524379 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.525606 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.525613 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:13:20.525790 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:13:20.525826 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 20:13:20.526473 (+ 647us) client_negotiation.cc:240] Negotiation successful
0809 20:13:20.526589 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"mutex_wait_us":2,"thread_start_us":324,"threads_started":1}
I20260809 20:13:20.527335 2027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0e32f41ea4d4d538ffa62b088cbd975" candidate_uuid: "bca6a9e650bd4a5a81a93396c73d8349" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a94e4e676a0443a8f911d5b4be365ea" is_pre_election: true
I20260809 20:13:20.527762 2027 raft_consensus.cc:2454] T a0e32f41ea4d4d538ffa62b088cbd975 P 2a94e4e676a0443a8f911d5b4be365ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bca6a9e650bd4a5a81a93396c73d8349 in term 0.
I20260809 20:13:20.527760 1593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0e32f41ea4d4d538ffa62b088cbd975" candidate_uuid: "bca6a9e650bd4a5a81a93396c73d8349" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85a31143ef754eb1835ee83fc6fe4b1a" is_pre_election: true
I20260809 20:13:20.528170 1593 raft_consensus.cc:2454] T a0e32f41ea4d4d538ffa62b088cbd975 P 85a31143ef754eb1835ee83fc6fe4b1a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bca6a9e650bd4a5a81a93396c73d8349 in term 0.
I20260809 20:13:20.528404 1699 leader_election.cc:302] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a94e4e676a0443a8f911d5b4be365ea, bca6a9e650bd4a5a81a93396c73d8349; no voters:
I20260809 20:13:20.528761 2135 raft_consensus.cc:2781] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:13:20.528899 2135 raft_consensus.cc:482] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:13:20.528990 2135 raft_consensus.cc:3037] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:13:20.531167 2135 raft_consensus.cc:504] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bca6a9e650bd4a5a81a93396c73d8349" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 34559 } } peers { permanent_uuid: "2a94e4e676a0443a8f911d5b4be365ea" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36191 } } peers { permanent_uuid: "85a31143ef754eb1835ee83fc6fe4b1a" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45953 } }
I20260809 20:13:20.531697 2135 leader_election.cc:288] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349 [CANDIDATE]: Term 1 election: Requested vote from peers 2a94e4e676a0443a8f911d5b4be365ea (127.14.181.3:36191), 85a31143ef754eb1835ee83fc6fe4b1a (127.14.181.1:45953)
I20260809 20:13:20.532140 2027 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0e32f41ea4d4d538ffa62b088cbd975" candidate_uuid: "bca6a9e650bd4a5a81a93396c73d8349" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a94e4e676a0443a8f911d5b4be365ea"
I20260809 20:13:20.532187 1593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0e32f41ea4d4d538ffa62b088cbd975" candidate_uuid: "bca6a9e650bd4a5a81a93396c73d8349" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85a31143ef754eb1835ee83fc6fe4b1a"
I20260809 20:13:20.532306 2027 raft_consensus.cc:3037] T a0e32f41ea4d4d538ffa62b088cbd975 P 2a94e4e676a0443a8f911d5b4be365ea [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:13:20.532341 1593 raft_consensus.cc:3037] T a0e32f41ea4d4d538ffa62b088cbd975 P 85a31143ef754eb1835ee83fc6fe4b1a [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:13:20.534446 1593 raft_consensus.cc:2454] T a0e32f41ea4d4d538ffa62b088cbd975 P 85a31143ef754eb1835ee83fc6fe4b1a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bca6a9e650bd4a5a81a93396c73d8349 in term 1.
I20260809 20:13:20.534503 2027 raft_consensus.cc:2454] T a0e32f41ea4d4d538ffa62b088cbd975 P 2a94e4e676a0443a8f911d5b4be365ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bca6a9e650bd4a5a81a93396c73d8349 in term 1.
I20260809 20:13:20.534799 1699 leader_election.cc:302] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85a31143ef754eb1835ee83fc6fe4b1a, bca6a9e650bd4a5a81a93396c73d8349; no voters:
I20260809 20:13:20.535024 2135 raft_consensus.cc:2781] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:13:20.535419 2135 raft_consensus.cc:686] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349 [term 1 LEADER]: Becoming Leader. State: Replica: bca6a9e650bd4a5a81a93396c73d8349, State: Running, Role: LEADER
I20260809 20:13:20.535885 2135 consensus_queue.cc:237] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bca6a9e650bd4a5a81a93396c73d8349" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 34559 } } peers { permanent_uuid: "2a94e4e676a0443a8f911d5b4be365ea" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36191 } } peers { permanent_uuid: "85a31143ef754eb1835ee83fc6fe4b1a" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45953 } }
I20260809 20:13:20.540016 1306 catalog_manager.cc:5495] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349 reported cstate change: term changed from 0 to 1, leader changed from <none> to bca6a9e650bd4a5a81a93396c73d8349 (127.14.181.2). New cstate: current_term: 1 leader_uuid: "bca6a9e650bd4a5a81a93396c73d8349" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bca6a9e650bd4a5a81a93396c73d8349" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 34559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a94e4e676a0443a8f911d5b4be365ea" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85a31143ef754eb1835ee83fc6fe4b1a" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45953 } health_report { overall_health: UNKNOWN } } }
I20260809 20:13:20.594210 2120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:13:20.589072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34788 (local address 127.14.181.2:34559)
0809 20:13:20.589248 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 20:13:20.589252 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:13:20.589325 (+ 73us) server_negotiation.cc:407] Connection header received
0809 20:13:20.589488 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:13:20.589492 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:13:20.589573 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:13:20.589688 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:13:20.590005 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.590736 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.592094 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.592486 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.592610 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:13:20.593187 (+ 577us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:13:20.593647 (+ 460us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:13:20.593773 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 20:13:20.593885 (+ 112us) server_negotiation.cc:299] Negotiation successful
0809 20:13:20.593961 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 20:13:20.601811 2027 raft_consensus.cc:1261] T a0e32f41ea4d4d538ffa62b088cbd975 P 2a94e4e676a0443a8f911d5b4be365ea [term 1 FOLLOWER]: Refusing update from remote peer bca6a9e650bd4a5a81a93396c73d8349: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:13:20.601806 1593 raft_consensus.cc:1261] T a0e32f41ea4d4d538ffa62b088cbd975 P 85a31143ef754eb1835ee83fc6fe4b1a [term 1 FOLLOWER]: Refusing update from remote peer bca6a9e650bd4a5a81a93396c73d8349: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:13:20.602748 2140 consensus_queue.cc:1035] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a94e4e676a0443a8f911d5b4be365ea" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:13:20.603129 2135 consensus_queue.cc:1035] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85a31143ef754eb1835ee83fc6fe4b1a" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:13:20.616777 2149 mvcc.cc:205] Tried to move back new op lower bound from 7316711016855228416 to 7316711016598548480. Current Snapshot: MvccSnapshot[applied={T|T < 7316711016855228416 or (T in {7316711016855228416})}]
I20260809 20:13:20.621268 2151 mvcc.cc:205] Tried to move back new op lower bound from 7316711016855228416 to 7316711016598548480. Current Snapshot: MvccSnapshot[applied={T|T < 7316711016855228416}]
I20260809 20:13:20.631037 1307 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:13:20.631316 1307 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:13:20.634745 1307 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 320f6b2841ad43629dd321d17b70699d: Sending DeleteTablet for 3 replicas of tablet a0e32f41ea4d4d538ffa62b088cbd975
I20260809 20:13:20.635775 1783 tablet_service.cc:1514] Processing DeleteTablet for tablet a0e32f41ea4d4d538ffa62b088cbd975 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:13:20 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:34772
I20260809 20:13:20.635893 1998 tablet_service.cc:1514] Processing DeleteTablet for tablet a0e32f41ea4d4d538ffa62b088cbd975 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:13:20 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:48232
I20260809 20:13:20.635957 1559 tablet_service.cc:1514] Processing DeleteTablet for tablet a0e32f41ea4d4d538ffa62b088cbd975 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:13:20 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:34752
I20260809 20:13:20.638902 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 1448
I20260809 20:13:20.646130 2163 tablet_replica.cc:330] T a0e32f41ea4d4d538ffa62b088cbd975 P 85a31143ef754eb1835ee83fc6fe4b1a: stopping tablet replica
I20260809 20:13:20.646629 2163 raft_consensus.cc:2229] T a0e32f41ea4d4d538ffa62b088cbd975 P 85a31143ef754eb1835ee83fc6fe4b1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:13:20.647136 2163 raft_consensus.cc:2258] T a0e32f41ea4d4d538ffa62b088cbd975 P 85a31143ef754eb1835ee83fc6fe4b1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:13:20.649259 2163 ts_tablet_manager.cc:1905] T a0e32f41ea4d4d538ffa62b088cbd975 P 85a31143ef754eb1835ee83fc6fe4b1a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:13:20.649823 2161 tablet_replica.cc:330] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349: stopping tablet replica
I20260809 20:13:20.650185 2161 raft_consensus.cc:2229] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349 [term 1 LEADER]: Raft consensus shutting down.
I20260809 20:13:20.655970 2161 raft_consensus.cc:2258] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:13:20.656744 2162 tablet_replica.cc:330] T a0e32f41ea4d4d538ffa62b088cbd975 P 2a94e4e676a0443a8f911d5b4be365ea: stopping tablet replica
I20260809 20:13:20.658445 2161 ts_tablet_manager.cc:1905] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:13:20.658454 2163 ts_tablet_manager.cc:1918] T a0e32f41ea4d4d538ffa62b088cbd975 P 85a31143ef754eb1835ee83fc6fe4b1a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:13:20.658587 2163 log.cc:1196] T a0e32f41ea4d4d538ffa62b088cbd975 P 85a31143ef754eb1835ee83fc6fe4b1a: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-0/wal/wals/a0e32f41ea4d4d538ffa62b088cbd975
I20260809 20:13:20.659322 2163 ts_tablet_manager.cc:1939] T a0e32f41ea4d4d538ffa62b088cbd975 P 85a31143ef754eb1835ee83fc6fe4b1a: Deleting consensus metadata
I20260809 20:13:20.661026 1286 catalog_manager.cc:4841] TS 85a31143ef754eb1835ee83fc6fe4b1a (127.14.181.1:45953): tablet a0e32f41ea4d4d538ffa62b088cbd975 (table test-table [id=f6d717d1784d46289025737e37dc7b6e]) successfully deleted
I20260809 20:13:20.661615 2162 raft_consensus.cc:2229] T a0e32f41ea4d4d538ffa62b088cbd975 P 2a94e4e676a0443a8f911d5b4be365ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:13:20.662086 2162 raft_consensus.cc:2258] T a0e32f41ea4d4d538ffa62b088cbd975 P 2a94e4e676a0443a8f911d5b4be365ea [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 09 20:13:20 dist-test-slave-6zbq krb5kdc[579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306396, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.1@KRBTEST.COM
I20260809 20:13:20.665403 2162 ts_tablet_manager.cc:1905] T a0e32f41ea4d4d538ffa62b088cbd975 P 2a94e4e676a0443a8f911d5b4be365ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:13:20.666810 2161 ts_tablet_manager.cc:1918] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:13:20.667047 2161 log.cc:1196] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-1/wal/wals/a0e32f41ea4d4d538ffa62b088cbd975
I20260809 20:13:20.667596 2161 ts_tablet_manager.cc:1939] T a0e32f41ea4d4d538ffa62b088cbd975 P bca6a9e650bd4a5a81a93396c73d8349: Deleting consensus metadata
I20260809 20:13:20.669497 1285 catalog_manager.cc:4841] TS bca6a9e650bd4a5a81a93396c73d8349 (127.14.181.2:34559): tablet a0e32f41ea4d4d538ffa62b088cbd975 (table test-table [id=f6d717d1784d46289025737e37dc7b6e]) successfully deleted
I20260809 20:13:20.671931 2162 ts_tablet_manager.cc:1918] T a0e32f41ea4d4d538ffa62b088cbd975 P 2a94e4e676a0443a8f911d5b4be365ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:13:20.672135 2162 log.cc:1196] T a0e32f41ea4d4d538ffa62b088cbd975 P 2a94e4e676a0443a8f911d5b4be365ea: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786306256699363-15060-0/minicluster-data/ts-2/wal/wals/a0e32f41ea4d4d538ffa62b088cbd975
I20260809 20:13:20.672209 2124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:13:20.640238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34754 (local address 127.14.181.1:45953)
0809 20:13:20.640402 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 20:13:20.640409 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:13:20.654407 (+ 13998us) server_negotiation.cc:407] Connection header received
0809 20:13:20.654696 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:13:20.654702 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:13:20.654793 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:13:20.654882 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:13:20.656780 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.657941 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.659911 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.660550 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.660644 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:13:20.665375 (+ 4731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:13:20.665390 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:13:20.665405 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:13:20.665442 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:13:20.669002 (+ 3560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:13:20.669870 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:13:20.669878 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:13:20.669882 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:13:20.670037 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:13:20.670509 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:13:20.670515 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:13:20.670519 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:13:20.670958 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:13:20.671255 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0809 20:13:20.671599 (+ 344us) server_negotiation.cc:299] Negotiation successful
0809 20:13:20.671828 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 20:13:20.672580 2162 ts_tablet_manager.cc:1939] T a0e32f41ea4d4d538ffa62b088cbd975 P 2a94e4e676a0443a8f911d5b4be365ea: Deleting consensus metadata
I20260809 20:13:20.672914 1655 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:13:20.674252 1286 catalog_manager.cc:4841] TS 2a94e4e676a0443a8f911d5b4be365ea (127.14.181.3:36191): tablet a0e32f41ea4d4d538ffa62b088cbd975 (table test-table [id=f6d717d1784d46289025737e37dc7b6e]) successfully deleted
I20260809 20:13:20.776796 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 1448
I20260809 20:13:20.805233 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 1674
Aug 09 20:13:20 dist-test-slave-6zbq krb5kdc[579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306396, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.2@KRBTEST.COM
I20260809 20:13:20.820602 2120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:13:20.805992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34804 (local address 127.14.181.2:34559)
0809 20:13:20.806193 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 20:13:20.806199 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:13:20.806223 (+ 24us) server_negotiation.cc:407] Connection header received
0809 20:13:20.806373 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:13:20.806379 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:13:20.806476 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:13:20.806563 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:13:20.807861 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.808710 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.810024 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.810555 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.810680 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:13:20.815003 (+ 4323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:13:20.815015 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:13:20.815030 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:13:20.815073 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:13:20.817908 (+ 2835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:13:20.818584 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:13:20.818591 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:13:20.818593 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:13:20.818741 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:13:20.819096 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:13:20.819100 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:13:20.819102 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:13:20.819444 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:13:20.819743 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0809 20:13:20.820056 (+ 313us) server_negotiation.cc:299] Negotiation successful
0809 20:13:20.820273 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 20:13:20.821455 1875 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:13:20.932101 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 1674
I20260809 20:13:20.955986 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 1891
Aug 09 20:13:20 dist-test-slave-6zbq krb5kdc[579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306396, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.3@KRBTEST.COM
I20260809 20:13:20.970155 2119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:13:20.956738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48244 (local address 127.14.181.3:36191)
0809 20:13:20.956931 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 20:13:20.956937 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:13:20.956957 (+ 20us) server_negotiation.cc:407] Connection header received
0809 20:13:20.957121 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:13:20.957127 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:13:20.957199 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:13:20.957283 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:13:20.958612 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.959338 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.960675 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:13:20.961074 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:13:20.961197 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:13:20.965122 (+ 3925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:13:20.965137 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:13:20.965152 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:13:20.965189 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:13:20.967581 (+ 2392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:13:20.968187 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:13:20.968194 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:13:20.968197 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:13:20.968339 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:13:20.968677 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:13:20.968681 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:13:20.968684 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:13:20.969049 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:13:20.969322 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0809 20:13:20.969637 (+ 315us) server_negotiation.cc:299] Negotiation successful
0809 20:13:20.969849 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 20:13:20.970794 2087 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:13:21.059492 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 1891
I20260809 20:13:21.075878 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 1261
I20260809 20:13:21.076988 1355 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:13:21.183193 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 1261
I20260809 20:13:21.213766 15060 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 20:13:21.557657 15060 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 20:13:21.557941 15060 mini_ranger.cc:66] Stopping Ranger...
I20260809 20:13:21.901603 15060 mini_ranger.cc:68] Stopped Ranger
2026-08-09 20:13:21.901 UTC [629] LOG: received smart shutdown request
2026-08-09 20:13:21.905 UTC [629] LOG: background worker "logical replication launcher" (PID 642) exited with exit code 1
2026-08-09 20:13:21.905 UTC [633] LOG: shutting down
2026-08-09 20:13:22.020 UTC [629] LOG: database system is shut down
2026-08-09T20:13:22Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (47193 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:13:22 dist-test-slave-6zbq krb5kdc[2188](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:13:22 dist-test-slave-6zbq krb5kdc[2188](info): set up 2 sockets
Aug 09 20:13:22 dist-test-slave-6zbq krb5kdc[2188](info): commencing operation
krb5kdc: starting...
W20260809 20:13:23.325276 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.003s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:13:23 dist-test-slave-6zbq krb5kdc[2188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:13:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:13:23Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.14.181.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.14.181.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.14.181.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/rangeradmin_127.14.181.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.14.181.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/rangeradmin_127.14.181.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.14.181.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.14.181.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.14.181.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/rangerlookup_127.14.181.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.14.181.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/rangerlookup_127.14.181.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.14.181.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.14.181.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.14.181.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/HTTP_127.14.181.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.14.181.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/HTTP_127.14.181.20@KRBTEST.COM.keytab.
I20260809 20:13:23.616568 15060 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskpWWQ8t/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/postgres -l logfile start
2026-08-09 20:13:25.684 UTC [2234] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 20:13:25.684 UTC [2234] LOG: listening on IPv4 address "127.14.181.20", port 39343
2026-08-09 20:13:25.687 UTC [2234] LOG: listening on Unix socket "/tmp/.s.PGSQL.39343"
2026-08-09 20:13:25.723 UTC [2241] LOG: database system was shut down at 2026-08-09 20:13:24 UTC
2026-08-09 20:13:25.726 UTC [2234] LOG: database system is ready to accept connections
I20260809 20:13:26.790827 15060 mini_postgres.cc:96] Postgres bound to 39343
2026-08-09 20:13:26.810 UTC [2254] FATAL: database "slave" does not exist
127.14.181.20:39343 - accepting connections
I20260809 20:13:26.811278 15060 mini_ranger.cc:161] Starting Ranger...
I20260809 20:13:26.836246 15060 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 20:13:27.192902 15060 mini_ranger.cc:87] Created ranger Postgres database
I20260809 20:13:27.193010 15060 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ranger-admin
2026-08-09 20:13:27,475 [I] DB FLAVOR :POSTGRES
2026-08-09 20:13:27,475 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 20:13:27,475 [I] Checking connection..
2026-08-09 20:13:27,475 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:39343/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 20:13:27,713 [I] Checking connection passed.
2026-08-09 20:13:27,713 [I] --------- Verifying version history table ---------
2026-08-09 20:13:27,713 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:39343/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 20:13:27,961 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 20:13:27,962 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:39343/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 20:13:28,201 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 20:13:28,201 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 20:13:28,201 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:39343/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 20:13:28.448 UTC [2362] WARNING: there is no transaction in progress
2026-08-09 20:13:28,456 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 20:13:28,456 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:39343/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 20:13:28,711 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 20:13:28,712 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 20:13:28,712 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:39343/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 20:13:28,954 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:39343/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 20:13:29,208 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:39343/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-6zbq.c.gcp-upstream.internal','N') ;"
2026-08-09 20:13:29,452 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:39343/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 20:13:29,716 [I] Table x_portal_user does not exist in database ranger
2026-08-09 20:13:29,716 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:39343/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 20:13:29,956 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 20:13:29,956 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:39343/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 20:13:30,204 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:39343/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 20:13:30,429 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 20:13:30,429 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:39343/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 20:13:31.289 UTC [2535] WARNING: there is no transaction in progress
2026-08-09 20:13:31.303 UTC [2535] WARNING: there is no transaction in progress
2026-08-09 20:13:31.319 UTC [2535] WARNING: there is no transaction in progress
2026-08-09 20:13:31.332 UTC [2535] WARNING: there is no transaction in progress
2026-08-09 20:13:31.346 UTC [2535] WARNING: there is no transaction in progress
2026-08-09 20:13:31.361 UTC [2535] WARNING: there is no transaction in progress
2026-08-09 20:13:31.408 UTC [2535] WARNING: there is no transaction in progress
2026-08-09 20:13:31.415 UTC [2535] WARNING: there is no transaction in progress
2026-08-09 20:13:31.432 UTC [2535] WARNING: there is no transaction in progress
2026-08-09 20:13:31.449 UTC [2535] WARNING: there is no transaction in progress
2026-08-09 20:13:31.463 UTC [2535] WARNING: there is no transaction in progress
2026-08-09 20:13:31.482 UTC [2535] WARNING: there is no transaction in progress
2026-08-09 20:13:31.495 UTC [2535] WARNING: there is no transaction in progress
2026-08-09 20:13:31.502 UTC [2535] WARNING: there is no transaction in progress
2026-08-09 20:13:31.509 UTC [2535] WARNING: there is no transaction in progress
2026-08-09 20:13:31.517 UTC [2535] WARNING: there is no transaction in progress
2026-08-09 20:13:32,256 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 20:13:32,257 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:39343/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 20:13:32,751 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 20:13:32,752 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:39343/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 20:13:33,192 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 20:13:33,193 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:39343/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 20:13:33,553 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 20:13:33,554 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:39343/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 20:13:33,804 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:39343/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 20:13:34,050 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:39343/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-6zbq.c.gcp-upstream.internal';"
2026-08-09 20:13:34,284 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 20:13:34,284 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:39343/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 20:13:34,534 [I] DB_PATCHES have already been applied
I20260809 20:13:34.539791 15060 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ranger-admin:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskpWWQ8t/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 20:13:34.539881 15060 mini_ranger.cc:193] Using host: 127.14.181.20
I20260809 20:13:34.558934 15060 mini_ranger.cc:227] Ranger admin URL: http://127.14.181.20:57125
Aug 09, 2026 8:13:34 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 8:13:34 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 8:13:34 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 8:13:34 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 8:13:34 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 8:13:35 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 8:13:35 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 20:13:35.820067 15060 mini_ranger.cc:160] Time spent starting Ranger: real 9.009s user 0.007s sys 0.038s
Aug 09, 2026 8:13:53 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 8:13:54 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 09, 2026 8:13:54 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 8:13:54 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 8:13:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 8:13:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 8:13:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 8:13:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 8:13:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 8:13:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 8:13:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 8:13:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 8:13:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 8:13:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 8:13:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 8:13:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 8:13:54 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 8:13:54 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 20:13:55.494656 15060 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.14.181.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.14.181.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.14.181.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/rangerkms_127.14.181.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.14.181.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/rangerkms_127.14.181.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.14.181.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.14.181.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.14.181.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/HTTP_127.14.181.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.14.181.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/HTTP_127.14.181.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 20:13:55 dist-test-slave-6zbq krb5kdc[2188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306435, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 20:13:55.675258 15060 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 20:13:55.694725 15060 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 20:13:56.355232 15060 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 20:13:56.355345 15060 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ranger-kms
I20260809 20:13:56.355383 15060 mini_ranger_kms.cc:227] Using postgres at 127.14.181.20:39343
2026-08-09 20:13:56,695 [I] DB FLAVOR :POSTGRES
2026-08-09 20:13:56,695 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 20:13:56,695 [I] Checking connection
2026-08-09 20:13:56,695 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:39343/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 20:13:56,920 [I] connection success
2026-08-09 20:13:56,920 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 20:13:56,920 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 20:13:56,921 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:39343/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 20:13:57,153 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 20:13:57,153 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 20:13:57,153 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 20:13:57,153 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.14.181.20:39343/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 20:13:57,410 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 20:13:57.844682 15060 mini_ranger_kms.cc:310] Created kms service
I20260809 20:13:58.009995 15060 mini_ranger_kms.cc:326] Created kudu user
I20260809 20:13:58.052305 15060 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 20:13:58 dist-test-slave-6zbq krb5kdc[2188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306435, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.14.181.20@KRBTEST.COM
I20260809 20:13:58.407409 15060 mini_ranger_kms.cc:384] Added ranger policy
I20260809 20:13:58.407716 15060 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ranger-kms:/tmp/dist-test-taskpWWQ8t/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskpWWQ8t/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 20:13:58.407763 15060 mini_ranger_kms.cc:240] Using host: 127.14.181.20
I20260809 20:13:58.428483 15060 mini_ranger_kms.cc:276] Ranger KMS PID: 2832
I20260809 20:13:58.428604 15060 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.14.181.20:42675
Aug 09, 2026 8:13:59 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 8:13:59 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 8:13:59 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 8:13:59 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 8:13:59 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 8:13:59 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 20:14:00 dist-test-slave-6zbq krb5kdc[2188](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786306440, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.181.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:00.947955 15060 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.273s user 0.079s sys 0.287s
I20260809 20:14:00.948218 15060 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 20:14:00.948390 15060 mini_ranger_kms.cc:401] 127.14.181.20:42675/kms/v1/keys
Aug 09 20:14:01 dist-test-slave-6zbq krb5kdc[2188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306440, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.181.20@KRBTEST.COM for HTTP/127.14.181.20@KRBTEST.COM
Aug 09 20:14:01 dist-test-slave-6zbq krb5kdc[2188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306440, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.14.181.20@KRBTEST.COM for HTTP/127.14.181.20@KRBTEST.COM
Aug 09 20:14:03 dist-test-slave-6zbq krb5kdc[2188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306443, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:14:03.620131 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:35869
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:42801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:35869
--ranger_config_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.181.20:42675/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:14:03.944556 2929 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:14:03.944803 2929 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:14:03.944908 2929 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:14:03.951740 2929 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:14:03.951828 2929 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:14:03.951894 2929 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:14:03.951964 2929 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:14:03.952026 2929 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:14:03.961344 2929 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:42801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/wal
--ranger_kms_url=127.14.181.20:42675/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:35869
--ranger_config_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:35869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:14:03.962458 2929 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:14:03.963639 2929 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:14:03.976643 2944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:03.976608 2941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:03.978897 2939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:03.979828 2929 server_base.cc:1034] running on GCE node
I20260809 20:14:03.980540 2929 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:14:03.981877 2929 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:14:03.983070 2929 hybrid_clock.cc:648] HybridClock initialized: now 1786306443983019 us; error 40 us; skew 500 ppm
I20260809 20:14:03.983384 2929 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:14:03 dist-test-slave-6zbq krb5kdc[2188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306443, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:03.986490 2929 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:14:03.987990 2929 webserver.cc:460] Webserver started at http://127.14.181.62:44747/ using document root <none> and password file <none>
I20260809 20:14:03.988572 2929 fs_manager.cc:359] Metadata directory not provided
I20260809 20:14:03.988682 2929 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:14:03.988968 2929 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 20:14:03 dist-test-slave-6zbq krb5kdc[2188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306443, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for HTTP/127.14.181.20@KRBTEST.COM
I20260809 20:14:04.045817 2929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "5ad87306b5164d20a7385f4275140b93"
format_stamp: "Formatted at 2026-08-09 20:14:04 on dist-test-slave-6zbq"
server_key: "3812fcf11b68cb76143bca67e6769e5c"
server_key_iv: "3a8d59e1684c3a6debd2947ed2b82cfd"
server_key_version: "kuduclusterkey@0"
I20260809 20:14:04.047025 2929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "5ad87306b5164d20a7385f4275140b93"
format_stamp: "Formatted at 2026-08-09 20:14:04 on dist-test-slave-6zbq"
server_key: "3812fcf11b68cb76143bca67e6769e5c"
server_key_iv: "3a8d59e1684c3a6debd2947ed2b82cfd"
server_key_version: "kuduclusterkey@0"
I20260809 20:14:04.053865 2929 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260809 20:14:04.069983 2961 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:04.071317 2929 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260809 20:14:04.071482 2929 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "5ad87306b5164d20a7385f4275140b93"
format_stamp: "Formatted at 2026-08-09 20:14:04 on dist-test-slave-6zbq"
server_key: "3812fcf11b68cb76143bca67e6769e5c"
server_key_iv: "3a8d59e1684c3a6debd2947ed2b82cfd"
server_key_version: "kuduclusterkey@0"
I20260809 20:14:04.071671 2929 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:14:04.099313 2929 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:14:04.103142 2929 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:14:04.103430 2929 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:14:04.121541 2929 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:35869
I20260809 20:14:04.121546 3032 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:35869 every 8 connection(s)
I20260809 20:14:04.122871 2929 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:14:04.127419 3033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:14:04.128979 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 2929
I20260809 20:14:04.129175 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:14:04.129822 15060 external_mini_cluster.cc:1428] Setting key 1238d6db3142e15c3e11e04dcc5cb476
I20260809 20:14:04.142308 3033 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93: Bootstrap starting.
I20260809 20:14:04.146169 3033 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93: Neither blocks nor log segments found. Creating new log.
I20260809 20:14:04.147639 3033 log.cc:824] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93: Log is configured to *not* fsync() on all Append() calls
I20260809 20:14:04.151070 3033 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93: No bootstrap required, opened a new log
Aug 09 20:14:04 dist-test-slave-6zbq krb5kdc[2188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306443, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:14:04.161921 3033 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ad87306b5164d20a7385f4275140b93" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 35869 } }
I20260809 20:14:04.162395 3033 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:14:04.162506 3033 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ad87306b5164d20a7385f4275140b93, State: Initialized, Role: FOLLOWER
I20260809 20:14:04.163177 3033 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ad87306b5164d20a7385f4275140b93" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 35869 } }
I20260809 20:14:04.163552 3033 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:14:04.163815 3033 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:14:04.164094 3033 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:14:04.164884 3037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:04.131843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51636 (local address 127.14.181.62:35869)
0809 20:14:04.146768 (+ 14925us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:04.146788 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:04.146838 (+ 50us) server_negotiation.cc:407] Connection header received
0809 20:14:04.148785 (+ 1947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:04.148813 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:04.149219 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:04.149554 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:04.150986 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:04.152379 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:04.153637 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:04.154303 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:04.154503 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:04.158069 (+ 3566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:04.158077 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:04.158090 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:04.158123 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:04.160886 (+ 2763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:04.161535 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:04.161542 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:04.161547 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:04.161690 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:04.162055 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:04.162060 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:04.162063 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:04.162664 (+ 601us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:04.162943 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:04.163546 (+ 603us) server_negotiation.cc:299] Negotiation successful
0809 20:14:04.163919 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14682,"thread_start_us":14441,"threads_started":1}
I20260809 20:14:04.167366 3033 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ad87306b5164d20a7385f4275140b93" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 35869 } }
I20260809 20:14:04.167913 3033 leader_election.cc:302] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5ad87306b5164d20a7385f4275140b93; no voters:
I20260809 20:14:04.168509 3033 leader_election.cc:288] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:14:04.168573 3039 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:14:04.169754 3039 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [term 1 LEADER]: Becoming Leader. State: Replica: 5ad87306b5164d20a7385f4275140b93, State: Running, Role: LEADER
I20260809 20:14:04.170289 3039 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ad87306b5164d20a7385f4275140b93" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 35869 } }
I20260809 20:14:04.172173 3033 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:14:04.172998 3042 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5ad87306b5164d20a7385f4275140b93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ad87306b5164d20a7385f4275140b93" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 35869 } } }
I20260809 20:14:04.173439 3042 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [sys.catalog]: This master's current role is: LEADER
I20260809 20:14:04.173024 3041 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ad87306b5164d20a7385f4275140b93. Latest consensus state: current_term: 1 leader_uuid: "5ad87306b5164d20a7385f4275140b93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ad87306b5164d20a7385f4275140b93" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 35869 } } }
I20260809 20:14:04.174957 3041 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [sys.catalog]: This master's current role is: LEADER
I20260809 20:14:04.184926 3047 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:14:04.189604 3047 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:14:04.208881 3047 catalog_manager.cc:1347] Generated new cluster ID: f0916c281203413a94984d2c8ac9dd55
I20260809 20:14:04.208997 3047 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:14:04.235399 3033 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 20:14:04.243568 3047 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:14:04.245532 3047 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:14:04.265254 3047 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93: Generated new TSK 0
I20260809 20:14:04.267091 3047 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.181.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
I20260809 20:14:05.070111 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.181.20:42675/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:0
--local_ip_for_outbound_sockets=127.14.181.1
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:35869
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:42801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 20:14:05 dist-test-slave-6zbq krb5kdc[2188](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786306445, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 20:14:05.478976 3096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:14:05.479314 3096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:14:05.479468 3096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:14:05.487629 3096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:14:05.487738 3096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:14:05.487884 3096 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:14:05.502092 3096 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:42801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.14.181.20:42675/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:35869
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:14:05.503701 3096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:14:05.505331 3096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:14:05.521780 3110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:05.523313 3111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:05.524436 3116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:05.524542 3096 server_base.cc:1034] running on GCE node
I20260809 20:14:05.525207 3096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:14:05.526424 3096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:14:05.527663 3096 hybrid_clock.cc:648] HybridClock initialized: now 1786306445527596 us; error 54 us; skew 500 ppm
I20260809 20:14:05.528043 3096 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:14:05 dist-test-slave-6zbq krb5kdc[2188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306445, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:05.535327 3096 init.cc:377] Logged in from keytab as kudu/127.14.181.1@KRBTEST.COM (short username kudu)
I20260809 20:14:05.537256 3096 webserver.cc:460] Webserver started at http://127.14.181.1:34987/ using document root <none> and password file <none>
I20260809 20:14:05.538280 3096 fs_manager.cc:359] Metadata directory not provided
I20260809 20:14:05.538452 3096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:14:05.538817 3096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 20:14:05 dist-test-slave-6zbq krb5kdc[2188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306445, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for HTTP/127.14.181.20@KRBTEST.COM
I20260809 20:14:05.559693 3096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/data/instance:
uuid: "50a5f57b02634fb9938ff71b8ab5c836"
format_stamp: "Formatted at 2026-08-09 20:14:05 on dist-test-slave-6zbq"
server_key: "a9d3a35096290d4aa56aee9deeba4eaf"
server_key_iv: "beeab7c5acb7dee439c90123f0529533"
server_key_version: "kuduclusterkey@0"
I20260809 20:14:05.560667 3096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance:
uuid: "50a5f57b02634fb9938ff71b8ab5c836"
format_stamp: "Formatted at 2026-08-09 20:14:05 on dist-test-slave-6zbq"
server_key: "a9d3a35096290d4aa56aee9deeba4eaf"
server_key_iv: "beeab7c5acb7dee439c90123f0529533"
server_key_version: "kuduclusterkey@0"
I20260809 20:14:05.566211 3096 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 20:14:05.583200 3128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:05.584633 3096 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 20:14:05.584806 3096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "50a5f57b02634fb9938ff71b8ab5c836"
format_stamp: "Formatted at 2026-08-09 20:14:05 on dist-test-slave-6zbq"
server_key: "a9d3a35096290d4aa56aee9deeba4eaf"
server_key_iv: "beeab7c5acb7dee439c90123f0529533"
server_key_version: "kuduclusterkey@0"
I20260809 20:14:05.585026 3096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:14:05.606195 3096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:14:05.611653 3096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:14:05.612048 3096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:14:05.622674 3096 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:14:05.633792 3096 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:14:05.633939 3096 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:05.634147 3096 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:14:05.634302 3096 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:05.742750 3096 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:35507
I20260809 20:14:05.742794 3314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:35507 every 8 connection(s)
I20260809 20:14:05.744408 3096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:14:05.753538 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 3096
I20260809 20:14:05.753751 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance
I20260809 20:14:05.754550 15060 external_mini_cluster.cc:1428] Setting key 83f9897abc0327608f40c4b7c4906485
Aug 09 20:14:05 dist-test-slave-6zbq krb5kdc[2188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306445, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:14:05.799546 3320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:05.747847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:35869 (local address 127.14.181.1:35407)
0809 20:14:05.760024 (+ 12177us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:05.760079 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:05.762593 (+ 2514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:05.763726 (+ 1133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:05.763738 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:05.773602 (+ 9864us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:14:05.774497 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:05.774532 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:05.783799 (+ 9267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:05.783804 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:05.785696 (+ 1892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:05.785722 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:05.786954 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:05.786960 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:05.787238 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:05.788018 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:14:05.788048 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:14:05.790919 (+ 2871us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:14:05.794899 (+ 3980us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:05.794908 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:05.794925 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:05.795501 (+ 576us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:05.795916 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:05.795922 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:05.795925 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:05.796151 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:05.796892 (+ 741us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:14:05.796900 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:14:05.797330 (+ 430us) client_negotiation.cc:769] Sending connection context
0809 20:14:05.797639 (+ 309us) client_negotiation.cc:240] Negotiation successful
0809 20:14:05.798155 (+ 516us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11837,"thread_start_us":11601,"threads_started":1}
I20260809 20:14:05.800627 3318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:05.747286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:35407 (local address 127.14.181.62:35869)
0809 20:14:05.758766 (+ 11480us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:05.758773 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:05.762993 (+ 4220us) server_negotiation.cc:407] Connection header received
0809 20:14:05.763064 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:05.763070 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:05.763165 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:05.763275 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:05.782489 (+ 19214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:05.783583 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:05.785894 (+ 2311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:05.786551 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:05.786661 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:05.791168 (+ 4507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:05.791175 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:05.791181 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:05.791230 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:05.794705 (+ 3475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:05.795643 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:05.795648 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:05.795652 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:05.795795 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:05.796297 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:05.796302 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:05.796306 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:05.796666 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:05.796816 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:05.800043 (+ 3227us) server_negotiation.cc:299] Negotiation successful
0809 20:14:05.800280 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11315,"thread_start_us":11726,"threads_started":1}
I20260809 20:14:05.802603 3316 heartbeater.cc:347] Connected to a master server at 127.14.181.62:35869
I20260809 20:14:05.802946 3316 heartbeater.cc:464] Registering TS with master...
I20260809 20:14:05.803750 3316 heartbeater.cc:511] Master 127.14.181.62:35869 requested a full tablet report, sending...
I20260809 20:14:05.806629 2982 ts_manager.cc:194] Registered new tserver with Master: 50a5f57b02634fb9938ff71b8ab5c836 (127.14.181.1:35507)
I20260809 20:14:05.808673 2982 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.1@KRBTEST.COM'} at 127.14.181.1:35407
WARNING: no policy specified for kudu/127.14.181.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
I20260809 20:14:05.854034 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.181.20:42675/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:0
--local_ip_for_outbound_sockets=127.14.181.2
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:35869
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:42801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 20:14:05 dist-test-slave-6zbq krb5kdc[2188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306445, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for HTTP/127.14.181.20@KRBTEST.COM
Aug 09 20:14:06 dist-test-slave-6zbq krb5kdc[2188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306445, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for HTTP/127.14.181.20@KRBTEST.COM
W20260809 20:14:06.351013 3330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:14:06.351491 3330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:14:06.351692 3330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:14:06.362669 3330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:14:06.362851 3330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:14:06.363078 3330 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:14:06.377954 3330 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:42801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.14.181.20:42675/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:35869
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:14:06.379791 3330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:14:06.381541 3330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:14:06.422905 3346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:06.426673 3347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:06.429940 3351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:06.438704 3330 server_base.cc:1034] running on GCE node
I20260809 20:14:06.439670 3330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:14:06.444798 3330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:14:06.446044 3330 hybrid_clock.cc:648] HybridClock initialized: now 1786306446445933 us; error 94 us; skew 500 ppm
I20260809 20:14:06.446470 3330 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:14:06 dist-test-slave-6zbq krb5kdc[2188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306446, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:06.450738 3330 init.cc:377] Logged in from keytab as kudu/127.14.181.2@KRBTEST.COM (short username kudu)
I20260809 20:14:06.485625 3330 webserver.cc:460] Webserver started at http://127.14.181.2:42491/ using document root <none> and password file <none>
I20260809 20:14:06.486686 3330 fs_manager.cc:359] Metadata directory not provided
I20260809 20:14:06.486894 3330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:14:06.487318 3330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 20:14:06 dist-test-slave-6zbq krb5kdc[2188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306446, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for HTTP/127.14.181.20@KRBTEST.COM
I20260809 20:14:06.516057 3330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/data/instance:
uuid: "8e6a4777549f43f99b9d1584921d4d8d"
format_stamp: "Formatted at 2026-08-09 20:14:06 on dist-test-slave-6zbq"
server_key: "65835841a8c28bf97348ee0228aac329"
server_key_iv: "5b5e9744c277791c3c0e4dd5ce197397"
server_key_version: "kuduclusterkey@0"
I20260809 20:14:06.527086 3330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance:
uuid: "8e6a4777549f43f99b9d1584921d4d8d"
format_stamp: "Formatted at 2026-08-09 20:14:06 on dist-test-slave-6zbq"
server_key: "65835841a8c28bf97348ee0228aac329"
server_key_iv: "5b5e9744c277791c3c0e4dd5ce197397"
server_key_version: "kuduclusterkey@0"
I20260809 20:14:06.544922 3330 fs_manager.cc:691] Time spent creating directory manager: real 0.017s user 0.005s sys 0.001s
I20260809 20:14:06.570045 3363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:06.579412 3330 fs_manager.cc:725] Time spent opening block manager: real 0.012s user 0.002s sys 0.000s
I20260809 20:14:06.579689 3330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "8e6a4777549f43f99b9d1584921d4d8d"
format_stamp: "Formatted at 2026-08-09 20:14:06 on dist-test-slave-6zbq"
server_key: "65835841a8c28bf97348ee0228aac329"
server_key_iv: "5b5e9744c277791c3c0e4dd5ce197397"
server_key_version: "kuduclusterkey@0"
I20260809 20:14:06.580026 3330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:14:06.608544 3330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:14:06.613049 3330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:14:06.613322 3330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:14:06.614311 3330 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:14:06.615796 3330 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:14:06.615868 3330 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:06.615978 3330 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:14:06.616025 3330 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:06.655083 3330 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:33129
I20260809 20:14:06.655128 3562 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:33129 every 8 connection(s)
I20260809 20:14:06.656404 3330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:14:06.657936 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 3330
I20260809 20:14:06.658105 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance
I20260809 20:14:06.658658 15060 external_mini_cluster.cc:1428] Setting key 4fa9726b82e8a1d35962c4280280e903
Aug 09 20:14:06 dist-test-slave-6zbq krb5kdc[2188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306446, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:14:06.676978 3569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:06.659116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:39389 (local address 127.14.181.62:35869)
0809 20:14:06.659609 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:06.659613 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:06.662411 (+ 2798us) server_negotiation.cc:407] Connection header received
0809 20:14:06.662555 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:06.662561 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:06.662656 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:06.662783 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:06.664396 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:06.665415 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:06.666997 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:06.667547 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:06.667679 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:06.671003 (+ 3324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:06.671011 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:06.671015 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:06.671057 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:06.673810 (+ 2753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:06.674733 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:06.674737 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:06.674740 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:06.674857 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:06.675292 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:06.675295 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:06.675297 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:06.675559 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:06.675701 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:06.676544 (+ 843us) server_negotiation.cc:299] Negotiation successful
0809 20:14:06.676721 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":256,"threads_started":1}
I20260809 20:14:06.678282 3570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:06.659707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:35869 (local address 127.14.181.2:39389)
0809 20:14:06.660527 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:06.660580 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:06.662278 (+ 1698us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:06.663059 (+ 781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:06.663068 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:06.663599 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:14:06.664190 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:06.664209 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:06.665559 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:06.665563 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:06.666857 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:06.666870 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:06.667731 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:06.667735 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:06.667931 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:06.668546 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:14:06.668568 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:14:06.670749 (+ 2181us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:14:06.673948 (+ 3199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:06.673956 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:06.673971 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:06.674540 (+ 569us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:06.674955 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:06.674959 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:06.674963 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:06.675200 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:06.675684 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:14:06.675693 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:14:06.676158 (+ 465us) client_negotiation.cc:769] Sending connection context
0809 20:14:06.676441 (+ 283us) client_negotiation.cc:240] Negotiation successful
0809 20:14:06.676946 (+ 505us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":308,"threads_started":1}
I20260809 20:14:06.679734 3563 heartbeater.cc:347] Connected to a master server at 127.14.181.62:35869
I20260809 20:14:06.680032 3563 heartbeater.cc:464] Registering TS with master...
I20260809 20:14:06.680722 3563 heartbeater.cc:511] Master 127.14.181.62:35869 requested a full tablet report, sending...
I20260809 20:14:06.682222 2982 ts_manager.cc:194] Registered new tserver with Master: 8e6a4777549f43f99b9d1584921d4d8d (127.14.181.2:33129)
I20260809 20:14:06.683008 2982 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.2@KRBTEST.COM'} at 127.14.181.2:39389
WARNING: no policy specified for kudu/127.14.181.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
I20260809 20:14:06.715543 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.181.20:42675/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:0
--local_ip_for_outbound_sockets=127.14.181.3
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:35869
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:42801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 20:14:06.812105 3316 heartbeater.cc:503] Master 127.14.181.62:35869 was elected leader, sending a full tablet report...
W20260809 20:14:07.024003 3574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:14:07.024259 3574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:14:07.024405 3574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:14:07.031199 3574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:14:07.031318 3574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:14:07.031489 3574 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:14:07.042027 3574 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:42801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.14.181.20:42675/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:35869
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:14:07.043216 3574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:14:07.044420 3574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:14:07.056288 3586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:07.056329 3584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:07.056356 3581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:07.057322 3574 server_base.cc:1034] running on GCE node
I20260809 20:14:07.057863 3574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:14:07.058760 3574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:14:07.059950 3574 hybrid_clock.cc:648] HybridClock initialized: now 1786306447059906 us; error 34 us; skew 500 ppm
I20260809 20:14:07.060223 3574 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:14:07 dist-test-slave-6zbq krb5kdc[2188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306447, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:07.063128 3574 init.cc:377] Logged in from keytab as kudu/127.14.181.3@KRBTEST.COM (short username kudu)
I20260809 20:14:07.064486 3574 webserver.cc:460] Webserver started at http://127.14.181.3:38415/ using document root <none> and password file <none>
I20260809 20:14:07.065073 3574 fs_manager.cc:359] Metadata directory not provided
I20260809 20:14:07.065168 3574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:14:07.065420 3574 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 20:14:07 dist-test-slave-6zbq krb5kdc[2188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306447, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for HTTP/127.14.181.20@KRBTEST.COM
I20260809 20:14:07.081835 3574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/data/instance:
uuid: "284a47dc8dd74c7e8b878b395540e576"
format_stamp: "Formatted at 2026-08-09 20:14:07 on dist-test-slave-6zbq"
server_key: "b256740fb557e97bbb486c1e407f8616"
server_key_iv: "e0363ecbd7d2f1ba993fcf116742d137"
server_key_version: "kuduclusterkey@0"
I20260809 20:14:07.082971 3574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance:
uuid: "284a47dc8dd74c7e8b878b395540e576"
format_stamp: "Formatted at 2026-08-09 20:14:07 on dist-test-slave-6zbq"
server_key: "b256740fb557e97bbb486c1e407f8616"
server_key_iv: "e0363ecbd7d2f1ba993fcf116742d137"
server_key_version: "kuduclusterkey@0"
I20260809 20:14:07.089811 3574 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260809 20:14:07.106264 3600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:07.107748 3574 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 20:14:07.107918 3574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "284a47dc8dd74c7e8b878b395540e576"
format_stamp: "Formatted at 2026-08-09 20:14:07 on dist-test-slave-6zbq"
server_key: "b256740fb557e97bbb486c1e407f8616"
server_key_iv: "e0363ecbd7d2f1ba993fcf116742d137"
server_key_version: "kuduclusterkey@0"
I20260809 20:14:07.108135 3574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:14:07.130319 3574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:14:07.133611 3574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:14:07.133852 3574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:14:07.134707 3574 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:14:07.135963 3574 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:14:07.136040 3574 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:07.136150 3574 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:14:07.136201 3574 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:07.165997 3574 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:38657
I20260809 20:14:07.166039 3792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:38657 every 8 connection(s)
I20260809 20:14:07.167157 3574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:14:07.175510 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 3574
I20260809 20:14:07.175705 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance
I20260809 20:14:07.176142 15060 external_mini_cluster.cc:1428] Setting key 987c5e259f7dc351916246346a55ac3c
Aug 09 20:14:07 dist-test-slave-6zbq krb5kdc[2188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306447, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:14:07.184882 3569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:07.169398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:36871 (local address 127.14.181.62:35869)
0809 20:14:07.169602 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:07.169608 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:07.170658 (+ 1050us) server_negotiation.cc:407] Connection header received
0809 20:14:07.172303 (+ 1645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:07.172309 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:07.172406 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:07.172487 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:07.173778 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:07.174558 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:07.176389 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:07.176869 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:07.176964 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:07.180264 (+ 3300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:07.180269 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:07.180272 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:07.180303 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:07.182551 (+ 2248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:07.183163 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:07.183166 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:07.183169 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:07.183290 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:07.183629 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:07.183631 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:07.183633 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:07.183869 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:07.183989 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:07.184481 (+ 492us) server_negotiation.cc:299] Negotiation successful
0809 20:14:07.184659 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 20:14:07.185702 3795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:07.169825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:35869 (local address 127.14.181.3:36871)
0809 20:14:07.170511 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:07.170555 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:07.172083 (+ 1528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:07.172679 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:07.172686 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:07.173065 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:14:07.173646 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:07.173664 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:07.174685 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:07.174689 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:07.176230 (+ 1541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:07.176253 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:07.177074 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:07.177082 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:07.177291 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:07.177908 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:14:07.177937 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:14:07.180090 (+ 2153us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:14:07.182656 (+ 2566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:07.182662 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:07.182672 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:07.183066 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:07.183364 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:07.183367 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:07.183369 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:07.183547 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:07.183955 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:14:07.183960 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:14:07.184206 (+ 246us) client_negotiation.cc:769] Sending connection context
0809 20:14:07.184408 (+ 202us) client_negotiation.cc:240] Negotiation successful
0809 20:14:07.184756 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":261,"threads_started":1}
I20260809 20:14:07.186957 3793 heartbeater.cc:347] Connected to a master server at 127.14.181.62:35869
I20260809 20:14:07.187218 3793 heartbeater.cc:464] Registering TS with master...
I20260809 20:14:07.187799 3793 heartbeater.cc:511] Master 127.14.181.62:35869 requested a full tablet report, sending...
I20260809 20:14:07.189142 2982 ts_manager.cc:194] Registered new tserver with Master: 284a47dc8dd74c7e8b878b395540e576 (127.14.181.3:38657)
I20260809 20:14:07.189980 2982 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.3@KRBTEST.COM'} at 127.14.181.3:36871
I20260809 20:14:07.191304 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 20:14:07.192934 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 3096
Aug 09 20:14:07 dist-test-slave-6zbq krb5kdc[2188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306443, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.1@KRBTEST.COM
I20260809 20:14:07.207625 3799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:07.193741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56002 (local address 127.14.181.1:35507)
0809 20:14:07.194316 (+ 575us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:07.194322 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:07.194367 (+ 45us) server_negotiation.cc:407] Connection header received
0809 20:14:07.194433 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:07.194441 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:07.194599 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:07.194714 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:07.195987 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:07.196943 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:07.198483 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:07.198981 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:07.199079 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:07.202921 (+ 3842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:07.202931 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:07.202942 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:07.202972 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:07.205368 (+ 2396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:07.205938 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:07.205943 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:07.205945 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:07.206078 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:07.206483 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:07.206486 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:07.206488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:07.206770 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:07.206995 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:07.207180 (+ 185us) server_negotiation.cc:299] Negotiation successful
0809 20:14:07.207366 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":289,"threads_started":1}
I20260809 20:14:07.208717 3310 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:14:07.287910 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 3096
I20260809 20:14:07.306730 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 3330
Aug 09 20:14:07 dist-test-slave-6zbq krb5kdc[2188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306443, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.2@KRBTEST.COM
I20260809 20:14:07.321530 3801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:07.307533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41174 (local address 127.14.181.2:33129)
0809 20:14:07.308044 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:07.308051 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:07.308077 (+ 26us) server_negotiation.cc:407] Connection header received
0809 20:14:07.308137 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:07.308143 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:07.308369 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:07.308491 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:07.309765 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:07.310834 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:07.312066 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:07.312599 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:07.312692 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:07.316707 (+ 4015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:07.316718 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:07.316732 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:07.316764 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:07.319267 (+ 2503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:07.319892 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:07.319898 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:07.319900 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:07.320035 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:07.320317 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:07.320320 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:07.320322 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:07.320631 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:07.320857 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:07.321032 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 20:14:07.321242 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":257,"threads_started":1}
I20260809 20:14:07.322777 3551 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:14:07.401886 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 3330
I20260809 20:14:07.423540 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 3574
Aug 09 20:14:07 dist-test-slave-6zbq krb5kdc[2188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306443, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.3@KRBTEST.COM
I20260809 20:14:07.443027 3803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:07.428371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51528 (local address 127.14.181.3:38657)
0809 20:14:07.428903 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:07.428910 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:07.428937 (+ 27us) server_negotiation.cc:407] Connection header received
0809 20:14:07.428995 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:07.429002 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:07.429207 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:07.429352 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:07.430783 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:07.431801 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:07.433107 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:07.433670 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:07.433788 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:07.438053 (+ 4265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:07.438064 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:07.438077 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:07.438112 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:07.440611 (+ 2499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:07.441215 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:07.441221 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:07.441223 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:07.441351 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:07.441621 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:07.441624 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:07.441626 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:07.441998 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:07.442248 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:07.442488 (+ 240us) server_negotiation.cc:299] Negotiation successful
0809 20:14:07.442681 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":248,"threads_started":1}
I20260809 20:14:07.444288 3780 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:14:07.523973 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 3574
I20260809 20:14:07.544104 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 2929
I20260809 20:14:07.545311 3026 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:14:07.647670 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 2929
I20260809 20:14:07.675470 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:35869
--webserver_interface=127.14.181.62
--webserver_port=44747
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:42801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:35869
--ranger_config_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.181.20:42675/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.14.181.20:42675/kms with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:14:07.979796 3806 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:14:07.980033 3806 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:14:07.980151 3806 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:14:07.986972 3806 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:14:07.987058 3806 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:14:07.987128 3806 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:14:07.987196 3806 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:14:07.987262 3806 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:14:07.996528 3806 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:42801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.14.181.20:42675/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:35869
--ranger_config_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:35869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=44747
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:14:07.997592 3806 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:14:07.998806 3806 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:14:08.009344 3812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:08.009409 3820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:08.009387 3813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:08.010565 3806 server_base.cc:1034] running on GCE node
I20260809 20:14:08.011238 3806 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:14:08.012427 3806 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:14:08.013622 3806 hybrid_clock.cc:648] HybridClock initialized: now 1786306448013571 us; error 42 us; skew 500 ppm
I20260809 20:14:08.013922 3806 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:14:08 dist-test-slave-6zbq krb5kdc[2188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306448, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:08.016726 3806 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:14:08.018018 3806 webserver.cc:460] Webserver started at http://127.14.181.62:44747/ using document root <none> and password file <none>
I20260809 20:14:08.018613 3806 fs_manager.cc:359] Metadata directory not provided
I20260809 20:14:08.018724 3806 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 20:14:08 dist-test-slave-6zbq krb5kdc[2188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306448, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for HTTP/127.14.181.20@KRBTEST.COM
I20260809 20:14:08.067314 3806 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 20:14:08.070061 3834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:08.071350 3806 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 20:14:08.071494 3806 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "5ad87306b5164d20a7385f4275140b93"
format_stamp: "Formatted at 2026-08-09 20:14:04 on dist-test-slave-6zbq"
server_key: "3812fcf11b68cb76143bca67e6769e5c"
server_key_iv: "3a8d59e1684c3a6debd2947ed2b82cfd"
server_key_version: "kuduclusterkey@0"
I20260809 20:14:08.072384 3806 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:14:08.106534 3806 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:14:08.109831 3806 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:14:08.110090 3806 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:14:08.126837 3806 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:35869
I20260809 20:14:08.126873 3924 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:35869 every 8 connection(s)
I20260809 20:14:08.128172 3806 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:14:08.134598 3926 sys_catalog.cc:263] Verifying existing consensus state
I20260809 20:14:08.137039 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 3806
I20260809 20:14:08.138116 3926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93: Bootstrap starting.
I20260809 20:14:08.138095 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.181.20:42675/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:35507
--local_ip_for_outbound_sockets=127.14.181.1
--tserver_master_addrs=127.14.181.62:35869
--webserver_port=34987
--webserver_interface=127.14.181.1
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:42801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.14.181.20:42675/kms with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 20:14:08.158138 3926 log.cc:824] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93: Log is configured to *not* fsync() on all Append() calls
I20260809 20:14:08.166389 3926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 20:14:08.166863 3926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93: Bootstrap complete.
I20260809 20:14:08.175354 3926 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ad87306b5164d20a7385f4275140b93" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 35869 } }
I20260809 20:14:08.176187 3926 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ad87306b5164d20a7385f4275140b93, State: Initialized, Role: FOLLOWER
I20260809 20:14:08.176810 3926 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ad87306b5164d20a7385f4275140b93" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 35869 } }
I20260809 20:14:08.177021 3926 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:14:08.177126 3926 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:14:08.177268 3926 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [term 1 FOLLOWER]: Advancing to term 2
I20260809 20:14:08.180823 3926 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ad87306b5164d20a7385f4275140b93" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 35869 } }
I20260809 20:14:08.181264 3926 leader_election.cc:302] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5ad87306b5164d20a7385f4275140b93; no voters:
I20260809 20:14:08.181797 3926 leader_election.cc:288] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 20:14:08.181910 3932 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 20:14:08.182996 3932 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [term 2 LEADER]: Becoming Leader. State: Replica: 5ad87306b5164d20a7385f4275140b93, State: Running, Role: LEADER
I20260809 20:14:08.183590 3932 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ad87306b5164d20a7385f4275140b93" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 35869 } }
I20260809 20:14:08.183758 3926 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:14:08.185890 3933 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "5ad87306b5164d20a7385f4275140b93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ad87306b5164d20a7385f4275140b93" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 35869 } } }
I20260809 20:14:08.186257 3933 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [sys.catalog]: This master's current role is: LEADER
I20260809 20:14:08.186558 3935 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ad87306b5164d20a7385f4275140b93. Latest consensus state: current_term: 2 leader_uuid: "5ad87306b5164d20a7385f4275140b93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ad87306b5164d20a7385f4275140b93" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 35869 } } }
I20260809 20:14:08.186901 3935 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93 [sys.catalog]: This master's current role is: LEADER
I20260809 20:14:08.193841 3941 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:14:08.199844 3941 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:14:08.201201 3941 catalog_manager.cc:1259] Loaded cluster ID: f0916c281203413a94984d2c8ac9dd55
I20260809 20:14:08.201340 3941 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:14:08.205202 3941 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:14:08.206908 3941 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93: Loaded TSK: 0
I20260809 20:14:08.208405 3941 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:14:08.210633 3926 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260809 20:14:08.517298 3930 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:14:08.517830 3930 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:14:08.518061 3930 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:14:08.528362 3930 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:14:08.528559 3930 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:14:08.528811 3930 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:14:08.540549 3930 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:42801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.14.181.20:42675/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:35507
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=34987
--tserver_master_addrs=127.14.181.62:35869
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:14:08.542142 3930 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:14:08.543402 3930 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:14:08.572176 3987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:08.582909 3988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:08.586019 3992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:08.587682 3930 server_base.cc:1034] running on GCE node
I20260809 20:14:08.588505 3930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:14:08.594655 3930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:14:08.596098 3930 hybrid_clock.cc:648] HybridClock initialized: now 1786306448596028 us; error 57 us; skew 500 ppm
I20260809 20:14:08.596521 3930 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:14:08 dist-test-slave-6zbq krb5kdc[2188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306448, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:08.600562 3930 init.cc:377] Logged in from keytab as kudu/127.14.181.1@KRBTEST.COM (short username kudu)
I20260809 20:14:08.612031 3930 webserver.cc:460] Webserver started at http://127.14.181.1:34987/ using document root <none> and password file <none>
I20260809 20:14:08.612967 3930 fs_manager.cc:359] Metadata directory not provided
I20260809 20:14:08.613125 3930 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 20:14:08 dist-test-slave-6zbq krb5kdc[2188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306448, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for HTTP/127.14.181.20@KRBTEST.COM
I20260809 20:14:08.651623 3930 fs_manager.cc:709] Time spent opening directory manager: real 0.021s user 0.010s sys 0.009s
I20260809 20:14:08.654289 4003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:08.655679 3930 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 20:14:08.655831 3930 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "50a5f57b02634fb9938ff71b8ab5c836"
format_stamp: "Formatted at 2026-08-09 20:14:05 on dist-test-slave-6zbq"
server_key: "a9d3a35096290d4aa56aee9deeba4eaf"
server_key_iv: "beeab7c5acb7dee439c90123f0529533"
server_key_version: "kuduclusterkey@0"
I20260809 20:14:08.656787 3930 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:14:08.672091 3930 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:14:08.677096 3930 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:14:08.677385 3930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:14:08.684656 3930 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:14:08.687096 3930 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:14:08.687209 3930 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:08.687312 3930 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:14:08.687376 3930 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:08.804283 3930 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:35507
I20260809 20:14:08.804320 4172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:35507 every 8 connection(s)
I20260809 20:14:08.806072 3930 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:14:08.811374 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 3930
I20260809 20:14:08.812227 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.181.20:42675/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:33129
--local_ip_for_outbound_sockets=127.14.181.2
--tserver_master_addrs=127.14.181.62:35869
--webserver_port=42491
--webserver_interface=127.14.181.2
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:42801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.14.181.20:42675/kms with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 20:14:08 dist-test-slave-6zbq krb5kdc[2188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306448, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:14:08.838616 4175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:08.809578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:35869 (local address 127.14.181.1:43467)
0809 20:14:08.810754 (+ 1176us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:08.810809 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:08.816562 (+ 5753us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:08.818963 (+ 2401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:08.818975 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:08.819590 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:14:08.820391 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:08.820419 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:08.823786 (+ 3367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:08.823792 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:08.825825 (+ 2033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:08.825842 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:08.827349 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:08.827357 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:08.827626 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:08.828315 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:14:08.828344 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:14:08.831069 (+ 2725us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:14:08.834267 (+ 3198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:08.834276 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:08.834291 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:08.834740 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:08.835180 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:08.835186 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:08.835190 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:08.835391 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:08.836139 (+ 748us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:14:08.836147 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:14:08.836453 (+ 306us) client_negotiation.cc:769] Sending connection context
0809 20:14:08.836681 (+ 228us) client_negotiation.cc:240] Negotiation successful
0809 20:14:08.837231 (+ 550us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":860,"thread_start_us":665,"threads_started":1}
I20260809 20:14:08.838824 4177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:08.810782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:43467 (local address 127.14.181.62:35869)
0809 20:14:08.817425 (+ 6643us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:08.817443 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:08.817492 (+ 49us) server_negotiation.cc:407] Connection header received
0809 20:14:08.817955 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:08.817976 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:08.818459 (+ 483us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:08.818800 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:08.821558 (+ 2758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:08.823584 (+ 2026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:08.826029 (+ 2445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:08.827094 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:08.828069 (+ 975us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:08.831364 (+ 3295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:08.831372 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:08.831386 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:08.831425 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:08.834116 (+ 2691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:08.834887 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:08.834894 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:08.834899 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:08.835060 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:08.835510 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:08.835513 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:08.835515 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:08.835984 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:08.836160 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:08.836949 (+ 789us) server_negotiation.cc:299] Negotiation successful
0809 20:14:08.837323 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6398,"thread_start_us":6198,"threads_started":1}
I20260809 20:14:08.841936 4173 heartbeater.cc:347] Connected to a master server at 127.14.181.62:35869
I20260809 20:14:08.842243 4173 heartbeater.cc:464] Registering TS with master...
I20260809 20:14:08.842948 4173 heartbeater.cc:511] Master 127.14.181.62:35869 requested a full tablet report, sending...
W20260809 20:14:08.845873 4173 heartbeater.cc:644] Failed to heartbeat to 127.14.181.62:35869 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 20:14:08.846102 4173 heartbeater.cc:464] Registering TS with master...
I20260809 20:14:08.846381 4173 heartbeater.cc:511] Master 127.14.181.62:35869 requested a full tablet report, sending...
I20260809 20:14:08.847564 4173 heartbeater.cc:464] Registering TS with master...
I20260809 20:14:08.847824 4173 heartbeater.cc:511] Master 127.14.181.62:35869 requested a full tablet report, sending...
W20260809 20:14:08.849084 4173 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 20:14:09.228449 4179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:14:09.228701 4179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:14:09.228828 4179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:14:09.235788 4179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:14:09.235901 4179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:14:09.236054 4179 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:14:09.245209 4179 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:42801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.14.181.20:42675/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:33129
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=42491
--tserver_master_addrs=127.14.181.62:35869
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:14:09.246271 4179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:14:09.247479 4179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:14:09.261338 4198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:09.262277 4196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:09.262753 4204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:09.262876 4179 server_base.cc:1034] running on GCE node
I20260809 20:14:09.263525 4179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:14:09.264593 4179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:14:09.265810 4179 hybrid_clock.cc:648] HybridClock initialized: now 1786306449265750 us; error 48 us; skew 500 ppm
I20260809 20:14:09.266088 4179 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:14:09 dist-test-slave-6zbq krb5kdc[2188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306449, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:09.269055 4179 init.cc:377] Logged in from keytab as kudu/127.14.181.2@KRBTEST.COM (short username kudu)
I20260809 20:14:09.270434 4179 webserver.cc:460] Webserver started at http://127.14.181.2:42491/ using document root <none> and password file <none>
I20260809 20:14:09.271030 4179 fs_manager.cc:359] Metadata directory not provided
I20260809 20:14:09.271152 4179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 20:14:09 dist-test-slave-6zbq krb5kdc[2188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306449, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for HTTP/127.14.181.20@KRBTEST.COM
I20260809 20:14:09.293264 4179 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 20:14:09.296586 4227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:09.298249 4179 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 20:14:09.298450 4179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "8e6a4777549f43f99b9d1584921d4d8d"
format_stamp: "Formatted at 2026-08-09 20:14:06 on dist-test-slave-6zbq"
server_key: "65835841a8c28bf97348ee0228aac329"
server_key_iv: "5b5e9744c277791c3c0e4dd5ce197397"
server_key_version: "kuduclusterkey@0"
I20260809 20:14:09.299777 4179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:14:09.321620 4179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:14:09.326453 4179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:14:09.326764 4179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:14:09.327912 4179 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:14:09.329548 4179 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:14:09.329666 4179 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:09.329775 4179 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:14:09.329865 4179 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:09.422981 4179 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:33129
I20260809 20:14:09.423172 4405 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:33129 every 8 connection(s)
I20260809 20:14:09.424767 4179 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:14:09.429899 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 4179
I20260809 20:14:09.430756 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.14.181.20:42675/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:38657
--local_ip_for_outbound_sockets=127.14.181.3
--tserver_master_addrs=127.14.181.62:35869
--webserver_port=38415
--webserver_interface=127.14.181.3
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:42801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.14.181.20:42675/kms with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 20:14:09 dist-test-slave-6zbq krb5kdc[2188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306449, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:14:09.468336 4410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:09.427503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:33661 (local address 127.14.181.62:35869)
0809 20:14:09.442733 (+ 15230us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:09.442740 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:09.447825 (+ 5085us) server_negotiation.cc:407] Connection header received
0809 20:14:09.450074 (+ 2249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:09.450093 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:09.450176 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:09.450296 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:09.452219 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:09.453371 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:09.455772 (+ 2401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:09.456401 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:09.456499 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:09.460783 (+ 4284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:09.460790 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:09.460794 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:09.460834 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:09.464682 (+ 3848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:09.465584 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:09.465590 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:09.465593 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:09.465748 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:09.466322 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:09.466328 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:09.466331 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:09.466723 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:09.466858 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:09.467782 (+ 924us) server_negotiation.cc:299] Negotiation successful
0809 20:14:09.467992 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15071,"thread_start_us":15230,"threads_started":1}
I20260809 20:14:09.469425 4411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:09.428097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:35869 (local address 127.14.181.2:33661)
0809 20:14:09.447369 (+ 19272us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:09.447428 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:09.449751 (+ 2323us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:09.450601 (+ 850us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:09.450613 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:09.451197 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:14:09.451993 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:09.452021 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:09.453586 (+ 1565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:09.453592 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:09.455596 (+ 2004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:09.455612 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:09.456862 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:09.456870 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:09.457160 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:09.457898 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:14:09.457927 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:14:09.460535 (+ 2608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:14:09.464842 (+ 4307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:09.464850 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:09.464865 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:09.465442 (+ 577us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:09.465899 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:09.465903 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:09.465906 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:09.466183 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:09.466949 (+ 766us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:14:09.466956 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:14:09.467355 (+ 399us) client_negotiation.cc:769] Sending connection context
0809 20:14:09.467655 (+ 300us) client_negotiation.cc:240] Negotiation successful
0809 20:14:09.468164 (+ 509us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18982,"thread_start_us":18781,"threads_started":1}
I20260809 20:14:09.470805 4407 heartbeater.cc:347] Connected to a master server at 127.14.181.62:35869
I20260809 20:14:09.471095 4407 heartbeater.cc:464] Registering TS with master...
I20260809 20:14:09.471781 4407 heartbeater.cc:511] Master 127.14.181.62:35869 requested a full tablet report, sending...
I20260809 20:14:09.473565 3868 ts_manager.cc:194] Registered new tserver with Master: 8e6a4777549f43f99b9d1584921d4d8d (127.14.181.2:33129)
I20260809 20:14:09.475188 3868 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.2@KRBTEST.COM'} at 127.14.181.2:33661
Aug 09 20:14:09 dist-test-slave-6zbq krb5kdc[2188](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786306449, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 20:14:09.821041 4413 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:14:09.821311 4413 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:14:09.821439 4413 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:14:09.830452 4413 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:14:09.830554 4413 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:14:09.830731 4413 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:14:09.842180 4413 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:42801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.14.181.20:42675/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:38657
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=38415
--tserver_master_addrs=127.14.181.62:35869
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:14:09.843329 4413 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:14:09.844486 4413 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 20:14:09.849244 4173 heartbeater.cc:464] Registering TS with master...
I20260809 20:14:09.849642 4173 heartbeater.cc:511] Master 127.14.181.62:35869 requested a full tablet report, sending...
I20260809 20:14:09.851006 3868 ts_manager.cc:194] Registered new tserver with Master: 50a5f57b02634fb9938ff71b8ab5c836 (127.14.181.1:35507)
I20260809 20:14:09.852226 3868 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.1@KRBTEST.COM'} at 127.14.181.1:43467
W20260809 20:14:09.865378 4421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:09.865509 4422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:09.873379 4413 server_base.cc:1034] running on GCE node
W20260809 20:14:09.873632 4427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:09.874236 4413 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:14:09.875242 4413 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:14:09.876456 4413 hybrid_clock.cc:648] HybridClock initialized: now 1786306449876370 us; error 85 us; skew 500 ppm
I20260809 20:14:09.876860 4413 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:14:09 dist-test-slave-6zbq krb5kdc[2188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306449, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:09.883041 4413 init.cc:377] Logged in from keytab as kudu/127.14.181.3@KRBTEST.COM (short username kudu)
I20260809 20:14:09.893812 4413 webserver.cc:460] Webserver started at http://127.14.181.3:38415/ using document root <none> and password file <none>
I20260809 20:14:09.894767 4413 fs_manager.cc:359] Metadata directory not provided
I20260809 20:14:09.894918 4413 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 20:14:09 dist-test-slave-6zbq krb5kdc[2188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306449, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for HTTP/127.14.181.20@KRBTEST.COM
Aug 09 20:14:09 dist-test-slave-6zbq krb5kdc[2188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306449, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for HTTP/127.14.181.20@KRBTEST.COM
I20260809 20:14:09.931087 4413 fs_manager.cc:709] Time spent opening directory manager: real 0.016s user 0.008s sys 0.002s
I20260809 20:14:09.970670 4437 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:09.972626 4413 fs_manager.cc:725] Time spent opening block manager: real 0.040s user 0.022s sys 0.016s
I20260809 20:14:09.972819 4413 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "284a47dc8dd74c7e8b878b395540e576"
format_stamp: "Formatted at 2026-08-09 20:14:07 on dist-test-slave-6zbq"
server_key: "b256740fb557e97bbb486c1e407f8616"
server_key_iv: "e0363ecbd7d2f1ba993fcf116742d137"
server_key_version: "kuduclusterkey@0"
I20260809 20:14:09.974205 4413 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:14:10.043334 4413 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:14:10.052771 4413 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:14:10.053036 4413 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:14:10.066687 4413 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:14:10.068106 4413 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:14:10.068205 4413 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:10.068318 4413 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:14:10.068389 4413 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:10.114583 4413 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:38657
I20260809 20:14:10.114668 4623 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:38657 every 8 connection(s)
I20260809 20:14:10.116410 4413 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:14:10.124627 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 4413
Aug 09 20:14:10 dist-test-slave-6zbq krb5kdc[2188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306449, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:14:10.149605 4631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:10.127371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55040 (local address 127.14.181.62:35869)
0809 20:14:10.131837 (+ 4466us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:10.131842 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:10.131857 (+ 15us) server_negotiation.cc:407] Connection header received
0809 20:14:10.131901 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:10.131905 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:10.131977 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:10.133962 (+ 1985us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:10.134185 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.135202 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.137207 (+ 2005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.137891 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.138006 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:10.141601 (+ 3595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:10.141607 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:10.141611 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:10.141645 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:10.145534 (+ 3889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:10.146568 (+ 1034us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:10.146573 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:10.146576 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:10.146740 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:10.147163 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:10.147168 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:10.147171 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:10.147720 (+ 549us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:10.147972 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:10.149085 (+ 1113us) server_negotiation.cc:299] Negotiation successful
0809 20:14:10.149278 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4331,"thread_start_us":4186,"threads_started":1}
I20260809 20:14:10.152503 4629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:10.121988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:44611 (local address 127.14.181.62:35869)
0809 20:14:10.127416 (+ 5428us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:10.127422 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:10.127442 (+ 20us) server_negotiation.cc:407] Connection header received
0809 20:14:10.127501 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:10.127506 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:10.127598 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:10.127710 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:10.136920 (+ 9210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.138143 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.140582 (+ 2439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.141263 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.141355 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:10.145541 (+ 4186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:10.145548 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:10.145553 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:10.145601 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:10.148810 (+ 3209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:10.149809 (+ 999us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:10.149814 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:10.149818 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:10.149953 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:10.150541 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:10.150546 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:10.150550 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:10.150868 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:10.151020 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:10.151958 (+ 938us) server_negotiation.cc:299] Negotiation successful
0809 20:14:10.152155 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5305,"thread_start_us":5197,"threads_started":1}
I20260809 20:14:10.154538 4628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:10.121418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:35869 (local address 127.14.181.3:44611)
0809 20:14:10.123752 (+ 2334us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:10.123800 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:10.125823 (+ 2023us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:10.129956 (+ 4133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:10.129967 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:10.130566 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:14:10.131311 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:10.131335 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.138389 (+ 7054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.138394 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:10.140417 (+ 2023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:10.140432 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.141679 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.141686 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:10.141978 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:10.142660 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:14:10.142700 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:14:10.145252 (+ 2552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:14:10.148974 (+ 3722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:10.148982 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:10.148996 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:10.149556 (+ 560us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:10.150103 (+ 547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:10.150108 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:10.150111 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:10.150403 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:10.151127 (+ 724us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:14:10.151134 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:14:10.151518 (+ 384us) client_negotiation.cc:769] Sending connection context
0809 20:14:10.152707 (+ 1189us) client_negotiation.cc:240] Negotiation successful
0809 20:14:10.153211 (+ 504us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2042,"thread_start_us":1812,"threads_started":1}
I20260809 20:14:10.155957 4624 heartbeater.cc:347] Connected to a master server at 127.14.181.62:35869
I20260809 20:14:10.156275 4624 heartbeater.cc:464] Registering TS with master...
I20260809 20:14:10.157081 4624 heartbeater.cc:511] Master 127.14.181.62:35869 requested a full tablet report, sending...
I20260809 20:14:10.158648 3868 ts_manager.cc:194] Registered new tserver with Master: 284a47dc8dd74c7e8b878b395540e576 (127.14.181.3:38657)
I20260809 20:14:10.159740 3868 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.3@KRBTEST.COM'} at 127.14.181.3:44611
I20260809 20:14:10.164389 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 20:14:10.188169 4629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:10.167914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55050 (local address 127.14.181.62:35869)
0809 20:14:10.168059 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:10.168064 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:10.174449 (+ 6385us) server_negotiation.cc:407] Connection header received
0809 20:14:10.174621 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:10.174625 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:10.174719 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:10.174808 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:10.176374 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.177330 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.179301 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.179906 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.179999 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:10.183258 (+ 3259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:10.183263 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:10.183267 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:10.183295 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:10.185764 (+ 2469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:10.186395 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:10.186399 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:10.186401 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:10.186510 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:10.186863 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:10.186867 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:10.186869 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:10.187114 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:10.187340 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:10.187651 (+ 311us) server_negotiation.cc:299] Negotiation successful
0809 20:14:10.187872 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 20:14:10.192433 3868 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55050:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 20:14:10.199901 3868 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
Aug 09 20:14:10 dist-test-slave-6zbq krb5kdc[2188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306449, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for HTTP/127.14.181.20@KRBTEST.COM
I20260809 20:14:10.291814 4649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:10.221483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:38657 (local address 127.0.0.1:51536)
0809 20:14:10.270913 (+ 49430us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:10.270930 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:10.271035 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:10.272023 (+ 988us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:10.272031 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:10.272063 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:14:10.272453 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:10.272464 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.275585 (+ 3121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.275591 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:10.277915 (+ 2324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:10.277932 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.290851 (+ 12919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.290857 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:10.291070 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:10.291125 (+ 55us) client_negotiation.cc:769] Sending connection context
0809 20:14:10.291277 (+ 152us) client_negotiation.cc:240] Negotiation successful
0809 20:14:10.291473 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49316,"thread_start_us":56595,"threads_started":1}
I20260809 20:14:10.293818 4652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:10.222120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51536 (local address 127.14.181.3:38657)
0809 20:14:10.269993 (+ 47873us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:10.270001 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:10.271147 (+ 1146us) server_negotiation.cc:407] Connection header received
0809 20:14:10.271266 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:10.271274 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:10.271529 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:10.271698 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:14:10.272663 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.275428 (+ 2765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.278332 (+ 2904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.280108 (+ 1776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.280250 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:10.280486 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:10.293286 (+ 12800us) server_negotiation.cc:299] Negotiation successful
0809 20:14:10.293467 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47697,"thread_start_us":47884,"threads_started":1}
I20260809 20:14:10.296314 4648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:10.231757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:33129 (local address 127.0.0.1:41184)
0809 20:14:10.280893 (+ 49136us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:10.280911 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:10.283152 (+ 2241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:10.284012 (+ 860us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:10.284017 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:10.284043 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:14:10.284383 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:10.284396 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.289324 (+ 4928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.289329 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:10.293073 (+ 3744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:10.293085 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.295474 (+ 2389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.295481 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:10.295703 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:10.295736 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 20:14:10.295813 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 20:14:10.295932 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49022,"mutex_wait_us":24,"thread_start_us":35235,"threads_started":1}
I20260809 20:14:10.297107 4654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:10.232120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41184 (local address 127.14.181.2:33129)
0809 20:14:10.266961 (+ 34841us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:10.266971 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:10.281011 (+ 14040us) server_negotiation.cc:407] Connection header received
0809 20:14:10.283348 (+ 2337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:10.283355 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:10.283554 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:10.283705 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:14:10.287623 (+ 3918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.289127 (+ 1504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.293227 (+ 4100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.294895 (+ 1668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.295025 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:10.295276 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:10.296640 (+ 1364us) server_negotiation.cc:299] Negotiation successful
0809 20:14:10.296813 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34656,"thread_start_us":35223,"threads_started":1}
I20260809 20:14:10.299063 4653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:10.221120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:35507 (local address 127.0.0.1:56008)
0809 20:14:10.266310 (+ 45190us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:10.266384 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:10.270406 (+ 4022us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:10.284901 (+ 14495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:10.284906 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:10.284933 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:14:10.285402 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:10.285415 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.294230 (+ 8815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.294238 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:10.296288 (+ 2050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:10.296308 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.298325 (+ 2017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.298331 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:10.298512 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:10.298543 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 20:14:10.298611 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 20:14:10.298736 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44885,"mutex_wait_us":18,"thread_start_us":59502,"threads_started":1}
I20260809 20:14:10.301203 4651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:10.221622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56008 (local address 127.14.181.1:35507)
0809 20:14:10.282569 (+ 60947us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:10.282575 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:10.282599 (+ 24us) server_negotiation.cc:407] Connection header received
0809 20:14:10.282701 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:10.282708 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:10.282928 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:10.285612 (+ 2684us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:14:10.285835 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.287410 (+ 1575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.296499 (+ 9089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.298074 (+ 1575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.299395 (+ 1321us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:10.299611 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:10.299685 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 20:14:10.299839 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60794,"thread_start_us":60628,"threads_started":1}
I20260809 20:14:10.301179 4296 tablet_service.cc:1467] Processing CreateTablet for tablet a8367a087dec4420b4c40db37ebef333 (DEFAULT_TABLE table=test-table [id=706ec74c635f4e7eb7dbe49fe407b3cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:14:10.302615 4296 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8367a087dec4420b4c40db37ebef333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:14:10.304735 4088 tablet_service.cc:1467] Processing CreateTablet for tablet a8367a087dec4420b4c40db37ebef333 (DEFAULT_TABLE table=test-table [id=706ec74c635f4e7eb7dbe49fe407b3cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:14:10.306121 4088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8367a087dec4420b4c40db37ebef333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:14:10.306048 4512 tablet_service.cc:1467] Processing CreateTablet for tablet a8367a087dec4420b4c40db37ebef333 (DEFAULT_TABLE table=test-table [id=706ec74c635f4e7eb7dbe49fe407b3cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:14:10.307381 4512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8367a087dec4420b4c40db37ebef333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:14:10.318532 4659 tablet_bootstrap.cc:492] T a8367a087dec4420b4c40db37ebef333 P 50a5f57b02634fb9938ff71b8ab5c836: Bootstrap starting.
I20260809 20:14:10.321565 4659 tablet_bootstrap.cc:654] T a8367a087dec4420b4c40db37ebef333 P 50a5f57b02634fb9938ff71b8ab5c836: Neither blocks nor log segments found. Creating new log.
I20260809 20:14:10.322829 4659 log.cc:824] T a8367a087dec4420b4c40db37ebef333 P 50a5f57b02634fb9938ff71b8ab5c836: Log is configured to *not* fsync() on all Append() calls
I20260809 20:14:10.332005 4661 tablet_bootstrap.cc:492] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576: Bootstrap starting.
I20260809 20:14:10.337018 4659 tablet_bootstrap.cc:492] T a8367a087dec4420b4c40db37ebef333 P 50a5f57b02634fb9938ff71b8ab5c836: No bootstrap required, opened a new log
I20260809 20:14:10.337280 4659 ts_tablet_manager.cc:1397] T a8367a087dec4420b4c40db37ebef333 P 50a5f57b02634fb9938ff71b8ab5c836: Time spent bootstrapping tablet: real 0.019s user 0.010s sys 0.007s
I20260809 20:14:10.338667 4661 tablet_bootstrap.cc:654] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576: Neither blocks nor log segments found. Creating new log.
I20260809 20:14:10.339970 4661 log.cc:824] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576: Log is configured to *not* fsync() on all Append() calls
I20260809 20:14:10.348910 4661 tablet_bootstrap.cc:492] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576: No bootstrap required, opened a new log
I20260809 20:14:10.349167 4661 ts_tablet_manager.cc:1397] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.008s
I20260809 20:14:10.360272 4661 raft_consensus.cc:348] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a5f57b02634fb9938ff71b8ab5c836" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35507 } } peers { permanent_uuid: "284a47dc8dd74c7e8b878b395540e576" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38657 } } peers { permanent_uuid: "8e6a4777549f43f99b9d1584921d4d8d" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 33129 } }
I20260809 20:14:10.360745 4661 raft_consensus.cc:374] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:14:10.360893 4661 raft_consensus.cc:729] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 284a47dc8dd74c7e8b878b395540e576, State: Initialized, Role: FOLLOWER
I20260809 20:14:10.361570 4661 consensus_queue.cc:260] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a5f57b02634fb9938ff71b8ab5c836" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35507 } } peers { permanent_uuid: "284a47dc8dd74c7e8b878b395540e576" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38657 } } peers { permanent_uuid: "8e6a4777549f43f99b9d1584921d4d8d" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 33129 } }
I20260809 20:14:10.369768 4661 ts_tablet_manager.cc:1428] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576: Time spent starting tablet: real 0.020s user 0.012s sys 0.007s
I20260809 20:14:10.370132 4624 heartbeater.cc:503] Master 127.14.181.62:35869 was elected leader, sending a full tablet report...
I20260809 20:14:10.370492 4659 raft_consensus.cc:348] T a8367a087dec4420b4c40db37ebef333 P 50a5f57b02634fb9938ff71b8ab5c836 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a5f57b02634fb9938ff71b8ab5c836" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35507 } } peers { permanent_uuid: "284a47dc8dd74c7e8b878b395540e576" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38657 } } peers { permanent_uuid: "8e6a4777549f43f99b9d1584921d4d8d" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 33129 } }
I20260809 20:14:10.370952 4659 raft_consensus.cc:374] T a8367a087dec4420b4c40db37ebef333 P 50a5f57b02634fb9938ff71b8ab5c836 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:14:10.371076 4659 raft_consensus.cc:729] T a8367a087dec4420b4c40db37ebef333 P 50a5f57b02634fb9938ff71b8ab5c836 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50a5f57b02634fb9938ff71b8ab5c836, State: Initialized, Role: FOLLOWER
I20260809 20:14:10.371768 4659 consensus_queue.cc:260] T a8367a087dec4420b4c40db37ebef333 P 50a5f57b02634fb9938ff71b8ab5c836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a5f57b02634fb9938ff71b8ab5c836" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35507 } } peers { permanent_uuid: "284a47dc8dd74c7e8b878b395540e576" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38657 } } peers { permanent_uuid: "8e6a4777549f43f99b9d1584921d4d8d" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 33129 } }
I20260809 20:14:10.376019 4173 heartbeater.cc:503] Master 127.14.181.62:35869 was elected leader, sending a full tablet report...
I20260809 20:14:10.377027 4659 ts_tablet_manager.cc:1428] T a8367a087dec4420b4c40db37ebef333 P 50a5f57b02634fb9938ff71b8ab5c836: Time spent starting tablet: real 0.040s user 0.012s sys 0.004s
I20260809 20:14:10.378057 4662 tablet_bootstrap.cc:492] T a8367a087dec4420b4c40db37ebef333 P 8e6a4777549f43f99b9d1584921d4d8d: Bootstrap starting.
W20260809 20:14:10.379627 4625 tablet.cc:2369] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:14:10.384594 4662 tablet_bootstrap.cc:654] T a8367a087dec4420b4c40db37ebef333 P 8e6a4777549f43f99b9d1584921d4d8d: Neither blocks nor log segments found. Creating new log.
I20260809 20:14:10.385944 4662 log.cc:824] T a8367a087dec4420b4c40db37ebef333 P 8e6a4777549f43f99b9d1584921d4d8d: Log is configured to *not* fsync() on all Append() calls
I20260809 20:14:10.406883 4662 tablet_bootstrap.cc:492] T a8367a087dec4420b4c40db37ebef333 P 8e6a4777549f43f99b9d1584921d4d8d: No bootstrap required, opened a new log
I20260809 20:14:10.407256 4662 ts_tablet_manager.cc:1397] T a8367a087dec4420b4c40db37ebef333 P 8e6a4777549f43f99b9d1584921d4d8d: Time spent bootstrapping tablet: real 0.029s user 0.009s sys 0.011s
I20260809 20:14:10.417630 4662 raft_consensus.cc:348] T a8367a087dec4420b4c40db37ebef333 P 8e6a4777549f43f99b9d1584921d4d8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a5f57b02634fb9938ff71b8ab5c836" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35507 } } peers { permanent_uuid: "284a47dc8dd74c7e8b878b395540e576" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38657 } } peers { permanent_uuid: "8e6a4777549f43f99b9d1584921d4d8d" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 33129 } }
I20260809 20:14:10.418152 4662 raft_consensus.cc:374] T a8367a087dec4420b4c40db37ebef333 P 8e6a4777549f43f99b9d1584921d4d8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:14:10.418304 4662 raft_consensus.cc:729] T a8367a087dec4420b4c40db37ebef333 P 8e6a4777549f43f99b9d1584921d4d8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e6a4777549f43f99b9d1584921d4d8d, State: Initialized, Role: FOLLOWER
I20260809 20:14:10.419099 4662 consensus_queue.cc:260] T a8367a087dec4420b4c40db37ebef333 P 8e6a4777549f43f99b9d1584921d4d8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a5f57b02634fb9938ff71b8ab5c836" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35507 } } peers { permanent_uuid: "284a47dc8dd74c7e8b878b395540e576" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38657 } } peers { permanent_uuid: "8e6a4777549f43f99b9d1584921d4d8d" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 33129 } }
I20260809 20:14:10.420725 4407 heartbeater.cc:503] Master 127.14.181.62:35869 was elected leader, sending a full tablet report...
I20260809 20:14:10.422621 4662 ts_tablet_manager.cc:1428] T a8367a087dec4420b4c40db37ebef333 P 8e6a4777549f43f99b9d1584921d4d8d: Time spent starting tablet: real 0.015s user 0.006s sys 0.008s
W20260809 20:14:10.444270 4409 tablet.cc:2369] T a8367a087dec4420b4c40db37ebef333 P 8e6a4777549f43f99b9d1584921d4d8d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 20:14:10.561452 4174 tablet.cc:2369] T a8367a087dec4420b4c40db37ebef333 P 50a5f57b02634fb9938ff71b8ab5c836: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:14:10.570788 4666 raft_consensus.cc:482] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:14:10.571071 4666 raft_consensus.cc:504] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a5f57b02634fb9938ff71b8ab5c836" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35507 } } peers { permanent_uuid: "284a47dc8dd74c7e8b878b395540e576" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38657 } } peers { permanent_uuid: "8e6a4777549f43f99b9d1584921d4d8d" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 33129 } }
I20260809 20:14:10.572683 4666 leader_election.cc:288] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50a5f57b02634fb9938ff71b8ab5c836 (127.14.181.1:35507), 8e6a4777549f43f99b9d1584921d4d8d (127.14.181.2:33129)
I20260809 20:14:10.581001 4628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:10.572875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:35507 (local address 127.14.181.3:48911)
0809 20:14:10.573128 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:10.573153 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:10.573293 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:10.574175 (+ 882us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:10.574181 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:10.574213 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:14:10.574475 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:10.574486 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.576096 (+ 1610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.576102 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:10.578233 (+ 2131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:10.578250 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.580206 (+ 1956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.580213 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:10.580431 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:10.580472 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 20:14:10.580571 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 20:14:10.580721 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135}
I20260809 20:14:10.581669 4651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:10.573518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:48911 (local address 127.14.181.1:35507)
0809 20:14:10.573711 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:10.573717 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:10.573735 (+ 18us) server_negotiation.cc:407] Connection header received
0809 20:14:10.573828 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:10.573833 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:10.573908 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:10.573992 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:14:10.574654 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.575818 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.578555 (+ 2737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.579826 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.579979 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:10.580052 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:10.581298 (+ 1246us) server_negotiation.cc:299] Negotiation successful
0809 20:14:10.581437 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 20:14:10.582567 4111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8367a087dec4420b4c40db37ebef333" candidate_uuid: "284a47dc8dd74c7e8b878b395540e576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50a5f57b02634fb9938ff71b8ab5c836" is_pre_election: true
I20260809 20:14:10.583142 4111 raft_consensus.cc:2454] T a8367a087dec4420b4c40db37ebef333 P 50a5f57b02634fb9938ff71b8ab5c836 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 284a47dc8dd74c7e8b878b395540e576 in term 0.
I20260809 20:14:10.583925 4444 leader_election.cc:302] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 284a47dc8dd74c7e8b878b395540e576, 50a5f57b02634fb9938ff71b8ab5c836; no voters:
I20260809 20:14:10.584460 4666 raft_consensus.cc:2781] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:14:10.584589 4666 raft_consensus.cc:482] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:14:10.584690 4666 raft_consensus.cc:3037] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:14:10.588006 4666 raft_consensus.cc:504] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a5f57b02634fb9938ff71b8ab5c836" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35507 } } peers { permanent_uuid: "284a47dc8dd74c7e8b878b395540e576" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38657 } } peers { permanent_uuid: "8e6a4777549f43f99b9d1584921d4d8d" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 33129 } }
I20260809 20:14:10.589182 4628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:10.573370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:33129 (local address 127.14.181.3:54381)
0809 20:14:10.582257 (+ 8887us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:10.582286 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:10.582422 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:10.583264 (+ 842us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:10.583281 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:10.583306 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:14:10.583501 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:10.583513 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.584929 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.584934 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:10.586768 (+ 1834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:10.586783 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.588469 (+ 1686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.588475 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:10.588698 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:10.588729 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 20:14:10.588809 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 20:14:10.588925 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8793,"threads_started":1}
I20260809 20:14:10.589159 4111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8367a087dec4420b4c40db37ebef333" candidate_uuid: "284a47dc8dd74c7e8b878b395540e576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50a5f57b02634fb9938ff71b8ab5c836"
I20260809 20:14:10.589354 4111 raft_consensus.cc:3037] T a8367a087dec4420b4c40db37ebef333 P 50a5f57b02634fb9938ff71b8ab5c836 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:14:10.589709 4654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:10.573901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:54381 (local address 127.14.181.2:33129)
0809 20:14:10.574088 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:10.574093 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:10.582829 (+ 8736us) server_negotiation.cc:407] Connection header received
0809 20:14:10.582915 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:10.582920 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:10.583012 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:10.583100 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:14:10.583694 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.584724 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.586951 (+ 2227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.588144 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.588298 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:10.588365 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:10.589349 (+ 984us) server_negotiation.cc:299] Negotiation successful
0809 20:14:10.589477 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 20:14:10.592159 4327 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8367a087dec4420b4c40db37ebef333" candidate_uuid: "284a47dc8dd74c7e8b878b395540e576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e6a4777549f43f99b9d1584921d4d8d" is_pre_election: true
I20260809 20:14:10.592676 4327 raft_consensus.cc:2454] T a8367a087dec4420b4c40db37ebef333 P 8e6a4777549f43f99b9d1584921d4d8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 284a47dc8dd74c7e8b878b395540e576 in term 0.
I20260809 20:14:10.593322 4111 raft_consensus.cc:2454] T a8367a087dec4420b4c40db37ebef333 P 50a5f57b02634fb9938ff71b8ab5c836 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 284a47dc8dd74c7e8b878b395540e576 in term 1.
I20260809 20:14:10.593782 4666 leader_election.cc:288] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576 [CANDIDATE]: Term 1 election: Requested vote from peers 50a5f57b02634fb9938ff71b8ab5c836 (127.14.181.1:35507), 8e6a4777549f43f99b9d1584921d4d8d (127.14.181.2:33129)
I20260809 20:14:10.593852 4444 leader_election.cc:302] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 284a47dc8dd74c7e8b878b395540e576, 50a5f57b02634fb9938ff71b8ab5c836; no voters:
I20260809 20:14:10.594393 4327 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8367a087dec4420b4c40db37ebef333" candidate_uuid: "284a47dc8dd74c7e8b878b395540e576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e6a4777549f43f99b9d1584921d4d8d"
I20260809 20:14:10.594601 4327 raft_consensus.cc:3037] T a8367a087dec4420b4c40db37ebef333 P 8e6a4777549f43f99b9d1584921d4d8d [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:14:10.597018 4666 raft_consensus.cc:2781] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:14:10.597486 4666 raft_consensus.cc:686] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576 [term 1 LEADER]: Becoming Leader. State: Replica: 284a47dc8dd74c7e8b878b395540e576, State: Running, Role: LEADER
I20260809 20:14:10.597661 4327 raft_consensus.cc:2454] T a8367a087dec4420b4c40db37ebef333 P 8e6a4777549f43f99b9d1584921d4d8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 284a47dc8dd74c7e8b878b395540e576 in term 1.
I20260809 20:14:10.598299 4666 consensus_queue.cc:237] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a5f57b02634fb9938ff71b8ab5c836" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35507 } } peers { permanent_uuid: "284a47dc8dd74c7e8b878b395540e576" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38657 } } peers { permanent_uuid: "8e6a4777549f43f99b9d1584921d4d8d" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 33129 } }
I20260809 20:14:10.603372 3864 catalog_manager.cc:5495] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576 reported cstate change: term changed from 0 to 1, leader changed from <none> to 284a47dc8dd74c7e8b878b395540e576 (127.14.181.3). New cstate: current_term: 1 leader_uuid: "284a47dc8dd74c7e8b878b395540e576" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50a5f57b02634fb9938ff71b8ab5c836" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "284a47dc8dd74c7e8b878b395540e576" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 38657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e6a4777549f43f99b9d1584921d4d8d" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 33129 } health_report { overall_health: UNKNOWN } } }
I20260809 20:14:10.626158 4652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:10.620458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51540 (local address 127.14.181.3:38657)
0809 20:14:10.620655 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:10.620661 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:10.620684 (+ 23us) server_negotiation.cc:407] Connection header received
0809 20:14:10.620879 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:10.620884 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:10.620991 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:10.621153 (+ 162us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:14:10.621457 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.622553 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.623848 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.624460 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.624594 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:10.624989 (+ 395us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:14:10.625619 (+ 630us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:14:10.625763 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:10.625813 (+ 50us) server_negotiation.cc:299] Negotiation successful
0809 20:14:10.625892 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 20:14:10.634546 4111 raft_consensus.cc:1261] T a8367a087dec4420b4c40db37ebef333 P 50a5f57b02634fb9938ff71b8ab5c836 [term 1 FOLLOWER]: Refusing update from remote peer 284a47dc8dd74c7e8b878b395540e576: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:14:10.634543 4327 raft_consensus.cc:1261] T a8367a087dec4420b4c40db37ebef333 P 8e6a4777549f43f99b9d1584921d4d8d [term 1 FOLLOWER]: Refusing update from remote peer 284a47dc8dd74c7e8b878b395540e576: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:14:10.635592 4672 consensus_queue.cc:1035] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e6a4777549f43f99b9d1584921d4d8d" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 33129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:14:10.635974 4666 consensus_queue.cc:1035] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50a5f57b02634fb9938ff71b8ab5c836" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:14:10.650121 4686 mvcc.cc:205] Tried to move back new op lower bound from 7316711221788532736 to 7316711221655343104. Current Snapshot: MvccSnapshot[applied={T|T < 7316711221788532736}]
I20260809 20:14:10.652809 4689 mvcc.cc:205] Tried to move back new op lower bound from 7316711221788532736 to 7316711221655343104. Current Snapshot: MvccSnapshot[applied={T|T < 7316711221788532736}]
I20260809 20:14:10.667268 3864 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55050:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:14:10.667518 3864 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55050:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:14:10.671260 3864 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5ad87306b5164d20a7385f4275140b93: Sending DeleteTablet for 3 replicas of tablet a8367a087dec4420b4c40db37ebef333
I20260809 20:14:10.672178 4088 tablet_service.cc:1514] Processing DeleteTablet for tablet a8367a087dec4420b4c40db37ebef333 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:14:10 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:56008
I20260809 20:14:10.672674 4296 tablet_service.cc:1514] Processing DeleteTablet for tablet a8367a087dec4420b4c40db37ebef333 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:14:10 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:41184
I20260809 20:14:10.675120 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 3930
I20260809 20:14:10.678892 4512 tablet_service.cc:1514] Processing DeleteTablet for tablet a8367a087dec4420b4c40db37ebef333 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:14:10 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:51536
I20260809 20:14:10.696010 4706 tablet_replica.cc:330] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576: stopping tablet replica
I20260809 20:14:10.696442 4706 raft_consensus.cc:2229] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576 [term 1 LEADER]: Raft consensus shutting down.
I20260809 20:14:10.697062 4706 raft_consensus.cc:2258] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:14:10.702325 4706 ts_tablet_manager.cc:1905] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:14:10.710845 4703 tablet_replica.cc:330] T a8367a087dec4420b4c40db37ebef333 P 50a5f57b02634fb9938ff71b8ab5c836: stopping tablet replica
I20260809 20:14:10.711390 4704 tablet_replica.cc:330] T a8367a087dec4420b4c40db37ebef333 P 8e6a4777549f43f99b9d1584921d4d8d: stopping tablet replica
I20260809 20:14:10.711840 4703 raft_consensus.cc:2229] T a8367a087dec4420b4c40db37ebef333 P 50a5f57b02634fb9938ff71b8ab5c836 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:14:10.712291 4704 raft_consensus.cc:2229] T a8367a087dec4420b4c40db37ebef333 P 8e6a4777549f43f99b9d1584921d4d8d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:14:10.712813 4703 raft_consensus.cc:2258] T a8367a087dec4420b4c40db37ebef333 P 50a5f57b02634fb9938ff71b8ab5c836 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:14:10.713371 4704 raft_consensus.cc:2258] T a8367a087dec4420b4c40db37ebef333 P 8e6a4777549f43f99b9d1584921d4d8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:14:10.715567 4704 ts_tablet_manager.cc:1905] T a8367a087dec4420b4c40db37ebef333 P 8e6a4777549f43f99b9d1584921d4d8d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:14:10.720005 4703 ts_tablet_manager.cc:1905] T a8367a087dec4420b4c40db37ebef333 P 50a5f57b02634fb9938ff71b8ab5c836: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:14:10.722481 4651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:10.675928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56018 (local address 127.14.181.1:35507)
0809 20:14:10.676106 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:10.676113 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:10.695516 (+ 19403us) server_negotiation.cc:407] Connection header received
0809 20:14:10.698510 (+ 2994us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:10.698516 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:10.698597 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:10.698667 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:10.702563 (+ 3896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.703698 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.707185 (+ 3487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.707793 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.707884 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:10.714020 (+ 6136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:10.714035 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:10.714051 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:10.714090 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:10.718937 (+ 4847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:10.719813 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:10.719822 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:10.719826 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:10.720016 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:10.720500 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:10.720506 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:10.720509 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:10.720947 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:10.721253 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:10.721862 (+ 609us) server_negotiation.cc:299] Negotiation successful
0809 20:14:10.722083 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 20:14:10.723883 4165 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:14:10.728865 4704 ts_tablet_manager.cc:1918] T a8367a087dec4420b4c40db37ebef333 P 8e6a4777549f43f99b9d1584921d4d8d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:14:10.729017 4704 log.cc:1196] T a8367a087dec4420b4c40db37ebef333 P 8e6a4777549f43f99b9d1584921d4d8d: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-1/wal/wals/a8367a087dec4420b4c40db37ebef333
I20260809 20:14:10.729503 4704 ts_tablet_manager.cc:1939] T a8367a087dec4420b4c40db37ebef333 P 8e6a4777549f43f99b9d1584921d4d8d: Deleting consensus metadata
I20260809 20:14:10.729663 4706 ts_tablet_manager.cc:1918] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:14:10.729825 4706 log.cc:1196] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786306256699363-15060-0/minicluster-data/ts-2/wal/wals/a8367a087dec4420b4c40db37ebef333
I20260809 20:14:10.730331 4706 ts_tablet_manager.cc:1939] T a8367a087dec4420b4c40db37ebef333 P 284a47dc8dd74c7e8b878b395540e576: Deleting consensus metadata
I20260809 20:14:10.731206 3838 catalog_manager.cc:4841] TS 8e6a4777549f43f99b9d1584921d4d8d (127.14.181.2:33129): tablet a8367a087dec4420b4c40db37ebef333 (table test-table [id=706ec74c635f4e7eb7dbe49fe407b3cc]) successfully deleted
I20260809 20:14:10.731874 3841 catalog_manager.cc:4841] TS 284a47dc8dd74c7e8b878b395540e576 (127.14.181.3:38657): tablet a8367a087dec4420b4c40db37ebef333 (table test-table [id=706ec74c635f4e7eb7dbe49fe407b3cc]) successfully deleted
I20260809 20:14:10.814977 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 3930
W20260809 20:14:10.835350 3845 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.181.1:35507 (error 108)
I20260809 20:14:10.836145 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 4179
I20260809 20:14:10.850899 4709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:10.850093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:35507 (local address 127.0.0.1:56030)
0809 20:14:10.850603 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:10.850712 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:35507: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":287,"threads_started":1}
W20260809 20:14:10.851203 3845 catalog_manager.cc:4584] TS 50a5f57b02634fb9938ff71b8ab5c836 (127.14.181.1:35507): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a8367a087dec4420b4c40db37ebef333: Network error: Client connection negotiation failed: client connection to 127.14.181.1:35507: connect: Connection refused (error 111)
I20260809 20:14:10.855021 4654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:10.837826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41192 (local address 127.14.181.2:33129)
0809 20:14:10.838018 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:10.838024 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:10.838044 (+ 20us) server_negotiation.cc:407] Connection header received
0809 20:14:10.838114 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:10.838121 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:10.838202 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:10.838299 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:10.840445 (+ 2146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.841599 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.843637 (+ 2038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.844289 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.844408 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:10.848319 (+ 3911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:10.848341 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:10.848364 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:10.848416 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:10.852262 (+ 3846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:10.852929 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:10.852937 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:10.852941 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:10.853124 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:10.853437 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:10.853443 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:10.853447 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:10.853903 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:10.854203 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:10.854418 (+ 215us) server_negotiation.cc:299] Negotiation successful
0809 20:14:10.854669 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 20:14:10.855780 4393 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:14:10.904870 4709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:10.904377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:35507 (local address 127.0.0.1:56036)
0809 20:14:10.904585 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:10.904698 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:35507: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260809 20:14:10.905931 4709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:10.905504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:35507 (local address 127.0.0.1:56042)
0809 20:14:10.905673 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:10.905763 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:35507: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 20:14:10.942965 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 4179
I20260809 20:14:10.966257 4709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:10.965828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:35507 (local address 127.0.0.1:56050)
0809 20:14:10.966027 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:10.966112 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:35507: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260809 20:14:10.967406 4709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:10.967037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:35507 (local address 127.0.0.1:56064)
0809 20:14:10.967184 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:10.967254 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:35507: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 20:14:10.972054 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 4413
I20260809 20:14:10.987394 4652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:10.972830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51556 (local address 127.14.181.3:38657)
0809 20:14:10.972986 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:10.972990 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:10.973008 (+ 18us) server_negotiation.cc:407] Connection header received
0809 20:14:10.973141 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:10.973144 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:10.973210 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:10.973303 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:10.975042 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.975907 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.977775 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:10.978228 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:10.978332 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:10.981503 (+ 3171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:10.981513 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:10.981527 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:10.981572 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:10.984470 (+ 2898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:10.985286 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:10.985293 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:10.985296 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:10.985448 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:10.985841 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:10.985845 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:10.985847 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:10.986163 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:10.986515 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:10.986923 (+ 408us) server_negotiation.cc:299] Negotiation successful
0809 20:14:10.987081 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 20:14:10.988049 4616 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:14:11.048331 4709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:11.047786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:35507 (local address 127.0.0.1:56072)
0809 20:14:11.048031 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:11.048135 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:35507: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260809 20:14:11.049494 4709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:11.049041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:35507 (local address 127.0.0.1:56074)
0809 20:14:11.049244 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:11.049339 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:35507: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260809 20:14:11.103122 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 4413
I20260809 20:14:11.125696 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 3806
I20260809 20:14:11.126909 3917 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:14:11.236093 4709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:11.235262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:35507 (local address 127.0.0.1:56078)
0809 20:14:11.235687 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:11.235889 (+ 202us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:35507: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260809 20:14:11.236752 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 3806
I20260809 20:14:11.268352 15060 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 20:14:11.612020 15060 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 20:14:11.612234 15060 mini_ranger.cc:66] Stopping Ranger...
I20260809 20:14:11.955651 15060 mini_ranger.cc:68] Stopped Ranger
2026-08-09 20:14:11.955 UTC [2234] LOG: received smart shutdown request
2026-08-09 20:14:11.958 UTC [2234] LOG: background worker "logical replication launcher" (PID 2249) exited with exit code 1
2026-08-09 20:14:11.958 UTC [2242] LOG: shutting down
2026-08-09 20:14:12.082 UTC [2234] LOG: database system is shut down
2026-08-09T20:14:12Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (50062 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:14:12 dist-test-slave-6zbq krb5kdc[4727](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:14:12 dist-test-slave-6zbq krb5kdc[4727](info): set up 2 sockets
Aug 09 20:14:12 dist-test-slave-6zbq krb5kdc[4727](info): commencing operation
krb5kdc: starting...
W20260809 20:14:13.394443 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.003s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:14:13 dist-test-slave-6zbq krb5kdc[4727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306453, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:14:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:14:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:14:13.598500 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:37121
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:32797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:37121,127.14.181.61:36141,127.14.181.60:35107
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:14:13.908650 4747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:14:13.908885 4747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:14:13.908977 4747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:14:13.915766 4747 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:14:13.915854 4747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:14:13.915905 4747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:14:13.915959 4747 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:14:13.916002 4747 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:14:13.925137 4747 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:32797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:37121,127.14.181.61:36141,127.14.181.60:35107
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:37121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:14:13.926180 4747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:14:13.927345 4747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:14:13.937937 4754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:13.937909 4758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:13.937873 4756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:13.938694 4747 server_base.cc:1034] running on GCE node
I20260809 20:14:13.939327 4747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:14:13.940487 4747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:14:13.941668 4747 hybrid_clock.cc:648] HybridClock initialized: now 1786306453941620 us; error 42 us; skew 500 ppm
I20260809 20:14:13.941992 4747 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:14:13 dist-test-slave-6zbq krb5kdc[4727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306453, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:13.944839 4747 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:14:13.946107 4747 webserver.cc:460] Webserver started at http://127.14.181.62:38101/ using document root <none> and password file <none>
I20260809 20:14:13.946746 4747 fs_manager.cc:359] Metadata directory not provided
I20260809 20:14:13.946861 4747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:14:13.947122 4747 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:14:13.949808 4747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "a5c8af7deb204f1dadd5485f17bb0fcf"
format_stamp: "Formatted at 2026-08-09 20:14:13 on dist-test-slave-6zbq"
server_key: "dc586ce455af003f6ab916521eb4ceda"
server_key_iv: "415ccddfeb934b3c01ecfabb90ed6499"
server_key_version: "encryptionkey@0"
I20260809 20:14:13.950608 4747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "a5c8af7deb204f1dadd5485f17bb0fcf"
format_stamp: "Formatted at 2026-08-09 20:14:13 on dist-test-slave-6zbq"
server_key: "dc586ce455af003f6ab916521eb4ceda"
server_key_iv: "415ccddfeb934b3c01ecfabb90ed6499"
server_key_version: "encryptionkey@0"
I20260809 20:14:13.955237 4747 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 20:14:13.958289 4772 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:13.959444 4747 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 20:14:13.959589 4747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "a5c8af7deb204f1dadd5485f17bb0fcf"
format_stamp: "Formatted at 2026-08-09 20:14:13 on dist-test-slave-6zbq"
server_key: "dc586ce455af003f6ab916521eb4ceda"
server_key_iv: "415ccddfeb934b3c01ecfabb90ed6499"
server_key_version: "encryptionkey@0"
I20260809 20:14:13.959764 4747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:14:13.974491 4747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:14:13.977922 4747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:14:13.978165 4747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:14:13.994832 4747 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:37121
I20260809 20:14:13.994904 4851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:37121 every 8 connection(s)
I20260809 20:14:13.996111 4747 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:14:13.999583 4852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:14:14.005338 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 4747
I20260809 20:14:14.005595 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:14:14.006439 15060 external_mini_cluster.cc:1428] Setting key f67246ce7f852a1540933c78349ee4f0
I20260809 20:14:14.006599 4852 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.62" port: 37121 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 20:14:14 dist-test-slave-6zbq krb5kdc[4727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306453, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:14:14.030442 4854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.010307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:37121 (local address 127.0.0.1:48072)
0809 20:14:14.011244 (+ 937us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.011300 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:14.013649 (+ 2349us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:14.014474 (+ 825us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:14.014481 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:14.015186 (+ 705us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:14:14.015657 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:14.015682 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.017195 (+ 1513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.017201 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:14.018317 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:14.018330 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.019464 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.019469 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:14.019590 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:14.020182 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:14:14.020212 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:14:14.022455 (+ 2243us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:14:14.026385 (+ 3930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:14.026396 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:14.026405 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:14.026821 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:14.027354 (+ 533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:14.027358 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:14.027361 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:14.027520 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:14.028436 (+ 916us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:14:14.028442 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:14:14.028664 (+ 222us) client_negotiation.cc:769] Sending connection context
0809 20:14:14.028862 (+ 198us) client_negotiation.cc:240] Negotiation successful
0809 20:14:14.029311 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"thread_start_us":384,"threads_started":1}
I20260809 20:14:14.030471 4856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.010307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48072 (local address 127.14.181.62:37121)
0809 20:14:14.012139 (+ 1832us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:14.012149 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:14.012194 (+ 45us) server_negotiation.cc:407] Connection header received
0809 20:14:14.014003 (+ 1809us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:14.014008 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:14.014227 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:14.014432 (+ 205us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:14.015854 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.017029 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.018489 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.019255 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.019433 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:14.022721 (+ 3288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:14.022732 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:14.022747 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:14.022785 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:14.026223 (+ 3438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:14.026966 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:14.026975 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:14.026978 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:14.027231 (+ 253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:14.027633 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:14.027638 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:14.027641 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:14.028295 (+ 654us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:14.028491 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:14.029037 (+ 546us) server_negotiation.cc:299] Negotiation successful
0809 20:14:14.029478 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":138,"server-negotiator.queue_time_us":1612,"spinlock_wait_cycles":47488,"thread_start_us":1389,"threads_started":1}
I20260809 20:14:14.033354 4852 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.61" port: 36141 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.14.181.61@KRBTEST.COM; defaulting to no policy
I20260809 20:14:14.034313 4854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.033958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:36141 (local address 127.0.0.1:52910)
0809 20:14:14.034123 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.034222 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:36141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260809 20:14:14.034575 4779 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.181.61:36141: connect: Connection refused (error 111)
I20260809 20:14:14.036000 4854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.035665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:36141 (local address 127.0.0.1:52922)
0809 20:14:14.035808 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.035869 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:36141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.61@KRBTEST.COM" created.
W20260809 20:14:14.036208 4852 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.61:36141: Network error: Client connection negotiation failed: client connection to 127.14.181.61:36141: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.61.keytab.
Entry for principal kudu/127.14.181.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.61.keytab.
I20260809 20:14:14.066450 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.61:36141
--webserver_interface=127.14.181.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.61.keytab
--principal=kudu/127.14.181.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:32797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:37121,127.14.181.61:36141,127.14.181.60:35107
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 20:14:14.085590 4852 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.61" port: 36141 } attempt: 1
I20260809 20:14:14.086712 4854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.086278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:36141 (local address 127.0.0.1:52938)
0809 20:14:14.086475 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.086574 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:36141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260809 20:14:14.087680 4854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.087343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:36141 (local address 127.0.0.1:52940)
0809 20:14:14.087490 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.087556 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:36141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 20:14:14.087860 4852 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.61:36141: Network error: Client connection negotiation failed: client connection to 127.14.181.61:36141: connect: Connection refused (error 111)
I20260809 20:14:14.156067 4852 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.61" port: 36141 } attempt: 2
I20260809 20:14:14.157140 4854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.156673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:36141 (local address 127.0.0.1:52952)
0809 20:14:14.156912 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.157007 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:36141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260809 20:14:14.158126 4854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.157793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:36141 (local address 127.0.0.1:52956)
0809 20:14:14.157931 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.158006 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:36141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 20:14:14.158314 4852 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.61:36141: Network error: Client connection negotiation failed: client connection to 127.14.181.61:36141: connect: Connection refused (error 111)
I20260809 20:14:14.249578 4852 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.61" port: 36141 } attempt: 3
I20260809 20:14:14.250762 4854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.250320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:36141 (local address 127.0.0.1:52972)
0809 20:14:14.250538 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.250629 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:36141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260809 20:14:14.251737 4854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.251377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:36141 (local address 127.0.0.1:52986)
0809 20:14:14.251521 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.251604 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:36141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 20:14:14.251926 4852 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.61:36141: Network error: Client connection negotiation failed: client connection to 127.14.181.61:36141: connect: Connection refused (error 111)
W20260809 20:14:14.374122 4866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:14:14.374388 4866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:14:14.374518 4866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:14:14.381336 4866 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:14:14.381438 4866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:14:14.381513 4866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:14:14.381592 4866 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:14:14.381650 4866 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:14:14.390753 4866 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:32797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:37121,127.14.181.61:36141,127.14.181.60:35107
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.61.keytab
--principal=kudu/127.14.181.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.61:36141
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.14.181.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:14:14.391857 4866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:14:14.393026 4866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 20:14:14.395123 4852 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.61" port: 36141 } attempt: 4
I20260809 20:14:14.396193 4854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.395688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:36141 (local address 127.0.0.1:53000)
0809 20:14:14.395956 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.396041 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:36141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128}
I20260809 20:14:14.397171 4854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.396825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:36141 (local address 127.0.0.1:53014)
0809 20:14:14.396967 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.397045 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:36141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 20:14:14.397348 4852 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.61:36141: Network error: Client connection negotiation failed: client connection to 127.14.181.61:36141: connect: Connection refused (error 111)
W20260809 20:14:14.403703 4884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:14.403744 4888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:14.403765 4893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:14.404524 4866 server_base.cc:1034] running on GCE node
I20260809 20:14:14.405206 4866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:14:14.406440 4866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:14:14.407626 4866 hybrid_clock.cc:648] HybridClock initialized: now 1786306454407585 us; error 33 us; skew 500 ppm
I20260809 20:14:14.407931 4866 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:14:14 dist-test-slave-6zbq krb5kdc[4727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306454, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:14.410751 4866 init.cc:377] Logged in from keytab as kudu/127.14.181.61@KRBTEST.COM (short username kudu)
I20260809 20:14:14.412050 4866 webserver.cc:460] Webserver started at http://127.14.181.61:37251/ using document root <none> and password file <none>
I20260809 20:14:14.412642 4866 fs_manager.cc:359] Metadata directory not provided
I20260809 20:14:14.412757 4866 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:14:14.413022 4866 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:14:14.415750 4866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-1/data/instance:
uuid: "639c0313262c42a3b4f5f19cb6d44052"
format_stamp: "Formatted at 2026-08-09 20:14:14 on dist-test-slave-6zbq"
server_key: "123d0d70a60eb3a7dd02e91f054045b3"
server_key_iv: "b1f88c38b8ec80bc68ac8e9b5b337e1f"
server_key_version: "encryptionkey@0"
I20260809 20:14:14.416468 4866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-1/wal/instance:
uuid: "639c0313262c42a3b4f5f19cb6d44052"
format_stamp: "Formatted at 2026-08-09 20:14:14 on dist-test-slave-6zbq"
server_key: "123d0d70a60eb3a7dd02e91f054045b3"
server_key_iv: "b1f88c38b8ec80bc68ac8e9b5b337e1f"
server_key_version: "encryptionkey@0"
I20260809 20:14:14.420965 4866 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260809 20:14:14.424059 4902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:14.425189 4866 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 20:14:14.425329 4866 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-1/wal
uuid: "639c0313262c42a3b4f5f19cb6d44052"
format_stamp: "Formatted at 2026-08-09 20:14:14 on dist-test-slave-6zbq"
server_key: "123d0d70a60eb3a7dd02e91f054045b3"
server_key_iv: "b1f88c38b8ec80bc68ac8e9b5b337e1f"
server_key_version: "encryptionkey@0"
I20260809 20:14:14.425499 4866 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:14:14.436975 4866 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:14:14.440423 4866 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:14:14.440661 4866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:14:14.456822 4866 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.61:36141
I20260809 20:14:14.456861 4989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.61:36141 every 8 connection(s)
I20260809 20:14:14.457950 4866 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-1/data/info.pb
I20260809 20:14:14.461067 4991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:14:14.465571 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 4866
I20260809 20:14:14.465775 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-1/wal/instance
I20260809 20:14:14.466324 15060 external_mini_cluster.cc:1428] Setting key 3817275a8c24998df728c3352f6a6f99
I20260809 20:14:14.467767 4991 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.62" port: 37121 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 20:14:14 dist-test-slave-6zbq krb5kdc[4727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306454, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.61@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:14:14.487432 4856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.470539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48076 (local address 127.14.181.62:37121)
0809 20:14:14.470724 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:14.470731 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:14.471741 (+ 1010us) server_negotiation.cc:407] Connection header received
0809 20:14:14.473962 (+ 2221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:14.473967 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:14.474033 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:14.474107 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:14.475829 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.476481 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.478032 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.478484 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.478581 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:14.481691 (+ 3110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:14.481696 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:14.481700 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:14.481747 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:14.484721 (+ 2974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:14.485374 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:14.485380 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:14.485383 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:14.485559 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:14.485889 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:14.485893 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:14.485896 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:14.486214 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:14.486392 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:14.486953 (+ 561us) server_negotiation.cc:299] Negotiation successful
0809 20:14:14.487151 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 20:14:14.487984 4993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.470855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:37121 (local address 127.0.0.1:48076)
0809 20:14:14.471572 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.471622 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:14.473690 (+ 2068us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:14.474362 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:14.474372 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:14.474978 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:14:14.475652 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:14.475675 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.476628 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.476633 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:14.477884 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:14.477896 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.478651 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.478657 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:14.478825 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:14.479375 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:14:14.479397 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:14:14.481475 (+ 2078us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:14:14.484844 (+ 3369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:14.484850 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:14.484859 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:14.485258 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:14.485648 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:14.485651 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:14.485653 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:14.485795 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:14.486319 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:14:14.486324 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:14:14.486615 (+ 291us) client_negotiation.cc:769] Sending connection context
0809 20:14:14.486811 (+ 196us) client_negotiation.cc:240] Negotiation successful
0809 20:14:14.487101 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":287,"threads_started":1}
I20260809 20:14:14.489493 4991 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.61" port: 36141 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.14.181.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.60@KRBTEST.COM" created.
Aug 09 20:14:14 dist-test-slave-6zbq krb5kdc[4727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306454, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.61@KRBTEST.COM for kudu/127.14.181.61@KRBTEST.COM
I20260809 20:14:14.502640 4993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.490171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:36141 (local address 127.0.0.1:53030)
0809 20:14:14.490320 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.490354 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:14.490453 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:14.491250 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:14.491254 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:14.491581 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:14:14.491712 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:14.491719 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.493350 (+ 1631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.493354 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:14.494222 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:14.494234 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.495087 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.495091 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:14.495287 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:14.495757 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:14:14.495777 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:14:14.497796 (+ 2019us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:14:14.500548 (+ 2752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:14.500553 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:14.500557 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:14.500894 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:14.501236 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:14.501241 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:14.501245 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:14.501374 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:14.501983 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:14:14.501986 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:14:14.502089 (+ 103us) client_negotiation.cc:769] Sending connection context
0809 20:14:14.502201 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 20:14:14.502412 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 20:14:14.503137 4997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.490251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53030 (local address 127.14.181.61:36141)
0809 20:14:14.490808 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:14.490816 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:14.490847 (+ 31us) server_negotiation.cc:407] Connection header received
0809 20:14:14.490900 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:14.490907 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:14.491108 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:14.491255 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:14.491863 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.493237 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.494387 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.494950 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.495065 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:14.497970 (+ 2905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:14.497981 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:14.497990 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:14.498021 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:14.500437 (+ 2416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:14.501004 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:14.501009 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:14.501011 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:14.501133 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:14.501475 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:14.501479 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:14.501483 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:14.501854 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:14.502036 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:14.502379 (+ 343us) server_negotiation.cc:299] Negotiation successful
0809 20:14:14.502604 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":261,"threads_started":1}
I20260809 20:14:14.505055 4991 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } has no permanent_uuid. Determining permanent_uuid...
I20260809 20:14:14.505964 4993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.505597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:35107 (local address 127.0.0.1:33628)
0809 20:14:14.505741 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.505839 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:35107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 20:14:14.506172 4904 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.181.60:35107: connect: Connection refused (error 111)
I20260809 20:14:14.507522 4993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.507241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:35107 (local address 127.0.0.1:33644)
0809 20:14:14.507364 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.507433 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:35107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260809 20:14:14.507705 4991 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.60:35107: Network error: Client connection negotiation failed: client connection to 127.14.181.60:35107: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.60.keytab.
Entry for principal kudu/127.14.181.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.60.keytab.
I20260809 20:14:14.519373 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.60:35107
--webserver_interface=127.14.181.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.60.keytab
--principal=kudu/127.14.181.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:32797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:37121,127.14.181.61:36141,127.14.181.60:35107
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 20:14:14.556932 4991 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } attempt: 1
I20260809 20:14:14.557801 4993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.557451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:35107 (local address 127.0.0.1:33658)
0809 20:14:14.557592 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.557679 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:35107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 20:14:14.558609 4993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.558293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:35107 (local address 127.0.0.1:33664)
0809 20:14:14.558454 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.558513 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:35107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260809 20:14:14.558840 4991 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.60:35107: Network error: Client connection negotiation failed: client connection to 127.14.181.60:35107: connect: Connection refused (error 111)
I20260809 20:14:14.627075 4991 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } attempt: 2
I20260809 20:14:14.627998 4993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.627630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:35107 (local address 127.0.0.1:33666)
0809 20:14:14.627796 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.627868 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:35107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 20:14:14.628908 4993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.628621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:35107 (local address 127.0.0.1:33670)
0809 20:14:14.628737 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.628802 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:35107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 20:14:14.629105 4991 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.60:35107: Network error: Client connection negotiation failed: client connection to 127.14.181.60:35107: connect: Connection refused (error 111)
I20260809 20:14:14.696585 4852 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.61" port: 36141 } attempt: 5
Aug 09 20:14:14 dist-test-slave-6zbq krb5kdc[4727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306453, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for kudu/127.14.181.61@KRBTEST.COM
I20260809 20:14:14.709554 4997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.697426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53040 (local address 127.14.181.61:36141)
0809 20:14:14.697600 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:14.697605 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:14.697627 (+ 22us) server_negotiation.cc:407] Connection header received
0809 20:14:14.697830 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:14.697835 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:14.697914 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:14.698003 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:14.698878 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.699565 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.700735 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.701197 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.701309 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:14.704686 (+ 3377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:14.704691 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:14.704694 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:14.704726 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:14.707154 (+ 2428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:14.707888 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:14.707891 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:14.707893 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:14.708001 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:14.708374 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:14.708376 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:14.708378 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:14.708625 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:14.708727 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:14.709183 (+ 456us) server_negotiation.cc:299] Negotiation successful
0809 20:14:14.709347 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 20:14:14.709728 4854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.697310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:36141 (local address 127.0.0.1:53040)
0809 20:14:14.697530 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.697552 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:14.697697 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:14.698063 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:14.698067 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:14.698509 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:14:14.698707 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:14.698718 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.699702 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.699706 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:14.700578 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:14.700591 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.701340 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.701346 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:14.701517 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:14.702079 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:14:14.702098 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:14:14.704496 (+ 2398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:14:14.707281 (+ 2785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:14.707287 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:14.707291 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:14.707792 (+ 501us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:14.708094 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:14.708099 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:14.708103 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:14.708278 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:14.708741 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:14:14.708746 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:14:14.708919 (+ 173us) client_negotiation.cc:769] Sending connection context
0809 20:14:14.709106 (+ 187us) client_negotiation.cc:240] Negotiation successful
0809 20:14:14.709371 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76}
I20260809 20:14:14.710767 4852 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } has no permanent_uuid. Determining permanent_uuid...
I20260809 20:14:14.711715 4854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.711365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:35107 (local address 127.0.0.1:33682)
0809 20:14:14.711511 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.711582 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:35107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260809 20:14:14.712574 4854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.712295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:35107 (local address 127.0.0.1:33698)
0809 20:14:14.712407 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.712469 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:35107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 20:14:14.712786 4852 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.60:35107: Network error: Client connection negotiation failed: client connection to 127.14.181.60:35107: connect: Connection refused (error 111)
I20260809 20:14:14.720278 4991 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } attempt: 3
I20260809 20:14:14.721132 4993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.720756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:35107 (local address 127.0.0.1:33700)
0809 20:14:14.720922 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.720997 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:35107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 20:14:14.721983 4993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.721627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:35107 (local address 127.0.0.1:33716)
0809 20:14:14.721823 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.721890 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:35107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
W20260809 20:14:14.722177 4991 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.60:35107: Network error: Client connection negotiation failed: client connection to 127.14.181.60:35107: connect: Connection refused (error 111)
I20260809 20:14:14.763969 4852 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } attempt: 1
I20260809 20:14:14.764998 4854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.764574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:35107 (local address 127.0.0.1:33732)
0809 20:14:14.764753 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.764848 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:35107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 20:14:14.765914 4854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.765620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:35107 (local address 127.0.0.1:33744)
0809 20:14:14.765740 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.765816 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:35107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 20:14:14.766129 4852 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.60:35107: Network error: Client connection negotiation failed: client connection to 127.14.181.60:35107: connect: Connection refused (error 111)
W20260809 20:14:14.827169 5000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:14:14.827440 5000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:14:14.827569 5000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:14:14.834408 5000 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
I20260809 20:14:14.834319 4852 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } attempt: 2
W20260809 20:14:14.834509 5000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:14:14.834585 5000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:14:14.834661 5000 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:14:14.834724 5000 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:14:14.835381 4854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.834911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:35107 (local address 127.0.0.1:33758)
0809 20:14:14.835133 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.835227 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:35107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260809 20:14:14.836383 4854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.836053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:35107 (local address 127.0.0.1:33764)
0809 20:14:14.836193 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.836274 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:35107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 20:14:14.836566 4852 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.60:35107: Network error: Client connection negotiation failed: client connection to 127.14.181.60:35107: connect: Connection refused (error 111)
I20260809 20:14:14.844022 5000 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:32797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:37121,127.14.181.61:36141,127.14.181.60:35107
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.60.keytab
--principal=kudu/127.14.181.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.60:35107
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.14.181.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:14:14.845126 5000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:14:14.846293 5000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:14:14.856752 5006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:14.856788 5005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:14.856940 5009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:14.857795 5000 server_base.cc:1034] running on GCE node
I20260809 20:14:14.858515 5000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:14:14.859701 5000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:14:14.860903 5000 hybrid_clock.cc:648] HybridClock initialized: now 1786306454860865 us; error 25 us; skew 500 ppm
I20260809 20:14:14.861246 5000 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:14:14 dist-test-slave-6zbq krb5kdc[4727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306454, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:14.864194 5000 init.cc:377] Logged in from keytab as kudu/127.14.181.60@KRBTEST.COM (short username kudu)
I20260809 20:14:14.865449 5000 webserver.cc:460] Webserver started at http://127.14.181.60:37555/ using document root <none> and password file <none>
I20260809 20:14:14.865373 4991 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } attempt: 4
I20260809 20:14:14.866133 5000 fs_manager.cc:359] Metadata directory not provided
I20260809 20:14:14.866276 5000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:14:14.866391 4993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.865884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:35107 (local address 127.0.0.1:33780)
0809 20:14:14.866105 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.866201 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:35107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260809 20:14:14.866623 5000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:14:14.867327 4993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.866976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:35107 (local address 127.0.0.1:33794)
0809 20:14:14.867123 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.867204 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:35107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 20:14:14.867560 4991 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.60:35107: Network error: Client connection negotiation failed: client connection to 127.14.181.60:35107: connect: Connection refused (error 111)
I20260809 20:14:14.869531 5000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-2/data/instance:
uuid: "80037f2f05ce4fbfb4a190e3231c1f8f"
format_stamp: "Formatted at 2026-08-09 20:14:14 on dist-test-slave-6zbq"
server_key: "8c81a7d35d7a611a619a027719493d4a"
server_key_iv: "7f9b2dd2a0ecb1de516ce915fe3caad8"
server_key_version: "encryptionkey@0"
I20260809 20:14:14.870270 5000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-2/wal/instance:
uuid: "80037f2f05ce4fbfb4a190e3231c1f8f"
format_stamp: "Formatted at 2026-08-09 20:14:14 on dist-test-slave-6zbq"
server_key: "8c81a7d35d7a611a619a027719493d4a"
server_key_iv: "7f9b2dd2a0ecb1de516ce915fe3caad8"
server_key_version: "encryptionkey@0"
I20260809 20:14:14.874830 5000 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 20:14:14.877805 5019 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:14.878995 5000 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:14:14.879142 5000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-2/wal
uuid: "80037f2f05ce4fbfb4a190e3231c1f8f"
format_stamp: "Formatted at 2026-08-09 20:14:14 on dist-test-slave-6zbq"
server_key: "8c81a7d35d7a611a619a027719493d4a"
server_key_iv: "7f9b2dd2a0ecb1de516ce915fe3caad8"
server_key_version: "encryptionkey@0"
I20260809 20:14:14.879312 5000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:14:14.890897 5000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:14:14.894613 5000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:14:14.894842 5000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:14:14.910809 5000 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.60:35107
I20260809 20:14:14.910861 5101 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.60:35107 every 8 connection(s)
I20260809 20:14:14.911943 5000 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-2/data/info.pb
I20260809 20:14:14.915153 5102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:14:14.916314 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 5000
I20260809 20:14:14.916523 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786306256699363-15060-0/minicluster-data/master-2/wal/instance
I20260809 20:14:14.917099 15060 external_mini_cluster.cc:1428] Setting key a6ab8df977504b304bb0285d33631760
I20260809 20:14:14.924059 5102 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.62" port: 37121 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 20:14:14 dist-test-slave-6zbq krb5kdc[4727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306453, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.60@KRBTEST.COM
Aug 09 20:14:14 dist-test-slave-6zbq krb5kdc[4727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306454, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.60@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:14:14.939340 5109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.918886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33808 (local address 127.14.181.60:35107)
0809 20:14:14.919616 (+ 730us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:14.919626 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:14.919667 (+ 41us) server_negotiation.cc:407] Connection header received
0809 20:14:14.921205 (+ 1538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:14.921225 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:14.921562 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:14.921854 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:14.923597 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.924918 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.926692 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.927649 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.927836 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:14.932296 (+ 4460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:14.932307 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:14.932320 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:14.932361 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:14.935307 (+ 2946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:14.936065 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:14.936073 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:14.936081 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:14.936267 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:14.936577 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:14.936582 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:14.936585 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:14.937205 (+ 620us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:14.937493 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:14.937822 (+ 329us) server_negotiation.cc:299] Negotiation successful
0809 20:14:14.938198 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":338,"threads_started":1}
I20260809 20:14:14.941684 4856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.926451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48090 (local address 127.14.181.62:37121)
0809 20:14:14.926646 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:14.926652 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:14.927103 (+ 451us) server_negotiation.cc:407] Connection header received
0809 20:14:14.927291 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:14.927294 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:14.927356 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:14.927431 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:14.928636 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.929694 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.931137 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.931590 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.931683 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:14.935095 (+ 3412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:14.935103 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:14.935108 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:14.935148 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:14.938189 (+ 3041us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:14.938873 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:14.938879 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:14.938882 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:14.939049 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:14.939396 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:14.939402 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:14.939405 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:14.940586 (+ 1181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:14.940759 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:14.941145 (+ 386us) server_negotiation.cc:299] Negotiation successful
0809 20:14:14.941360 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 20:14:14.941933 5110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.926318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:37121 (local address 127.0.0.1:48090)
0809 20:14:14.926969 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.927007 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:14.927162 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:14.927517 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:14.927524 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:14.928243 (+ 719us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:14:14.928494 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:14.928503 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.929834 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.929838 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:14.931003 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:14.931018 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.931822 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.931830 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:14.932007 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:14.932610 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:14:14.932631 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:14:14.934907 (+ 2276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:14:14.938304 (+ 3397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:14.938313 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:14.938318 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:14.938746 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:14.939143 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:14.939146 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:14.939148 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:14.939279 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:14.940724 (+ 1445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:14:14.940729 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:14:14.940861 (+ 132us) client_negotiation.cc:769] Sending connection context
0809 20:14:14.940993 (+ 132us) client_negotiation.cc:240] Negotiation successful
0809 20:14:14.941221 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":253,"threads_started":1}
I20260809 20:14:14.942749 4852 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } attempt: 3
I20260809 20:14:14.943399 5102 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.61" port: 36141 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 20:14:14 dist-test-slave-6zbq krb5kdc[4727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306453, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for kudu/127.14.181.60@KRBTEST.COM
Aug 09 20:14:14 dist-test-slave-6zbq krb5kdc[4727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306454, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.60@KRBTEST.COM for kudu/127.14.181.61@KRBTEST.COM
Aug 09 20:14:14 dist-test-slave-6zbq krb5kdc[4727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306453, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:14:14.956869 5109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.943305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33810 (local address 127.14.181.60:35107)
0809 20:14:14.943448 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:14.943453 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:14.943555 (+ 102us) server_negotiation.cc:407] Connection header received
0809 20:14:14.943666 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:14.943670 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:14.943735 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:14.944619 (+ 884us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:14.944751 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.945744 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.947067 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.947655 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.947770 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:14.951672 (+ 3902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:14.951679 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:14.951683 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:14.951714 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:14.954414 (+ 2700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:14.955033 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:14.955038 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:14.955041 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:14.955145 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:14.955498 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:14.955504 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:14.955507 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:14.955875 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:14.956010 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:14.956420 (+ 410us) server_negotiation.cc:299] Negotiation successful
0809 20:14:14.956633 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":49}
I20260809 20:14:14.956871 4854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.943226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:35107 (local address 127.0.0.1:33810)
0809 20:14:14.943456 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.943473 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:14.943574 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:14.943896 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:14.943902 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:14.944321 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:14:14.944492 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:14.944503 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.945868 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.945873 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:14.946928 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:14.946940 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.947807 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.947813 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:14.947972 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:14.948539 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:14:14.948560 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:14:14.951514 (+ 2954us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:14:14.954523 (+ 3009us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:14.954529 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:14.954533 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:14.954931 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:14.955258 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:14.955264 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:14.955268 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:14.955399 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:14.955999 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:14:14.956004 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:14:14.956153 (+ 149us) client_negotiation.cc:769] Sending connection context
0809 20:14:14.956319 (+ 166us) client_negotiation.cc:240] Negotiation successful
0809 20:14:14.956500 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118}
I20260809 20:14:14.958220 4856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.942288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48100 (local address 127.14.181.62:37121)
0809 20:14:14.942472 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:14.942478 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:14.942611 (+ 133us) server_negotiation.cc:407] Connection header received
0809 20:14:14.942747 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:14.942751 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:14.942817 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:14.942903 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:14.944613 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.945721 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.947477 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.947954 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.948054 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:14.952430 (+ 4376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:14.952437 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:14.952441 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:14.952475 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:14.955569 (+ 3094us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:14.956278 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:14.956281 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:14.956283 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:14.956455 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:14.956863 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:14.956869 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:14.956871 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:14.957187 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:14.957447 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:14.957740 (+ 293us) server_negotiation.cc:299] Negotiation successful
0809 20:14:14.957922 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 20:14:14.959422 4997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.944144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53056 (local address 127.14.181.61:36141)
0809 20:14:14.944318 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:14.944323 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:14.944369 (+ 46us) server_negotiation.cc:407] Connection header received
0809 20:14:14.944524 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:14.944529 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:14.944594 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:14.944672 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:14.945344 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.946077 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.947828 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.948292 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.948380 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:14.951530 (+ 3150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:14.951537 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:14.951542 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:14.951579 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:14.954928 (+ 3349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:14.955701 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:14.955707 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:14.955710 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:14.955875 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:14.958156 (+ 2281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:14.958162 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:14.958165 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:14.958519 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:14.958630 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:14.959014 (+ 384us) server_negotiation.cc:299] Negotiation successful
0809 20:14:14.959166 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 20:14:14.959518 5110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.944097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:36141 (local address 127.0.0.1:53056)
0809 20:14:14.944306 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.944323 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:14.944417 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:14.944704 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:14.944717 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:14.945070 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:14:14.945205 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:14.945215 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.946219 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.946224 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:14.947667 (+ 1443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:14.947677 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.948584 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.948588 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:14.948792 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:14.949227 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:14:14.949243 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:14:14.951356 (+ 2113us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:14:14.955084 (+ 3728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:14.955089 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:14.955093 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:14.955569 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:14.957823 (+ 2254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:14.957827 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:14.957830 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:14.958000 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:14.958633 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:14:14.958638 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:14:14.958793 (+ 155us) client_negotiation.cc:769] Sending connection context
0809 20:14:14.958956 (+ 163us) client_negotiation.cc:240] Negotiation successful
0809 20:14:14.959198 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"mutex_wait_us":58}
I20260809 20:14:14.960418 5102 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } has no permanent_uuid. Determining permanent_uuid...
I20260809 20:14:14.962399 4852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf: Bootstrap starting.
I20260809 20:14:14.965929 4852 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf: Neither blocks nor log segments found. Creating new log.
I20260809 20:14:14.967239 4852 log.cc:824] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf: Log is configured to *not* fsync() on all Append() calls
Aug 09 20:14:14 dist-test-slave-6zbq krb5kdc[4727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306454, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.60@KRBTEST.COM for kudu/127.14.181.60@KRBTEST.COM
I20260809 20:14:14.974263 5110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.960949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:35107 (local address 127.0.0.1:33824)
0809 20:14:14.961078 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:14.961107 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:14.961199 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:14.961446 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:14.961450 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:14.961864 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:14:14.962023 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:14.962034 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.963053 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.963058 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:14.964285 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:14.964300 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.965021 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.965031 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:14.965206 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:14.965664 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:14:14.965686 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:14:14.968005 (+ 2319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:14:14.971534 (+ 3529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:14.971539 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:14.971544 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:14.971991 (+ 447us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:14.972370 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:14.972375 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:14.972379 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:14.972532 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:14.973393 (+ 861us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:14:14.973397 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:14:14.973536 (+ 139us) client_negotiation.cc:769] Sending connection context
0809 20:14:14.973687 (+ 151us) client_negotiation.cc:240] Negotiation successful
0809 20:14:14.973951 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 20:14:14.974951 5109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.961031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33824 (local address 127.14.181.60:35107)
0809 20:14:14.961178 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:14.961181 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:14.961195 (+ 14us) server_negotiation.cc:407] Connection header received
0809 20:14:14.961289 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:14.961292 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:14.961338 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:14.961403 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:14.962144 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.962915 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.964420 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.964882 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.964969 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:14.968219 (+ 3250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:14.968225 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:14.968230 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:14.968263 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:14.971395 (+ 3132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:14.972097 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:14.972103 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:14.972106 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:14.972259 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:14.972643 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:14.972648 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:14.972660 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:14.973198 (+ 538us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:14.973348 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:14.974539 (+ 1191us) server_negotiation.cc:299] Negotiation successful
0809 20:14:14.974697 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
Aug 09 20:14:14 dist-test-slave-6zbq krb5kdc[4727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306453, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.61@KRBTEST.COM
I20260809 20:14:14.976465 4852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf: No bootstrap required, opened a new log
I20260809 20:14:14.980156 5102 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80037f2f05ce4fbfb4a190e3231c1f8f: Bootstrap starting.
I20260809 20:14:14.983916 5102 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 80037f2f05ce4fbfb4a190e3231c1f8f: Neither blocks nor log segments found. Creating new log.
I20260809 20:14:14.983932 4997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:14.967936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53070 (local address 127.14.181.61:36141)
0809 20:14:14.968077 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:14.968083 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:14.968196 (+ 113us) server_negotiation.cc:407] Connection header received
0809 20:14:14.968449 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:14.968454 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:14.968520 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:14.968578 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:14.970058 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.970796 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.971989 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:14.972500 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:14.972597 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:14.977351 (+ 4754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:14.977358 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:14.977362 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:14.977398 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:14.980642 (+ 3244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:14.981379 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:14.981385 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:14.981387 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:14.981545 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:14.981963 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:14.981968 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:14.981972 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:14.982508 (+ 536us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:14.982768 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:14.983400 (+ 632us) server_negotiation.cc:299] Negotiation successful
0809 20:14:14.983625 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 20:14:14.984082 4852 raft_consensus.cc:348] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 37121 } } peers { permanent_uuid: "639c0313262c42a3b4f5f19cb6d44052" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 36141 } } peers { permanent_uuid: "80037f2f05ce4fbfb4a190e3231c1f8f" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } }
I20260809 20:14:14.984438 4852 raft_consensus.cc:374] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:14:14.984551 4852 raft_consensus.cc:729] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5c8af7deb204f1dadd5485f17bb0fcf, State: Initialized, Role: FOLLOWER
I20260809 20:14:14.985146 5102 log.cc:824] T 00000000000000000000000000000000 P 80037f2f05ce4fbfb4a190e3231c1f8f: Log is configured to *not* fsync() on all Append() calls
I20260809 20:14:14.985069 4852 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 37121 } } peers { permanent_uuid: "639c0313262c42a3b4f5f19cb6d44052" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 36141 } } peers { permanent_uuid: "80037f2f05ce4fbfb4a190e3231c1f8f" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } }
I20260809 20:14:14.985944 5114 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 37121 } } peers { permanent_uuid: "639c0313262c42a3b4f5f19cb6d44052" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 36141 } } peers { permanent_uuid: "80037f2f05ce4fbfb4a190e3231c1f8f" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } } }
I20260809 20:14:14.986439 5114 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf [sys.catalog]: This master's current role is: FOLLOWER
I20260809 20:14:14.987056 4852 sys_catalog.cc:564] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:14:14.989502 15060 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 20:14:14.996256 5114 raft_consensus.cc:482] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:14:14.996503 5114 raft_consensus.cc:504] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 37121 } } peers { permanent_uuid: "639c0313262c42a3b4f5f19cb6d44052" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 36141 } } peers { permanent_uuid: "80037f2f05ce4fbfb4a190e3231c1f8f" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } }
I20260809 20:14:14.997846 5114 leader_election.cc:288] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 639c0313262c42a3b4f5f19cb6d44052 (127.14.181.61:36141), 80037f2f05ce4fbfb4a190e3231c1f8f (127.14.181.60:35107)
I20260809 20:14:14.999965 4747 master_runner.cc:186] Error getting master registration for 127.14.181.61:36141: OK, instance_id { permanent_uuid: "639c0313262c42a3b4f5f19cb6d44052" instance_seqno: 1786306454452261 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 20:14:15.020632 4747 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 20:14:15.026156 5102 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80037f2f05ce4fbfb4a190e3231c1f8f: No bootstrap required, opened a new log
W20260809 20:14:15.027580 5126 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 20:14:15.027776 5126 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 20:14:15.042646 5102 raft_consensus.cc:348] T 00000000000000000000000000000000 P 80037f2f05ce4fbfb4a190e3231c1f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 37121 } } peers { permanent_uuid: "639c0313262c42a3b4f5f19cb6d44052" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 36141 } } peers { permanent_uuid: "80037f2f05ce4fbfb4a190e3231c1f8f" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } }
I20260809 20:14:15.043231 5102 raft_consensus.cc:374] T 00000000000000000000000000000000 P 80037f2f05ce4fbfb4a190e3231c1f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:14:15.043390 5102 raft_consensus.cc:729] T 00000000000000000000000000000000 P 80037f2f05ce4fbfb4a190e3231c1f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80037f2f05ce4fbfb4a190e3231c1f8f, State: Initialized, Role: FOLLOWER
I20260809 20:14:15.044179 5102 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80037f2f05ce4fbfb4a190e3231c1f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 37121 } } peers { permanent_uuid: "639c0313262c42a3b4f5f19cb6d44052" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 36141 } } peers { permanent_uuid: "80037f2f05ce4fbfb4a190e3231c1f8f" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } }
I20260809 20:14:15.057631 5142 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80037f2f05ce4fbfb4a190e3231c1f8f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 37121 } } peers { permanent_uuid: "639c0313262c42a3b4f5f19cb6d44052" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 36141 } } peers { permanent_uuid: "80037f2f05ce4fbfb4a190e3231c1f8f" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } } }
I20260809 20:14:15.059945 5142 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80037f2f05ce4fbfb4a190e3231c1f8f [sys.catalog]: This master's current role is: FOLLOWER
I20260809 20:14:15.059836 5102 sys_catalog.cc:564] T 00000000000000000000000000000000 P 80037f2f05ce4fbfb4a190e3231c1f8f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:14:15.060222 4856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:15.030443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48116 (local address 127.14.181.62:37121)
0809 20:14:15.030595 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:15.030601 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:15.031213 (+ 612us) server_negotiation.cc:407] Connection header received
0809 20:14:15.031631 (+ 418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:15.031637 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:15.031726 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:15.031798 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:15.036634 (+ 4836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:15.037746 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:15.042570 (+ 4824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:15.043315 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:15.043416 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:15.051145 (+ 7729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:15.051152 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:15.051157 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:15.051217 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:15.055096 (+ 3879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:15.056763 (+ 1667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:15.056768 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:15.056772 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:15.056930 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:15.057840 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:15.057846 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:15.057849 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:15.058206 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:15.058459 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:15.059617 (+ 1158us) server_negotiation.cc:299] Negotiation successful
0809 20:14:15.059870 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 20:14:15.060472 5061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80037f2f05ce4fbfb4a190e3231c1f8f" is_pre_election: true
I20260809 20:14:15.061129 5061 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 80037f2f05ce4fbfb4a190e3231c1f8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5c8af7deb204f1dadd5485f17bb0fcf in term 0.
I20260809 20:14:15.061794 4773 leader_election.cc:302] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80037f2f05ce4fbfb4a190e3231c1f8f, a5c8af7deb204f1dadd5485f17bb0fcf; no voters:
I20260809 20:14:15.062639 5114 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:14:15.062798 5114 raft_consensus.cc:482] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:14:15.062891 5114 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:14:15.064339 5109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:15.033567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33840 (local address 127.14.181.60:35107)
0809 20:14:15.033743 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:15.033748 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:15.044635 (+ 10887us) server_negotiation.cc:407] Connection header received
0809 20:14:15.044872 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:15.044877 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:15.045283 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:15.045356 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:15.047561 (+ 2205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:15.048548 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:15.050632 (+ 2084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:15.051273 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:15.051366 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:15.054391 (+ 3025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:15.054399 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:15.054404 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:15.054447 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:15.059247 (+ 4800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:15.062005 (+ 2758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:15.062010 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:15.062013 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:15.062156 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:15.062665 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:15.062669 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:15.062672 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:15.062993 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:15.063225 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:15.063811 (+ 586us) server_negotiation.cc:299] Negotiation successful
0809 20:14:15.064024 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 20:14:15.066766 5114 raft_consensus.cc:504] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 37121 } } peers { permanent_uuid: "639c0313262c42a3b4f5f19cb6d44052" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 36141 } } peers { permanent_uuid: "80037f2f05ce4fbfb4a190e3231c1f8f" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } }
I20260809 20:14:15.068130 5061 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80037f2f05ce4fbfb4a190e3231c1f8f"
I20260809 20:14:15.068256 4997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:15.031128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53072 (local address 127.14.181.61:36141)
0809 20:14:15.031350 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:15.031356 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:15.038883 (+ 7527us) server_negotiation.cc:407] Connection header received
0809 20:14:15.039154 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:15.039160 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:15.039242 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:15.039312 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:15.044552 (+ 5240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:15.045575 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:15.047983 (+ 2408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:15.048600 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:15.048682 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:15.054882 (+ 6200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:15.054888 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:15.054892 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:15.054930 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:15.060985 (+ 6055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:15.062032 (+ 1047us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:15.062037 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:15.062040 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:15.062176 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:15.066007 (+ 3831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:15.066017 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:15.066020 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:15.066467 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:15.066686 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:15.067310 (+ 624us) server_negotiation.cc:299] Negotiation successful
0809 20:14:15.067683 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260809 20:14:15.068324 5061 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 80037f2f05ce4fbfb4a190e3231c1f8f [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:14:15.070797 5114 leader_election.cc:288] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf [CANDIDATE]: Term 1 election: Requested vote from peers 639c0313262c42a3b4f5f19cb6d44052 (127.14.181.61:36141), 80037f2f05ce4fbfb4a190e3231c1f8f (127.14.181.60:35107)
I20260809 20:14:15.071506 5061 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 80037f2f05ce4fbfb4a190e3231c1f8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5c8af7deb204f1dadd5485f17bb0fcf in term 1.
I20260809 20:14:15.072006 4773 leader_election.cc:302] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80037f2f05ce4fbfb4a190e3231c1f8f, a5c8af7deb204f1dadd5485f17bb0fcf; no voters:
I20260809 20:14:15.073628 5114 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:14:15.074414 5114 raft_consensus.cc:686] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf [term 1 LEADER]: Becoming Leader. State: Replica: a5c8af7deb204f1dadd5485f17bb0fcf, State: Running, Role: LEADER
I20260809 20:14:15.075024 5114 consensus_queue.cc:237] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 37121 } } peers { permanent_uuid: "639c0313262c42a3b4f5f19cb6d44052" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 36141 } } peers { permanent_uuid: "80037f2f05ce4fbfb4a190e3231c1f8f" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } }
I20260809 20:14:15.080083 5150 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5c8af7deb204f1dadd5485f17bb0fcf. Latest consensus state: current_term: 1 leader_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 37121 } } peers { permanent_uuid: "639c0313262c42a3b4f5f19cb6d44052" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 36141 } } peers { permanent_uuid: "80037f2f05ce4fbfb4a190e3231c1f8f" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } } }
I20260809 20:14:15.080602 5150 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf [sys.catalog]: This master's current role is: LEADER
I20260809 20:14:15.091696 5153 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:14:15.093902 5153 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:14:15.103605 5061 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 80037f2f05ce4fbfb4a190e3231c1f8f [term 1 FOLLOWER]: Refusing update from remote peer a5c8af7deb204f1dadd5485f17bb0fcf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:14:15.104692 5150 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "80037f2f05ce4fbfb4a190e3231c1f8f" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 20:14:15.108552 5171 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 80037f2f05ce4fbfb4a190e3231c1f8f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 20:14:15.108752 5171 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 20:14:15.109910 5000 master_runner.cc:186] Error getting master registration for 127.14.181.61:36141: OK, instance_id { permanent_uuid: "639c0313262c42a3b4f5f19cb6d44052" instance_seqno: 1786306454452261 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 20:14:15.123329 5000 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 20:14:15.134210 5142 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80037f2f05ce4fbfb4a190e3231c1f8f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5c8af7deb204f1dadd5485f17bb0fcf. Latest consensus state: current_term: 1 leader_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 37121 } } peers { permanent_uuid: "639c0313262c42a3b4f5f19cb6d44052" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 36141 } } peers { permanent_uuid: "80037f2f05ce4fbfb4a190e3231c1f8f" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } } }
I20260809 20:14:15.134568 5142 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80037f2f05ce4fbfb4a190e3231c1f8f [sys.catalog]: This master's current role is: FOLLOWER
I20260809 20:14:15.141851 5168 mvcc.cc:205] Tried to move back new op lower bound from 7316711240093822976 to 7316711239993798656. Current Snapshot: MvccSnapshot[applied={T|T < 7316711240093822976}]
I20260809 20:14:15.142961 5150 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 37121 } } peers { permanent_uuid: "639c0313262c42a3b4f5f19cb6d44052" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 36141 } } peers { permanent_uuid: "80037f2f05ce4fbfb4a190e3231c1f8f" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } } }
I20260809 20:14:15.143235 5150 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf [sys.catalog]: This master's current role is: LEADER
I20260809 20:14:15.144565 5174 mvcc.cc:205] Tried to move back new op lower bound from 7316711240093822976 to 7316711239993798656. Current Snapshot: MvccSnapshot[applied={T|T < 7316711240093822976}]
I20260809 20:14:15.145978 5153 catalog_manager.cc:1347] Generated new cluster ID: abf0d2ddafcd4277a14dfcc2f5249142
I20260809 20:14:15.146083 5153 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:14:15.150254 5142 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80037f2f05ce4fbfb4a190e3231c1f8f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 37121 } } peers { permanent_uuid: "639c0313262c42a3b4f5f19cb6d44052" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 36141 } } peers { permanent_uuid: "80037f2f05ce4fbfb4a190e3231c1f8f" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } } }
I20260809 20:14:15.150508 5142 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80037f2f05ce4fbfb4a190e3231c1f8f [sys.catalog]: This master's current role is: FOLLOWER
I20260809 20:14:15.166774 4991 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } attempt: 5
I20260809 20:14:15.174793 5153 catalog_manager.cc:1370] Generated new certificate authority record
Aug 09 20:14:15 dist-test-slave-6zbq krb5kdc[4727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306454, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.61@KRBTEST.COM for kudu/127.14.181.60@KRBTEST.COM
I20260809 20:14:15.177841 5153 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:14:15.192487 4993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:15.167462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:35107 (local address 127.0.0.1:33848)
0809 20:14:15.167801 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:15.167821 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:15.167925 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:15.168754 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:15.168759 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:15.169307 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:14:15.169509 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:15.169521 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:15.171568 (+ 2047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:15.171573 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:15.173022 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:15.173040 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:15.174400 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:15.174406 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:15.174625 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:15.175384 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:14:15.175407 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:14:15.178864 (+ 3457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:14:15.186769 (+ 7905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:15.186774 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:15.186805 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:15.187672 (+ 867us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:15.188473 (+ 801us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:15.188478 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:15.188482 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:15.188777 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:15.189934 (+ 1157us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:14:15.189940 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:14:15.190207 (+ 267us) client_negotiation.cc:769] Sending connection context
0809 20:14:15.190474 (+ 267us) client_negotiation.cc:240] Negotiation successful
0809 20:14:15.190942 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219}
I20260809 20:14:15.194237 5109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:15.168132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33848 (local address 127.14.181.60:35107)
0809 20:14:15.168307 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:15.168313 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:15.168330 (+ 17us) server_negotiation.cc:407] Connection header received
0809 20:14:15.168378 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:15.168383 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:15.168455 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:15.168549 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:15.169679 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:15.170833 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:15.173349 (+ 2516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:15.174015 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:15.174137 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:15.179164 (+ 5027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:15.179173 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:15.179178 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:15.179215 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:15.186540 (+ 7325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:15.187926 (+ 1386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:15.187963 (+ 37us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:15.187967 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:15.188261 (+ 294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:15.189017 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:15.189022 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:15.189026 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:15.189744 (+ 718us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:15.191429 (+ 1685us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:15.192089 (+ 660us) server_negotiation.cc:299] Negotiation successful
0809 20:14:15.193484 (+ 1395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 20:14:15.202472 5153 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf: Generated new TSK 0
I20260809 20:14:15.203825 4991 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 639c0313262c42a3b4f5f19cb6d44052: Bootstrap starting.
I20260809 20:14:15.204295 5153 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:14:15.208717 4991 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 639c0313262c42a3b4f5f19cb6d44052: Neither blocks nor log segments found. Creating new log.
I20260809 20:14:15.209939 4991 log.cc:824] T 00000000000000000000000000000000 P 639c0313262c42a3b4f5f19cb6d44052: Log is configured to *not* fsync() on all Append() calls
I20260809 20:14:15.213649 4991 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 639c0313262c42a3b4f5f19cb6d44052: No bootstrap required, opened a new log
I20260809 20:14:15.235069 4991 raft_consensus.cc:348] T 00000000000000000000000000000000 P 639c0313262c42a3b4f5f19cb6d44052 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 37121 } } peers { permanent_uuid: "639c0313262c42a3b4f5f19cb6d44052" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 36141 } } peers { permanent_uuid: "80037f2f05ce4fbfb4a190e3231c1f8f" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } }
I20260809 20:14:15.235882 4991 raft_consensus.cc:374] T 00000000000000000000000000000000 P 639c0313262c42a3b4f5f19cb6d44052 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:14:15.236100 4991 raft_consensus.cc:729] T 00000000000000000000000000000000 P 639c0313262c42a3b4f5f19cb6d44052 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 639c0313262c42a3b4f5f19cb6d44052, State: Initialized, Role: FOLLOWER
I20260809 20:14:15.237267 4991 consensus_queue.cc:260] T 00000000000000000000000000000000 P 639c0313262c42a3b4f5f19cb6d44052 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 37121 } } peers { permanent_uuid: "639c0313262c42a3b4f5f19cb6d44052" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 36141 } } peers { permanent_uuid: "80037f2f05ce4fbfb4a190e3231c1f8f" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } }
I20260809 20:14:15.258970 5184 sys_catalog.cc:455] T 00000000000000000000000000000000 P 639c0313262c42a3b4f5f19cb6d44052 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 37121 } } peers { permanent_uuid: "639c0313262c42a3b4f5f19cb6d44052" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 36141 } } peers { permanent_uuid: "80037f2f05ce4fbfb4a190e3231c1f8f" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } } }
I20260809 20:14:15.259431 5184 sys_catalog.cc:458] T 00000000000000000000000000000000 P 639c0313262c42a3b4f5f19cb6d44052 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 20:14:15.262053 4949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "639c0313262c42a3b4f5f19cb6d44052" is_pre_election: true
I20260809 20:14:15.262633 4949 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 639c0313262c42a3b4f5f19cb6d44052 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5c8af7deb204f1dadd5485f17bb0fcf in term 0.
I20260809 20:14:15.262997 4946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "639c0313262c42a3b4f5f19cb6d44052"
I20260809 20:14:15.263240 4946 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 639c0313262c42a3b4f5f19cb6d44052 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:14:15.266371 4946 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 639c0313262c42a3b4f5f19cb6d44052 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5c8af7deb204f1dadd5485f17bb0fcf in term 1.
I20260809 20:14:15.267108 4944 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 639c0313262c42a3b4f5f19cb6d44052 [term 1 FOLLOWER]: Refusing update from remote peer a5c8af7deb204f1dadd5485f17bb0fcf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:14:15.267838 4991 sys_catalog.cc:564] T 00000000000000000000000000000000 P 639c0313262c42a3b4f5f19cb6d44052 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:14:15.268484 5114 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "639c0313262c42a3b4f5f19cb6d44052" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 36141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:14:15.336033 5184 sys_catalog.cc:455] T 00000000000000000000000000000000 P 639c0313262c42a3b4f5f19cb6d44052 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5c8af7deb204f1dadd5485f17bb0fcf. Latest consensus state: current_term: 1 leader_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 37121 } } peers { permanent_uuid: "639c0313262c42a3b4f5f19cb6d44052" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 36141 } } peers { permanent_uuid: "80037f2f05ce4fbfb4a190e3231c1f8f" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } } }
I20260809 20:14:15.336335 5184 sys_catalog.cc:458] T 00000000000000000000000000000000 P 639c0313262c42a3b4f5f19cb6d44052 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 20:14:15.336624 5199 sys_catalog.cc:455] T 00000000000000000000000000000000 P 639c0313262c42a3b4f5f19cb6d44052 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 37121 } } peers { permanent_uuid: "639c0313262c42a3b4f5f19cb6d44052" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 36141 } } peers { permanent_uuid: "80037f2f05ce4fbfb4a190e3231c1f8f" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } } }
I20260809 20:14:15.336911 5199 sys_catalog.cc:458] T 00000000000000000000000000000000 P 639c0313262c42a3b4f5f19cb6d44052 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 20:14:15.361143 5222 catalog_manager.cc:1259] Loaded cluster ID: abf0d2ddafcd4277a14dfcc2f5249142
I20260809 20:14:15.361296 5222 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 639c0313262c42a3b4f5f19cb6d44052: loading cluster ID for follower catalog manager: success
I20260809 20:14:15.365064 5222 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 639c0313262c42a3b4f5f19cb6d44052: acquiring CA information for follower catalog manager: success
I20260809 20:14:15.367492 5222 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 639c0313262c42a3b4f5f19cb6d44052: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 20:14:15.807623 5114 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5c8af7deb204f1dadd5485f17bb0fcf" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 37121 } } peers { permanent_uuid: "639c0313262c42a3b4f5f19cb6d44052" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 36141 } } peers { permanent_uuid: "80037f2f05ce4fbfb4a190e3231c1f8f" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 35107 } } }
I20260809 20:14:15.807955 5114 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5c8af7deb204f1dadd5485f17bb0fcf [sys.catalog]: This master's current role is: LEADER
I20260809 20:14:16.110782 5171 catalog_manager.cc:1259] Loaded cluster ID: abf0d2ddafcd4277a14dfcc2f5249142
I20260809 20:14:16.110890 5171 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 80037f2f05ce4fbfb4a190e3231c1f8f: loading cluster ID for follower catalog manager: success
I20260809 20:14:16.113299 5171 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 80037f2f05ce4fbfb4a190e3231c1f8f: acquiring CA information for follower catalog manager: success
I20260809 20:14:16.115025 5171 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 80037f2f05ce4fbfb4a190e3231c1f8f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 20:14:16.362365 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 4747
I20260809 20:14:16.363663 4842 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:14:16.480655 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 4747
I20260809 20:14:16.508495 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 4866
I20260809 20:14:16.509521 4981 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:14:16.612857 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 4866
I20260809 20:14:16.637642 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 5000
I20260809 20:14:16.638698 5097 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:14:16.739621 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 5000
2026-08-09T20:14:16Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (4559 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:14:16 dist-test-slave-6zbq krb5kdc[5236](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:14:16 dist-test-slave-6zbq krb5kdc[5236](info): set up 2 sockets
Aug 09 20:14:16 dist-test-slave-6zbq krb5kdc[5236](info): commencing operation
krb5kdc: starting...
W20260809 20:14:17.942143 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.157s user 0.000s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:14:18 dist-test-slave-6zbq krb5kdc[5236](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:14:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:14:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:14:18.155844 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:43793
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:44063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:43793
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:14:18.464643 5256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:14:18.464882 5256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:14:18.465003 5256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:14:18.472000 5256 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:14:18.472083 5256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:14:18.472157 5256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:14:18.472234 5256 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:14:18.472292 5256 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:14:18.481451 5256 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:44063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:43793
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:43793
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:14:18.482577 5256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:14:18.483772 5256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:14:18.494287 5268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:18.494371 5274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:18.494387 5277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:18.495371 5256 server_base.cc:1034] running on GCE node
I20260809 20:14:18.496081 5256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:14:18.497315 5256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:14:18.498503 5256 hybrid_clock.cc:648] HybridClock initialized: now 1786306458498451 us; error 44 us; skew 500 ppm
I20260809 20:14:18.498814 5256 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:14:18 dist-test-slave-6zbq krb5kdc[5236](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306458, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:18.501681 5256 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:14:18.503019 5256 webserver.cc:460] Webserver started at http://127.14.181.62:42635/ using document root <none> and password file <none>
I20260809 20:14:18.503621 5256 fs_manager.cc:359] Metadata directory not provided
I20260809 20:14:18.503744 5256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:14:18.504014 5256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:14:18.506810 5256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "795325195b3c499b87fc70273c5b9dc5"
format_stamp: "Formatted at 2026-08-09 20:14:18 on dist-test-slave-6zbq"
server_key: "69fea371d6181d50da335b67b0638bf4"
server_key_iv: "315b52a442096ec43c9324c70fb8c9d0"
server_key_version: "encryptionkey@0"
I20260809 20:14:18.507512 5256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "795325195b3c499b87fc70273c5b9dc5"
format_stamp: "Formatted at 2026-08-09 20:14:18 on dist-test-slave-6zbq"
server_key: "69fea371d6181d50da335b67b0638bf4"
server_key_iv: "315b52a442096ec43c9324c70fb8c9d0"
server_key_version: "encryptionkey@0"
I20260809 20:14:18.512162 5256 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260809 20:14:18.515281 5293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:18.516444 5256 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 20:14:18.516597 5256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "795325195b3c499b87fc70273c5b9dc5"
format_stamp: "Formatted at 2026-08-09 20:14:18 on dist-test-slave-6zbq"
server_key: "69fea371d6181d50da335b67b0638bf4"
server_key_iv: "315b52a442096ec43c9324c70fb8c9d0"
server_key_version: "encryptionkey@0"
I20260809 20:14:18.516778 5256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:14:18.536650 5256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:14:18.540632 5256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:14:18.540904 5256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:14:18.557279 5256 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:43793
I20260809 20:14:18.557304 5382 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:43793 every 8 connection(s)
I20260809 20:14:18.558527 5256 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:14:18.562069 5384 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:14:18.563457 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 5256
I20260809 20:14:18.563694 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:14:18.564535 15060 external_mini_cluster.cc:1428] Setting key 43d4895bfc32377af019714d9a49a1de
I20260809 20:14:18.576192 5384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 795325195b3c499b87fc70273c5b9dc5: Bootstrap starting.
Aug 09 20:14:18 dist-test-slave-6zbq krb5kdc[5236](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:14:18.579300 5384 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 795325195b3c499b87fc70273c5b9dc5: Neither blocks nor log segments found. Creating new log.
I20260809 20:14:18.580549 5384 log.cc:824] T 00000000000000000000000000000000 P 795325195b3c499b87fc70273c5b9dc5: Log is configured to *not* fsync() on all Append() calls
I20260809 20:14:18.583847 5384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 795325195b3c499b87fc70273c5b9dc5: No bootstrap required, opened a new log
I20260809 20:14:18.587308 5387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:18.566313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59972 (local address 127.14.181.62:43793)
0809 20:14:18.567094 (+ 781us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:18.567109 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:18.567159 (+ 50us) server_negotiation.cc:407] Connection header received
0809 20:14:18.568841 (+ 1682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:18.568869 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:18.569361 (+ 492us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:18.569790 (+ 429us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:18.571173 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:18.573175 (+ 2002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:18.574508 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:18.575509 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:18.575681 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:18.579664 (+ 3983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:18.579677 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:18.579699 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:18.579763 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:18.583495 (+ 3732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:18.584151 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:18.584160 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:18.584165 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:18.584338 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:18.584714 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:18.584718 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:18.584720 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:18.585203 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:18.585502 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:18.585960 (+ 458us) server_negotiation.cc:299] Negotiation successful
0809 20:14:18.586334 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":529,"thread_start_us":317,"threads_started":1}
I20260809 20:14:18.590754 15060 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 20:14:18.591514 5384 raft_consensus.cc:348] T 00000000000000000000000000000000 P 795325195b3c499b87fc70273c5b9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "795325195b3c499b87fc70273c5b9dc5" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 43793 } }
I20260809 20:14:18.591830 5384 raft_consensus.cc:374] T 00000000000000000000000000000000 P 795325195b3c499b87fc70273c5b9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:14:18.591918 5384 raft_consensus.cc:729] T 00000000000000000000000000000000 P 795325195b3c499b87fc70273c5b9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 795325195b3c499b87fc70273c5b9dc5, State: Initialized, Role: FOLLOWER
I20260809 20:14:18.592432 5384 consensus_queue.cc:260] T 00000000000000000000000000000000 P 795325195b3c499b87fc70273c5b9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "795325195b3c499b87fc70273c5b9dc5" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 43793 } }
I20260809 20:14:18.592641 5384 raft_consensus.cc:388] T 00000000000000000000000000000000 P 795325195b3c499b87fc70273c5b9dc5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:14:18.592764 5384 raft_consensus.cc:482] T 00000000000000000000000000000000 P 795325195b3c499b87fc70273c5b9dc5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:14:18.592953 5384 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 795325195b3c499b87fc70273c5b9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:14:18.595289 5384 raft_consensus.cc:504] T 00000000000000000000000000000000 P 795325195b3c499b87fc70273c5b9dc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "795325195b3c499b87fc70273c5b9dc5" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 43793 } }
I20260809 20:14:18.595721 5384 leader_election.cc:302] T 00000000000000000000000000000000 P 795325195b3c499b87fc70273c5b9dc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 795325195b3c499b87fc70273c5b9dc5; no voters:
I20260809 20:14:18.596221 5384 leader_election.cc:288] T 00000000000000000000000000000000 P 795325195b3c499b87fc70273c5b9dc5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:14:18.596338 5392 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 795325195b3c499b87fc70273c5b9dc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:14:18.596922 5392 raft_consensus.cc:686] T 00000000000000000000000000000000 P 795325195b3c499b87fc70273c5b9dc5 [term 1 LEADER]: Becoming Leader. State: Replica: 795325195b3c499b87fc70273c5b9dc5, State: Running, Role: LEADER
I20260809 20:14:18.597419 5392 consensus_queue.cc:237] T 00000000000000000000000000000000 P 795325195b3c499b87fc70273c5b9dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "795325195b3c499b87fc70273c5b9dc5" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 43793 } }
I20260809 20:14:18.597998 5384 sys_catalog.cc:564] T 00000000000000000000000000000000 P 795325195b3c499b87fc70273c5b9dc5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:14:18.599822 5395 sys_catalog.cc:455] T 00000000000000000000000000000000 P 795325195b3c499b87fc70273c5b9dc5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "795325195b3c499b87fc70273c5b9dc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "795325195b3c499b87fc70273c5b9dc5" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 43793 } } }
I20260809 20:14:18.600242 5395 sys_catalog.cc:458] T 00000000000000000000000000000000 P 795325195b3c499b87fc70273c5b9dc5 [sys.catalog]: This master's current role is: LEADER
I20260809 20:14:18.599846 5398 sys_catalog.cc:455] T 00000000000000000000000000000000 P 795325195b3c499b87fc70273c5b9dc5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 795325195b3c499b87fc70273c5b9dc5. Latest consensus state: current_term: 1 leader_uuid: "795325195b3c499b87fc70273c5b9dc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "795325195b3c499b87fc70273c5b9dc5" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 43793 } } }
I20260809 20:14:18.602738 5398 sys_catalog.cc:458] T 00000000000000000000000000000000 P 795325195b3c499b87fc70273c5b9dc5 [sys.catalog]: This master's current role is: LEADER
I20260809 20:14:18.612702 5404 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:14:18.617985 5404 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:14:18.626940 5404 catalog_manager.cc:1347] Generated new cluster ID: 76f1098d0ecc4f15b883efcd2fa11c1f
I20260809 20:14:18.627043 5404 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:14:18.637610 5404 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:14:18.639348 5404 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:14:18.646955 5404 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 795325195b3c499b87fc70273c5b9dc5: Generated new TSK 0
I20260809 20:14:18.647830 5404 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:14:18.701557 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 5256
I20260809 20:14:18.702587 5377 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:14:18.794096 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 5256
2026-08-09T20:14:18Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2049 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:14:18 dist-test-slave-6zbq krb5kdc[5440](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:14:18 dist-test-slave-6zbq krb5kdc[5440](info): set up 2 sockets
Aug 09 20:14:18 dist-test-slave-6zbq krb5kdc[5440](info): commencing operation
krb5kdc: starting...
W20260809 20:14:19.985934 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.152s user 0.000s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:14:20 dist-test-slave-6zbq krb5kdc[5440](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:14:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:14:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:14:20.227319 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:39017
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:39017
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:14:20.538714 5458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:14:20.538965 5458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:14:20.539094 5458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:14:20.546018 5458 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:14:20.546118 5458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:14:20.546192 5458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:14:20.546262 5458 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:14:20.546319 5458 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:14:20.555730 5458 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:39017
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:39017
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:14:20.556901 5458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:14:20.558081 5458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:14:20.568889 5469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:20.568929 5475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:20.568962 5471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:20.569990 5458 server_base.cc:1034] running on GCE node
I20260809 20:14:20.570720 5458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:14:20.571933 5458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:14:20.573124 5458 hybrid_clock.cc:648] HybridClock initialized: now 1786306460573076 us; error 29 us; skew 500 ppm
I20260809 20:14:20.573431 5458 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:14:20 dist-test-slave-6zbq krb5kdc[5440](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306460, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:20.576292 5458 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:14:20.577641 5458 webserver.cc:460] Webserver started at http://127.14.181.62:41363/ using document root <none> and password file <none>
I20260809 20:14:20.578284 5458 fs_manager.cc:359] Metadata directory not provided
I20260809 20:14:20.578425 5458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:14:20.578675 5458 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:14:20.581426 5458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "f0d4629efcfb411888390125cdec16fa"
format_stamp: "Formatted at 2026-08-09 20:14:20 on dist-test-slave-6zbq"
server_key: "cfa351bda5dc272808ef45d7529cd984"
server_key_iv: "5c194ca549cda59941de04c0d755d719"
server_key_version: "encryptionkey@0"
I20260809 20:14:20.582129 5458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "f0d4629efcfb411888390125cdec16fa"
format_stamp: "Formatted at 2026-08-09 20:14:20 on dist-test-slave-6zbq"
server_key: "cfa351bda5dc272808ef45d7529cd984"
server_key_iv: "5c194ca549cda59941de04c0d755d719"
server_key_version: "encryptionkey@0"
I20260809 20:14:20.586843 5458 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 20:14:20.589867 5485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:20.591070 5458 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:14:20.591217 5458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "f0d4629efcfb411888390125cdec16fa"
format_stamp: "Formatted at 2026-08-09 20:14:20 on dist-test-slave-6zbq"
server_key: "cfa351bda5dc272808ef45d7529cd984"
server_key_iv: "5c194ca549cda59941de04c0d755d719"
server_key_version: "encryptionkey@0"
I20260809 20:14:20.591390 5458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:14:20.608482 5458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:14:20.613294 5458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:14:20.613572 5458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:14:20.631019 5458 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:39017
I20260809 20:14:20.631050 5564 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:39017 every 8 connection(s)
I20260809 20:14:20.632184 5458 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:14:20.635288 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 5458
I20260809 20:14:20.635509 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:14:20.635769 5565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:14:20.636375 15060 external_mini_cluster.cc:1428] Setting key e5897b978ff60d0222c56ffd78b6f3ae
I20260809 20:14:20.649199 5565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa: Bootstrap starting.
Aug 09 20:14:20 dist-test-slave-6zbq krb5kdc[5440](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:14:20.652070 5565 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa: Neither blocks nor log segments found. Creating new log.
I20260809 20:14:20.653043 5565 log.cc:824] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa: Log is configured to *not* fsync() on all Append() calls
I20260809 20:14:20.655552 5565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa: No bootstrap required, opened a new log
I20260809 20:14:20.657874 5568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:20.638231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37308 (local address 127.14.181.62:39017)
0809 20:14:20.639059 (+ 828us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:20.639070 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:20.639109 (+ 39us) server_negotiation.cc:407] Connection header received
0809 20:14:20.640590 (+ 1481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:20.640614 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:20.640954 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:20.641284 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:20.642906 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:20.644102 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:20.645840 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:20.646586 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:20.646711 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:20.651148 (+ 4437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:20.651155 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:20.651168 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:20.651214 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:20.654083 (+ 2869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:20.654790 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:20.654797 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:20.654803 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:20.654954 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:20.655326 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:20.655330 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:20.655332 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:20.655839 (+ 507us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:20.656154 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:20.656553 (+ 399us) server_negotiation.cc:299] Negotiation successful
0809 20:14:20.656923 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":632,"thread_start_us":386,"threads_started":1}
I20260809 20:14:20.662984 5565 raft_consensus.cc:348] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d4629efcfb411888390125cdec16fa" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39017 } }
I20260809 20:14:20.663323 5565 raft_consensus.cc:374] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:14:20.663432 5565 raft_consensus.cc:729] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0d4629efcfb411888390125cdec16fa, State: Initialized, Role: FOLLOWER
I20260809 20:14:20.663956 5565 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d4629efcfb411888390125cdec16fa" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39017 } }
I20260809 20:14:20.664160 5565 raft_consensus.cc:388] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:14:20.664284 5565 raft_consensus.cc:482] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:14:20.664427 5565 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:14:20.666507 5565 raft_consensus.cc:504] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d4629efcfb411888390125cdec16fa" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39017 } }
I20260809 20:14:20.666962 5565 leader_election.cc:302] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f0d4629efcfb411888390125cdec16fa; no voters:
I20260809 20:14:20.667467 5565 leader_election.cc:288] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:14:20.667567 5572 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:14:20.668187 5572 raft_consensus.cc:686] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [term 1 LEADER]: Becoming Leader. State: Replica: f0d4629efcfb411888390125cdec16fa, State: Running, Role: LEADER
I20260809 20:14:20.668679 5572 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d4629efcfb411888390125cdec16fa" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39017 } }
I20260809 20:14:20.669229 5565 sys_catalog.cc:564] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:14:20.671651 5574 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f0d4629efcfb411888390125cdec16fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d4629efcfb411888390125cdec16fa" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39017 } } }
I20260809 20:14:20.672065 5574 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [sys.catalog]: This master's current role is: LEADER
I20260809 20:14:20.671576 5575 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0d4629efcfb411888390125cdec16fa. Latest consensus state: current_term: 1 leader_uuid: "f0d4629efcfb411888390125cdec16fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d4629efcfb411888390125cdec16fa" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39017 } } }
I20260809 20:14:20.673079 5575 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [sys.catalog]: This master's current role is: LEADER
I20260809 20:14:20.675503 5584 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:14:20.680265 5584 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:14:20.688927 5584 catalog_manager.cc:1347] Generated new cluster ID: e75124fba42e424bafcdd84da9e6ba85
I20260809 20:14:20.689026 5584 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:14:20.708709 5584 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:14:20.709884 5584 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:14:20.715780 5584 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa: Generated new TSK 0
I20260809 20:14:20.716490 5584 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.181.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
I20260809 20:14:20.782990 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:0
--local_ip_for_outbound_sockets=127.14.181.1
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39017
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:14:21.116282 5608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:14:21.116567 5608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:14:21.116672 5608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:14:21.123806 5608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:14:21.123908 5608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:14:21.124025 5608 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:14:21.133342 5608 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39017
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:14:21.134539 5608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:14:21.135753 5608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:14:21.147984 5615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:21.147964 5619 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:21.148066 5617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:21.148567 5608 server_base.cc:1034] running on GCE node
I20260809 20:14:21.149106 5608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:14:21.149916 5608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:14:21.151106 5608 hybrid_clock.cc:648] HybridClock initialized: now 1786306461151070 us; error 26 us; skew 500 ppm
I20260809 20:14:21.151381 5608 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:14:21 dist-test-slave-6zbq krb5kdc[5440](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306461, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:21.154233 5608 init.cc:377] Logged in from keytab as kudu/127.14.181.1@KRBTEST.COM (short username kudu)
I20260809 20:14:21.155525 5608 webserver.cc:460] Webserver started at http://127.14.181.1:37639/ using document root <none> and password file <none>
I20260809 20:14:21.156162 5608 fs_manager.cc:359] Metadata directory not provided
I20260809 20:14:21.156270 5608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:14:21.156529 5608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:14:21.159211 5608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/data/instance:
uuid: "0d6f9c34eccf4ebea1ce5255be6958e7"
format_stamp: "Formatted at 2026-08-09 20:14:21 on dist-test-slave-6zbq"
server_key: "e01b109ec5841da3d5615003cab799cf"
server_key_iv: "304d541b445f0829ca4fac3d15579f9b"
server_key_version: "encryptionkey@0"
I20260809 20:14:21.159931 5608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance:
uuid: "0d6f9c34eccf4ebea1ce5255be6958e7"
format_stamp: "Formatted at 2026-08-09 20:14:21 on dist-test-slave-6zbq"
server_key: "e01b109ec5841da3d5615003cab799cf"
server_key_iv: "304d541b445f0829ca4fac3d15579f9b"
server_key_version: "encryptionkey@0"
I20260809 20:14:21.164535 5608 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260809 20:14:21.167703 5630 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:21.168877 5608 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 20:14:21.169010 5608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "0d6f9c34eccf4ebea1ce5255be6958e7"
format_stamp: "Formatted at 2026-08-09 20:14:21 on dist-test-slave-6zbq"
server_key: "e01b109ec5841da3d5615003cab799cf"
server_key_iv: "304d541b445f0829ca4fac3d15579f9b"
server_key_version: "encryptionkey@0"
I20260809 20:14:21.169171 5608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:14:21.191011 5608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:14:21.194525 5608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:14:21.194768 5608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:14:21.195652 5608 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:14:21.196902 5608 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:14:21.196973 5608 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:21.197081 5608 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:14:21.197130 5608 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:21.226029 5608 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:41995
I20260809 20:14:21.226090 5804 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:41995 every 8 connection(s)
I20260809 20:14:21.227200 5608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:14:21.237316 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 5608
I20260809 20:14:21.237542 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance
I20260809 20:14:21.238478 15060 external_mini_cluster.cc:1428] Setting key ca313ab4efae3789ff4b7a29e09db3e5
Aug 09 20:14:21 dist-test-slave-6zbq krb5kdc[5440](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306461, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:14:21.246279 5807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:21.229531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:53771 (local address 127.14.181.62:39017)
0809 20:14:21.229945 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:21.229950 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:21.230857 (+ 907us) server_negotiation.cc:407] Connection header received
0809 20:14:21.232630 (+ 1773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:21.232635 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:21.232715 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:21.232832 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:21.234242 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:21.235021 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:21.236489 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:21.236964 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:21.237107 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:21.240561 (+ 3454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:21.240567 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:21.240571 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:21.240622 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:21.243597 (+ 2975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:21.244244 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:21.244250 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:21.244253 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:21.244392 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:21.244735 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:21.244740 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:21.244742 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:21.245046 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:21.245186 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:21.245755 (+ 569us) server_negotiation.cc:299] Negotiation successful
0809 20:14:21.245961 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":207,"threads_started":1}
I20260809 20:14:21.246984 5808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:21.230033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.1:53771)
0809 20:14:21.230705 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:21.230749 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:21.232366 (+ 1617us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:21.233060 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:21.233068 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:21.233544 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:14:21.234060 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:21.234093 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:21.235175 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:21.235179 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:21.236348 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:21.236360 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:21.237168 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:21.237173 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:21.237379 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:21.237945 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:14:21.237966 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:14:21.240351 (+ 2385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:14:21.243728 (+ 3377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:21.243740 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:21.243751 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:21.244135 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:21.244478 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:21.244481 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:21.244483 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:21.244645 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:21.245143 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:14:21.245148 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:14:21.245416 (+ 268us) client_negotiation.cc:769] Sending connection context
0809 20:14:21.245621 (+ 205us) client_negotiation.cc:240] Negotiation successful
0809 20:14:21.245968 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":272,"threads_started":1}
I20260809 20:14:21.248337 5805 heartbeater.cc:347] Connected to a master server at 127.14.181.62:39017
I20260809 20:14:21.248643 5805 heartbeater.cc:464] Registering TS with master...
I20260809 20:14:21.249397 5805 heartbeater.cc:511] Master 127.14.181.62:39017 requested a full tablet report, sending...
I20260809 20:14:21.251382 5514 ts_manager.cc:194] Registered new tserver with Master: 0d6f9c34eccf4ebea1ce5255be6958e7 (127.14.181.1:41995)
I20260809 20:14:21.252748 5514 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.1@KRBTEST.COM'} at 127.14.181.1:53771
WARNING: no policy specified for kudu/127.14.181.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
I20260809 20:14:21.290014 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:0
--local_ip_for_outbound_sockets=127.14.181.2
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39017
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:14:21.597612 5816 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:14:21.597843 5816 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:14:21.597955 5816 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:14:21.604790 5816 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:14:21.604882 5816 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:14:21.605036 5816 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:14:21.614388 5816 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39017
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:14:21.615420 5816 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:14:21.616562 5816 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:14:21.628183 5826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:21.628212 5833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:21.628182 5829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:21.629123 5816 server_base.cc:1034] running on GCE node
I20260809 20:14:21.629689 5816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:14:21.630560 5816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:14:21.631765 5816 hybrid_clock.cc:648] HybridClock initialized: now 1786306461631720 us; error 56 us; skew 500 ppm
I20260809 20:14:21.632038 5816 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:14:21 dist-test-slave-6zbq krb5kdc[5440](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306461, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:21.635070 5816 init.cc:377] Logged in from keytab as kudu/127.14.181.2@KRBTEST.COM (short username kudu)
I20260809 20:14:21.636355 5816 webserver.cc:460] Webserver started at http://127.14.181.2:37413/ using document root <none> and password file <none>
I20260809 20:14:21.636938 5816 fs_manager.cc:359] Metadata directory not provided
I20260809 20:14:21.637051 5816 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:14:21.637313 5816 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:14:21.639923 5816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/data/instance:
uuid: "51a737fe8d8848b9aa4481b384e4ed6e"
format_stamp: "Formatted at 2026-08-09 20:14:21 on dist-test-slave-6zbq"
server_key: "ebfb159ebd8b1b47b43af2b640533172"
server_key_iv: "da78999324edb0427e6a2f674a043d94"
server_key_version: "encryptionkey@0"
I20260809 20:14:21.640635 5816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance:
uuid: "51a737fe8d8848b9aa4481b384e4ed6e"
format_stamp: "Formatted at 2026-08-09 20:14:21 on dist-test-slave-6zbq"
server_key: "ebfb159ebd8b1b47b43af2b640533172"
server_key_iv: "da78999324edb0427e6a2f674a043d94"
server_key_version: "encryptionkey@0"
I20260809 20:14:21.645285 5816 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.005s
I20260809 20:14:21.648380 5842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:21.649521 5816 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 20:14:21.649663 5816 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "51a737fe8d8848b9aa4481b384e4ed6e"
format_stamp: "Formatted at 2026-08-09 20:14:21 on dist-test-slave-6zbq"
server_key: "ebfb159ebd8b1b47b43af2b640533172"
server_key_iv: "da78999324edb0427e6a2f674a043d94"
server_key_version: "encryptionkey@0"
I20260809 20:14:21.649824 5816 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:14:21.668267 5816 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:14:21.671905 5816 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:14:21.672117 5816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:14:21.672899 5816 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:14:21.674042 5816 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:14:21.674113 5816 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:21.674207 5816 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:14:21.674250 5816 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:21.702811 5816 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:37017
I20260809 20:14:21.702888 6007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:37017 every 8 connection(s)
I20260809 20:14:21.703900 5816 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:14:21.708582 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 5816
I20260809 20:14:21.708770 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance
I20260809 20:14:21.709343 15060 external_mini_cluster.cc:1428] Setting key c1d13fb497a1316d9e10d89c6a791b58
Aug 09 20:14:21 dist-test-slave-6zbq krb5kdc[5440](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306461, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:14:21.723312 5807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:21.706058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:59655 (local address 127.14.181.62:39017)
0809 20:14:21.706271 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:21.706277 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:21.707373 (+ 1096us) server_negotiation.cc:407] Connection header received
0809 20:14:21.709387 (+ 2014us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:21.709392 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:21.709481 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:21.709569 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:21.711201 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:21.711945 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:21.714012 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:21.714470 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:21.714567 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:21.718078 (+ 3511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:21.718083 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:21.718086 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:21.718127 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:21.720479 (+ 2352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:21.721149 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:21.721153 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:21.721156 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:21.721283 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:21.721675 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:21.721679 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:21.721681 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:21.721941 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:21.722073 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:21.722759 (+ 686us) server_negotiation.cc:299] Negotiation successful
0809 20:14:21.722983 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 20:14:21.724092 6012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:21.706563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.2:59655)
0809 20:14:21.707221 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:21.707256 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:21.709111 (+ 1855us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:21.709836 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:21.709847 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:21.710467 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:14:21.711014 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:21.711039 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:21.712095 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:21.712100 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:21.713877 (+ 1777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:21.713891 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:21.714674 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:21.714680 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:21.714934 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:21.715546 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:14:21.715578 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:14:21.717877 (+ 2299us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:14:21.720616 (+ 2739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:21.720624 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:21.720638 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:21.721018 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:21.721386 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:21.721391 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:21.721395 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:21.721563 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:21.722062 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:14:21.722069 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:14:21.722416 (+ 347us) client_negotiation.cc:769] Sending connection context
0809 20:14:21.722653 (+ 237us) client_negotiation.cc:240] Negotiation successful
0809 20:14:21.723097 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":250,"threads_started":1}
I20260809 20:14:21.725432 6008 heartbeater.cc:347] Connected to a master server at 127.14.181.62:39017
I20260809 20:14:21.725677 6008 heartbeater.cc:464] Registering TS with master...
I20260809 20:14:21.726305 6008 heartbeater.cc:511] Master 127.14.181.62:39017 requested a full tablet report, sending...
I20260809 20:14:21.727645 5514 ts_manager.cc:194] Registered new tserver with Master: 51a737fe8d8848b9aa4481b384e4ed6e (127.14.181.2:37017)
I20260809 20:14:21.728391 5514 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.2@KRBTEST.COM'} at 127.14.181.2:59655
WARNING: no policy specified for kudu/127.14.181.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
I20260809 20:14:21.760689 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:0
--local_ip_for_outbound_sockets=127.14.181.3
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39017
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:14:22.066656 6015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:14:22.066883 6015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:14:22.067004 6015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:14:22.073899 6015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:14:22.073999 6015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:14:22.074141 6015 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:14:22.083374 6015 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:39017
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:14:22.084419 6015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:14:22.085814 6015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:14:22.098264 6028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:22.098316 6030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:22.098367 6024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:22.099042 6015 server_base.cc:1034] running on GCE node
I20260809 20:14:22.099601 6015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:14:22.100420 6015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:14:22.101614 6015 hybrid_clock.cc:648] HybridClock initialized: now 1786306462101567 us; error 43 us; skew 500 ppm
I20260809 20:14:22.101893 6015 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:14:22 dist-test-slave-6zbq krb5kdc[5440](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306462, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:22.109237 6015 init.cc:377] Logged in from keytab as kudu/127.14.181.3@KRBTEST.COM (short username kudu)
I20260809 20:14:22.110584 6015 webserver.cc:460] Webserver started at http://127.14.181.3:35507/ using document root <none> and password file <none>
I20260809 20:14:22.111145 6015 fs_manager.cc:359] Metadata directory not provided
I20260809 20:14:22.111241 6015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:14:22.111479 6015 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:14:22.114069 6015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/data/instance:
uuid: "8e2c799d0c2c480c905b712b42a36347"
format_stamp: "Formatted at 2026-08-09 20:14:22 on dist-test-slave-6zbq"
server_key: "b92f679409aa4d0b5c5a5694df3a1bed"
server_key_iv: "bfd4e0194a2daa5445be4d34cf477006"
server_key_version: "encryptionkey@0"
I20260809 20:14:22.114794 6015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance:
uuid: "8e2c799d0c2c480c905b712b42a36347"
format_stamp: "Formatted at 2026-08-09 20:14:22 on dist-test-slave-6zbq"
server_key: "b92f679409aa4d0b5c5a5694df3a1bed"
server_key_iv: "bfd4e0194a2daa5445be4d34cf477006"
server_key_version: "encryptionkey@0"
I20260809 20:14:22.119403 6015 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 20:14:22.122470 6038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:22.123670 6015 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 20:14:22.123811 6015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "8e2c799d0c2c480c905b712b42a36347"
format_stamp: "Formatted at 2026-08-09 20:14:22 on dist-test-slave-6zbq"
server_key: "b92f679409aa4d0b5c5a5694df3a1bed"
server_key_iv: "bfd4e0194a2daa5445be4d34cf477006"
server_key_version: "encryptionkey@0"
I20260809 20:14:22.123974 6015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:14:22.144222 6015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:14:22.147632 6015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:14:22.147894 6015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:14:22.148708 6015 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:14:22.149912 6015 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:14:22.149991 6015 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:22.150107 6015 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:14:22.150161 6015 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:22.179486 6015 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:35267
I20260809 20:14:22.179549 6214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:35267 every 8 connection(s)
I20260809 20:14:22.180657 6015 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:14:22.190097 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 6015
I20260809 20:14:22.190299 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance
I20260809 20:14:22.190739 15060 external_mini_cluster.cc:1428] Setting key 93054dbe2380672176707cbef51031c7
Aug 09 20:14:22 dist-test-slave-6zbq krb5kdc[5440](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306462, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:14:22.198697 5807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:22.182947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:35189 (local address 127.14.181.62:39017)
0809 20:14:22.183123 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:22.183127 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:22.184132 (+ 1005us) server_negotiation.cc:407] Connection header received
0809 20:14:22.185841 (+ 1709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:22.185846 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:22.185943 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:22.186028 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:22.187381 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.188106 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.189513 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.189976 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.190101 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:22.193749 (+ 3648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:22.193756 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:22.193760 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:22.193800 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:22.196328 (+ 2528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:22.196939 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:22.196942 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:22.196945 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:22.197062 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:22.197383 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:22.197386 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:22.197387 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:22.197625 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:22.197727 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:22.198248 (+ 521us) server_negotiation.cc:299] Negotiation successful
0809 20:14:22.198454 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 20:14:22.199467 6219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:22.183304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.3:35189)
0809 20:14:22.183975 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:22.184017 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:22.185609 (+ 1592us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:22.186224 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:22.186231 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:22.186728 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:14:22.187247 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:22.187269 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.188222 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.188226 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:22.189405 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:22.189417 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.190162 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.190168 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:22.190426 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:22.190975 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:14:22.190997 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:14:22.193534 (+ 2537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:14:22.196440 (+ 2906us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:22.196446 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:22.196456 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:22.196852 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:22.197134 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:22.197137 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:22.197139 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:22.197306 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:22.197709 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:14:22.197714 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:14:22.197970 (+ 256us) client_negotiation.cc:769] Sending connection context
0809 20:14:22.198175 (+ 205us) client_negotiation.cc:240] Negotiation successful
0809 20:14:22.198544 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":270,"threads_started":1}
I20260809 20:14:22.200614 6216 heartbeater.cc:347] Connected to a master server at 127.14.181.62:39017
I20260809 20:14:22.200860 6216 heartbeater.cc:464] Registering TS with master...
I20260809 20:14:22.201483 6216 heartbeater.cc:511] Master 127.14.181.62:39017 requested a full tablet report, sending...
I20260809 20:14:22.202754 5514 ts_manager.cc:194] Registered new tserver with Master: 8e2c799d0c2c480c905b712b42a36347 (127.14.181.3:35267)
I20260809 20:14:22.203509 5514 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.3@KRBTEST.COM'} at 127.14.181.3:35189
I20260809 20:14:22.205832 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 20:14:22.220672 5807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:22.209957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37314 (local address 127.14.181.62:39017)
0809 20:14:22.210091 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:22.210095 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:22.210557 (+ 462us) server_negotiation.cc:407] Connection header received
0809 20:14:22.210675 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:22.210679 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:22.210731 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:22.210807 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:22.212029 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.212710 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.213910 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.214295 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.214438 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:22.216465 (+ 2027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:22.216470 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:22.216472 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:22.216496 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:22.218662 (+ 2166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:22.219221 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:22.219224 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:22.219226 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:22.219349 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:22.219607 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:22.219610 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:22.219612 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:22.219887 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:22.220062 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:22.220320 (+ 258us) server_negotiation.cc:299] Negotiation successful
0809 20:14:22.220468 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 20:14:22.224056 5514 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37314:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 20:14:22.232754 5514 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 20:14:22.255765 5805 heartbeater.cc:503] Master 127.14.181.62:39017 was elected leader, sending a full tablet report...
I20260809 20:14:22.271642 6238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:22.243733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:37017 (local address 127.0.0.1:53202)
0809 20:14:22.263168 (+ 19435us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:22.263187 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:22.263311 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:22.264214 (+ 903us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:22.264221 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:22.264261 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:14:22.264744 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:22.264756 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.266590 (+ 1834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.266595 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:22.269253 (+ 2658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:22.269269 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.270627 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.270633 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:22.270816 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:22.270869 (+ 53us) client_negotiation.cc:769] Sending connection context
0809 20:14:22.270998 (+ 129us) client_negotiation.cc:240] Negotiation successful
0809 20:14:22.271181 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19305,"mutex_wait_us":91,"thread_start_us":13047,"threads_started":1}
I20260809 20:14:22.271828 6247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:22.244002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36036 (local address 127.14.181.3:35267)
0809 20:14:22.260535 (+ 16533us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:22.260543 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:22.263083 (+ 2540us) server_negotiation.cc:407] Connection header received
0809 20:14:22.263183 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:22.263191 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:22.263426 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:22.264128 (+ 702us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:14:22.265084 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.266669 (+ 1585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.269340 (+ 2671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.270762 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.270888 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:22.271109 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:22.271307 (+ 198us) server_negotiation.cc:299] Negotiation successful
0809 20:14:22.271468 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16377,"thread_start_us":16205,"threads_started":1}
I20260809 20:14:22.272409 6246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:22.243969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53202 (local address 127.14.181.2:37017)
0809 20:14:22.259334 (+ 15365us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:22.259343 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:22.263428 (+ 4085us) server_negotiation.cc:407] Connection header received
0809 20:14:22.263523 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:22.263531 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:22.263744 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:22.263939 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:14:22.264975 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.266424 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.269488 (+ 3064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.270438 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.270556 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:22.270752 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:22.271980 (+ 1228us) server_negotiation.cc:299] Negotiation successful
0809 20:14:22.272146 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15189,"thread_start_us":15356,"threads_started":1}
I20260809 20:14:22.272667 6241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:22.243217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42714 (local address 127.14.181.1:41995)
0809 20:14:22.263554 (+ 20337us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:22.263561 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:22.263586 (+ 25us) server_negotiation.cc:407] Connection header received
0809 20:14:22.263667 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:22.263673 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:22.263883 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:22.264756 (+ 873us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:14:22.265420 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.266902 (+ 1482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.269505 (+ 2603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.270946 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.271072 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:22.271267 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:22.272276 (+ 1009us) server_negotiation.cc:299] Negotiation successful
0809 20:14:22.272412 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20172,"thread_start_us":20027,"threads_started":1}
I20260809 20:14:22.271781 6242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:22.243355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:35267 (local address 127.0.0.1:36036)
0809 20:14:22.262802 (+ 19447us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:22.262821 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:22.262953 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:22.264391 (+ 1438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:22.264395 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:22.264422 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:14:22.264895 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:22.264913 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.266823 (+ 1910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.266828 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:22.269141 (+ 2313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:22.269159 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.270962 (+ 1803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.270968 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:22.271133 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:22.271164 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 20:14:22.271251 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 20:14:22.271371 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19314,"mutex_wait_us":108,"thread_start_us":19168,"threads_started":1}
I20260809 20:14:22.272181 6245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:22.243094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:41995 (local address 127.0.0.1:42714)
0809 20:14:22.257114 (+ 14020us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:22.257152 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:22.257320 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:22.264758 (+ 7438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:22.264762 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:22.264794 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:14:22.265218 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:22.265229 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.267041 (+ 1812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.267047 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:22.269360 (+ 2313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:22.269373 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.271423 (+ 2050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.271430 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:22.271610 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:22.271650 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 20:14:22.271745 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 20:14:22.271865 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13817,"mutex_wait_us":57,"thread_start_us":19785,"threads_started":1}
I20260809 20:14:22.276033 5907 tablet_service.cc:1467] Processing CreateTablet for tablet 1baf867d8a6a4861a1011877eb805eb2 (DEFAULT_TABLE table=test-table [id=5805baa13e2648c5bae8c37e54bd97a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:14:22.276368 5705 tablet_service.cc:1467] Processing CreateTablet for tablet 1baf867d8a6a4861a1011877eb805eb2 (DEFAULT_TABLE table=test-table [id=5805baa13e2648c5bae8c37e54bd97a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:14:22.276365 6114 tablet_service.cc:1467] Processing CreateTablet for tablet 1baf867d8a6a4861a1011877eb805eb2 (DEFAULT_TABLE table=test-table [id=5805baa13e2648c5bae8c37e54bd97a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:14:22.277204 5907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1baf867d8a6a4861a1011877eb805eb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:14:22.277647 5705 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1baf867d8a6a4861a1011877eb805eb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:14:22.277662 6114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1baf867d8a6a4861a1011877eb805eb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:14:22.288045 6249 tablet_bootstrap.cc:492] T 1baf867d8a6a4861a1011877eb805eb2 P 51a737fe8d8848b9aa4481b384e4ed6e: Bootstrap starting.
I20260809 20:14:22.291070 6249 tablet_bootstrap.cc:654] T 1baf867d8a6a4861a1011877eb805eb2 P 51a737fe8d8848b9aa4481b384e4ed6e: Neither blocks nor log segments found. Creating new log.
I20260809 20:14:22.291455 6251 tablet_bootstrap.cc:492] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7: Bootstrap starting.
I20260809 20:14:22.292717 6253 tablet_bootstrap.cc:492] T 1baf867d8a6a4861a1011877eb805eb2 P 8e2c799d0c2c480c905b712b42a36347: Bootstrap starting.
I20260809 20:14:22.293627 6249 log.cc:824] T 1baf867d8a6a4861a1011877eb805eb2 P 51a737fe8d8848b9aa4481b384e4ed6e: Log is configured to *not* fsync() on all Append() calls
I20260809 20:14:22.295114 6251 tablet_bootstrap.cc:654] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7: Neither blocks nor log segments found. Creating new log.
I20260809 20:14:22.295848 6253 tablet_bootstrap.cc:654] T 1baf867d8a6a4861a1011877eb805eb2 P 8e2c799d0c2c480c905b712b42a36347: Neither blocks nor log segments found. Creating new log.
I20260809 20:14:22.296357 6251 log.cc:824] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7: Log is configured to *not* fsync() on all Append() calls
I20260809 20:14:22.296799 6253 log.cc:824] T 1baf867d8a6a4861a1011877eb805eb2 P 8e2c799d0c2c480c905b712b42a36347: Log is configured to *not* fsync() on all Append() calls
I20260809 20:14:22.302712 6253 tablet_bootstrap.cc:492] T 1baf867d8a6a4861a1011877eb805eb2 P 8e2c799d0c2c480c905b712b42a36347: No bootstrap required, opened a new log
I20260809 20:14:22.302798 6249 tablet_bootstrap.cc:492] T 1baf867d8a6a4861a1011877eb805eb2 P 51a737fe8d8848b9aa4481b384e4ed6e: No bootstrap required, opened a new log
I20260809 20:14:22.302839 6251 tablet_bootstrap.cc:492] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7: No bootstrap required, opened a new log
I20260809 20:14:22.302961 6253 ts_tablet_manager.cc:1397] T 1baf867d8a6a4861a1011877eb805eb2 P 8e2c799d0c2c480c905b712b42a36347: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20260809 20:14:22.303058 6249 ts_tablet_manager.cc:1397] T 1baf867d8a6a4861a1011877eb805eb2 P 51a737fe8d8848b9aa4481b384e4ed6e: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.007s
I20260809 20:14:22.303058 6251 ts_tablet_manager.cc:1397] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260809 20:14:22.310161 6253 raft_consensus.cc:348] T 1baf867d8a6a4861a1011877eb805eb2 P 8e2c799d0c2c480c905b712b42a36347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41995 } } peers { permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 } } peers { permanent_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37017 } }
I20260809 20:14:22.310528 6253 raft_consensus.cc:374] T 1baf867d8a6a4861a1011877eb805eb2 P 8e2c799d0c2c480c905b712b42a36347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:14:22.310624 6253 raft_consensus.cc:729] T 1baf867d8a6a4861a1011877eb805eb2 P 8e2c799d0c2c480c905b712b42a36347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e2c799d0c2c480c905b712b42a36347, State: Initialized, Role: FOLLOWER
I20260809 20:14:22.311184 6253 consensus_queue.cc:260] T 1baf867d8a6a4861a1011877eb805eb2 P 8e2c799d0c2c480c905b712b42a36347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41995 } } peers { permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 } } peers { permanent_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37017 } }
I20260809 20:14:22.312178 6216 heartbeater.cc:503] Master 127.14.181.62:39017 was elected leader, sending a full tablet report...
I20260809 20:14:22.312853 6253 ts_tablet_manager.cc:1428] T 1baf867d8a6a4861a1011877eb805eb2 P 8e2c799d0c2c480c905b712b42a36347: Time spent starting tablet: real 0.010s user 0.009s sys 0.000s
I20260809 20:14:22.313263 6251 raft_consensus.cc:348] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41995 } } peers { permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 } } peers { permanent_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37017 } }
I20260809 20:14:22.313263 6249 raft_consensus.cc:348] T 1baf867d8a6a4861a1011877eb805eb2 P 51a737fe8d8848b9aa4481b384e4ed6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41995 } } peers { permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 } } peers { permanent_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37017 } }
I20260809 20:14:22.313669 6249 raft_consensus.cc:374] T 1baf867d8a6a4861a1011877eb805eb2 P 51a737fe8d8848b9aa4481b384e4ed6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:14:22.313669 6251 raft_consensus.cc:374] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:14:22.313769 6249 raft_consensus.cc:729] T 1baf867d8a6a4861a1011877eb805eb2 P 51a737fe8d8848b9aa4481b384e4ed6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51a737fe8d8848b9aa4481b384e4ed6e, State: Initialized, Role: FOLLOWER
I20260809 20:14:22.313769 6251 raft_consensus.cc:729] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d6f9c34eccf4ebea1ce5255be6958e7, State: Initialized, Role: FOLLOWER
I20260809 20:14:22.314332 6251 consensus_queue.cc:260] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41995 } } peers { permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 } } peers { permanent_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37017 } }
I20260809 20:14:22.314328 6249 consensus_queue.cc:260] T 1baf867d8a6a4861a1011877eb805eb2 P 51a737fe8d8848b9aa4481b384e4ed6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41995 } } peers { permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 } } peers { permanent_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37017 } }
I20260809 20:14:22.315929 6008 heartbeater.cc:503] Master 127.14.181.62:39017 was elected leader, sending a full tablet report...
I20260809 20:14:22.315994 6251 ts_tablet_manager.cc:1428] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260809 20:14:22.316457 6249 ts_tablet_manager.cc:1428] T 1baf867d8a6a4861a1011877eb805eb2 P 51a737fe8d8848b9aa4481b384e4ed6e: Time spent starting tablet: real 0.013s user 0.012s sys 0.001s
I20260809 20:14:22.325610 6261 raft_consensus.cc:482] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:14:22.325821 6261 raft_consensus.cc:504] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41995 } } peers { permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 } } peers { permanent_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37017 } }
I20260809 20:14:22.327311 6261 leader_election.cc:288] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e2c799d0c2c480c905b712b42a36347 (127.14.181.3:35267), 51a737fe8d8848b9aa4481b384e4ed6e (127.14.181.2:37017)
I20260809 20:14:22.333621 6247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:22.327690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:35723 (local address 127.14.181.3:35267)
0809 20:14:22.327914 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:22.327920 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:22.328221 (+ 301us) server_negotiation.cc:407] Connection header received
0809 20:14:22.328421 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:22.328426 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:22.328478 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:22.328545 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:14:22.329191 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.330167 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.331952 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.332704 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.332842 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:22.332915 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:22.333270 (+ 355us) server_negotiation.cc:299] Negotiation successful
0809 20:14:22.333391 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260809 20:14:22.333638 6246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:22.327673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:53873 (local address 127.14.181.2:37017)
0809 20:14:22.327863 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:22.327870 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:22.328504 (+ 634us) server_negotiation.cc:407] Connection header received
0809 20:14:22.328669 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:22.328672 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:22.328722 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:22.328796 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:14:22.329409 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.330238 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.331991 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.332722 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.332876 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:22.332947 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:22.333293 (+ 346us) server_negotiation.cc:299] Negotiation successful
0809 20:14:22.333413 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 20:14:22.333953 6263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:22.327679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:37017 (local address 127.14.181.1:53873)
0809 20:14:22.328411 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:22.328425 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:22.328542 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:22.328822 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:22.328831 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:22.328856 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:14:22.329234 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:22.329245 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.330438 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.330441 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:22.331845 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:22.331858 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.332964 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.332971 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:22.333150 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:22.333172 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 20:14:22.333249 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 20:14:22.333374 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"mutex_wait_us":15,"thread_start_us":433,"threads_started":1}
I20260809 20:14:22.334487 6262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:22.327410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:35267 (local address 127.14.181.1:35723)
0809 20:14:22.328094 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:22.328117 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:22.328290 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:22.328576 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:22.328580 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:22.328605 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:14:22.328990 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:22.329007 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.330279 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.330285 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:22.331812 (+ 1527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:22.331825 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.332922 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.332929 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:22.333088 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:22.333150 (+ 62us) client_negotiation.cc:769] Sending connection context
0809 20:14:22.333998 (+ 848us) client_negotiation.cc:240] Negotiation successful
0809 20:14:22.334122 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"mutex_wait_us":19,"thread_start_us":519,"threads_started":1}
I20260809 20:14:22.335098 5939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1baf867d8a6a4861a1011877eb805eb2" candidate_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" is_pre_election: true
I20260809 20:14:22.335259 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1baf867d8a6a4861a1011877eb805eb2" candidate_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e2c799d0c2c480c905b712b42a36347" is_pre_election: true
I20260809 20:14:22.335489 5939 raft_consensus.cc:2454] T 1baf867d8a6a4861a1011877eb805eb2 P 51a737fe8d8848b9aa4481b384e4ed6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d6f9c34eccf4ebea1ce5255be6958e7 in term 0.
I20260809 20:14:22.335703 6146 raft_consensus.cc:2454] T 1baf867d8a6a4861a1011877eb805eb2 P 8e2c799d0c2c480c905b712b42a36347 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d6f9c34eccf4ebea1ce5255be6958e7 in term 0.
I20260809 20:14:22.336135 5631 leader_election.cc:302] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d6f9c34eccf4ebea1ce5255be6958e7, 51a737fe8d8848b9aa4481b384e4ed6e; no voters:
I20260809 20:14:22.336468 6261 raft_consensus.cc:2781] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:14:22.336604 6261 raft_consensus.cc:482] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:14:22.336694 6261 raft_consensus.cc:3037] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:14:22.338754 6261 raft_consensus.cc:504] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41995 } } peers { permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 } } peers { permanent_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37017 } }
I20260809 20:14:22.339232 6261 leader_election.cc:288] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7 [CANDIDATE]: Term 1 election: Requested vote from peers 8e2c799d0c2c480c905b712b42a36347 (127.14.181.3:35267), 51a737fe8d8848b9aa4481b384e4ed6e (127.14.181.2:37017)
I20260809 20:14:22.339608 6146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1baf867d8a6a4861a1011877eb805eb2" candidate_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e2c799d0c2c480c905b712b42a36347"
I20260809 20:14:22.339653 5939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1baf867d8a6a4861a1011877eb805eb2" candidate_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51a737fe8d8848b9aa4481b384e4ed6e"
I20260809 20:14:22.339769 6146 raft_consensus.cc:3037] T 1baf867d8a6a4861a1011877eb805eb2 P 8e2c799d0c2c480c905b712b42a36347 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:14:22.339802 5939 raft_consensus.cc:3037] T 1baf867d8a6a4861a1011877eb805eb2 P 51a737fe8d8848b9aa4481b384e4ed6e [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:14:22.341801 6146 raft_consensus.cc:2454] T 1baf867d8a6a4861a1011877eb805eb2 P 8e2c799d0c2c480c905b712b42a36347 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d6f9c34eccf4ebea1ce5255be6958e7 in term 1.
I20260809 20:14:22.341933 5939 raft_consensus.cc:2454] T 1baf867d8a6a4861a1011877eb805eb2 P 51a737fe8d8848b9aa4481b384e4ed6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d6f9c34eccf4ebea1ce5255be6958e7 in term 1.
I20260809 20:14:22.342188 5633 leader_election.cc:302] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d6f9c34eccf4ebea1ce5255be6958e7, 8e2c799d0c2c480c905b712b42a36347; no voters:
I20260809 20:14:22.342489 6261 raft_consensus.cc:2781] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:14:22.342862 6261 raft_consensus.cc:686] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 1 LEADER]: Becoming Leader. State: Replica: 0d6f9c34eccf4ebea1ce5255be6958e7, State: Running, Role: LEADER
I20260809 20:14:22.343240 6261 consensus_queue.cc:237] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41995 } } peers { permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 } } peers { permanent_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37017 } }
I20260809 20:14:22.347244 5512 catalog_manager.cc:5495] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d6f9c34eccf4ebea1ce5255be6958e7 (127.14.181.1). New cstate: current_term: 1 leader_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37017 } health_report { overall_health: UNKNOWN } } }
I20260809 20:14:22.363616 6241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:22.359077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42730 (local address 127.14.181.1:41995)
0809 20:14:22.359270 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:22.359276 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:22.359307 (+ 31us) server_negotiation.cc:407] Connection header received
0809 20:14:22.359462 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:22.359465 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:22.359542 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:22.359646 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:14:22.359947 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.360579 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.361953 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.362329 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.362445 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:22.362834 (+ 389us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:14:22.363218 (+ 384us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:14:22.363312 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:22.363365 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 20:14:22.363419 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 20:14:22.370124 5939 raft_consensus.cc:1261] T 1baf867d8a6a4861a1011877eb805eb2 P 51a737fe8d8848b9aa4481b384e4ed6e [term 1 FOLLOWER]: Refusing update from remote peer 0d6f9c34eccf4ebea1ce5255be6958e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:14:22.370157 6146 raft_consensus.cc:1261] T 1baf867d8a6a4861a1011877eb805eb2 P 8e2c799d0c2c480c905b712b42a36347 [term 1 FOLLOWER]: Refusing update from remote peer 0d6f9c34eccf4ebea1ce5255be6958e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:14:22.371058 6261 consensus_queue.cc:1035] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:14:22.371313 6266 consensus_queue.cc:1035] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:14:22.381996 6271 mvcc.cc:205] Tried to move back new op lower bound from 7316711269860626432 to 7316711269760950272. Current Snapshot: MvccSnapshot[applied={T|T < 7316711269860626432}]
I20260809 20:14:22.385825 6272 mvcc.cc:205] Tried to move back new op lower bound from 7316711269860626432 to 7316711269760950272. Current Snapshot: MvccSnapshot[applied={T|T < 7316711269860626432}]
I20260809 20:14:22.395085 5512 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37314:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:14:22.395359 5512 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37314:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:14:22.398710 5512 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa: Sending DeleteTablet for 3 replicas of tablet 1baf867d8a6a4861a1011877eb805eb2
I20260809 20:14:22.399683 5705 tablet_service.cc:1514] Processing DeleteTablet for tablet 1baf867d8a6a4861a1011877eb805eb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:14:22 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:42714
I20260809 20:14:22.399725 6114 tablet_service.cc:1514] Processing DeleteTablet for tablet 1baf867d8a6a4861a1011877eb805eb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:14:22 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:36036
I20260809 20:14:22.400058 5907 tablet_service.cc:1514] Processing DeleteTablet for tablet 1baf867d8a6a4861a1011877eb805eb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:14:22 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:53202
I20260809 20:14:22.400920 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 5608
I20260809 20:14:22.415040 6282 tablet_replica.cc:330] T 1baf867d8a6a4861a1011877eb805eb2 P 8e2c799d0c2c480c905b712b42a36347: stopping tablet replica
I20260809 20:14:22.415522 6282 raft_consensus.cc:2229] T 1baf867d8a6a4861a1011877eb805eb2 P 8e2c799d0c2c480c905b712b42a36347 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:14:22.416046 6282 raft_consensus.cc:2258] T 1baf867d8a6a4861a1011877eb805eb2 P 8e2c799d0c2c480c905b712b42a36347 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:14:22.417855 6282 ts_tablet_manager.cc:1905] T 1baf867d8a6a4861a1011877eb805eb2 P 8e2c799d0c2c480c905b712b42a36347: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:14:22.425369 6282 ts_tablet_manager.cc:1918] T 1baf867d8a6a4861a1011877eb805eb2 P 8e2c799d0c2c480c905b712b42a36347: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:14:22.425519 6282 log.cc:1196] T 1baf867d8a6a4861a1011877eb805eb2 P 8e2c799d0c2c480c905b712b42a36347: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/wal/wals/1baf867d8a6a4861a1011877eb805eb2
I20260809 20:14:22.426024 6282 ts_tablet_manager.cc:1939] T 1baf867d8a6a4861a1011877eb805eb2 P 8e2c799d0c2c480c905b712b42a36347: Deleting consensus metadata
I20260809 20:14:22.426323 6283 tablet_replica.cc:330] T 1baf867d8a6a4861a1011877eb805eb2 P 51a737fe8d8848b9aa4481b384e4ed6e: stopping tablet replica
I20260809 20:14:22.426720 6283 raft_consensus.cc:2229] T 1baf867d8a6a4861a1011877eb805eb2 P 51a737fe8d8848b9aa4481b384e4ed6e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:14:22.427163 6283 raft_consensus.cc:2258] T 1baf867d8a6a4861a1011877eb805eb2 P 51a737fe8d8848b9aa4481b384e4ed6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:14:22.427201 6281 tablet_replica.cc:330] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7: stopping tablet replica
I20260809 20:14:22.427729 6281 raft_consensus.cc:2229] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 1 LEADER]: Raft consensus shutting down.
I20260809 20:14:22.427767 5490 catalog_manager.cc:4841] TS 8e2c799d0c2c480c905b712b42a36347 (127.14.181.3:35267): tablet 1baf867d8a6a4861a1011877eb805eb2 (table test-table [id=5805baa13e2648c5bae8c37e54bd97a2]) successfully deleted
I20260809 20:14:22.428442 6281 raft_consensus.cc:2258] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:14:22.429934 6281 ts_tablet_manager.cc:1905] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:14:22.431861 6283 ts_tablet_manager.cc:1905] T 1baf867d8a6a4861a1011877eb805eb2 P 51a737fe8d8848b9aa4481b384e4ed6e: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 20:14:22 dist-test-slave-6zbq krb5kdc[5440](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.1@KRBTEST.COM
I20260809 20:14:22.437132 6281 ts_tablet_manager.cc:1918] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:14:22.437358 6281 log.cc:1196] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/wal/wals/1baf867d8a6a4861a1011877eb805eb2
I20260809 20:14:22.437901 6281 ts_tablet_manager.cc:1939] T 1baf867d8a6a4861a1011877eb805eb2 P 0d6f9c34eccf4ebea1ce5255be6958e7: Deleting consensus metadata
I20260809 20:14:22.438593 6283 ts_tablet_manager.cc:1918] T 1baf867d8a6a4861a1011877eb805eb2 P 51a737fe8d8848b9aa4481b384e4ed6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:14:22.438789 6283 log.cc:1196] T 1baf867d8a6a4861a1011877eb805eb2 P 51a737fe8d8848b9aa4481b384e4ed6e: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/wal/wals/1baf867d8a6a4861a1011877eb805eb2
I20260809 20:14:22.439343 6283 ts_tablet_manager.cc:1939] T 1baf867d8a6a4861a1011877eb805eb2 P 51a737fe8d8848b9aa4481b384e4ed6e: Deleting consensus metadata
I20260809 20:14:22.439617 5491 catalog_manager.cc:4841] TS 0d6f9c34eccf4ebea1ce5255be6958e7 (127.14.181.1:41995): tablet 1baf867d8a6a4861a1011877eb805eb2 (table test-table [id=5805baa13e2648c5bae8c37e54bd97a2]) successfully deleted
I20260809 20:14:22.440734 5489 catalog_manager.cc:4841] TS 51a737fe8d8848b9aa4481b384e4ed6e (127.14.181.2:37017): tablet 1baf867d8a6a4861a1011877eb805eb2 (table test-table [id=5805baa13e2648c5bae8c37e54bd97a2]) successfully deleted
I20260809 20:14:22.444237 6241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:22.401973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42734 (local address 127.14.181.1:41995)
0809 20:14:22.402125 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:22.402130 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:22.423421 (+ 21291us) server_negotiation.cc:407] Connection header received
0809 20:14:22.423853 (+ 432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:22.423859 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:22.423936 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:22.424008 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:22.427548 (+ 3540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.428777 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.430759 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.431483 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.431581 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:22.437140 (+ 5559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:22.437156 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:22.437171 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:22.437224 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:22.441430 (+ 4206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:22.442134 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:22.442142 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:22.442146 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:22.442383 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:22.442747 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:22.442752 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:22.442755 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:22.443190 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:22.443478 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:22.443649 (+ 171us) server_negotiation.cc:299] Negotiation successful
0809 20:14:22.443887 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 20:14:22.444832 5794 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:14:22.539160 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 5608
I20260809 20:14:22.562561 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 5816
Aug 09 20:14:22 dist-test-slave-6zbq krb5kdc[5440](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.2@KRBTEST.COM
I20260809 20:14:22.576452 6246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:22.563240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53206 (local address 127.14.181.2:37017)
0809 20:14:22.563427 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:22.563432 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:22.563450 (+ 18us) server_negotiation.cc:407] Connection header received
0809 20:14:22.563596 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:22.563600 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:22.563662 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:22.563740 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:22.564894 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.565603 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.566997 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.567373 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.567460 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:22.571512 (+ 4052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:22.571524 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:22.571538 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:22.571575 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:22.574029 (+ 2454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:22.574744 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:22.574751 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:22.574753 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:22.574869 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:22.575158 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:22.575161 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:22.575163 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:22.575515 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:22.575717 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:22.575953 (+ 236us) server_negotiation.cc:299] Negotiation successful
0809 20:14:22.576103 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 20:14:22.577069 6000 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:14:22.667555 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 5816
I20260809 20:14:22.688287 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 6015
Aug 09 20:14:22 dist-test-slave-6zbq krb5kdc[5440](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.3@KRBTEST.COM
I20260809 20:14:22.702582 6247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:22.689096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36040 (local address 127.14.181.3:35267)
0809 20:14:22.689316 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:22.689322 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:22.689341 (+ 19us) server_negotiation.cc:407] Connection header received
0809 20:14:22.689398 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:22.689402 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:22.689469 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:22.689559 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:22.690865 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.691610 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.692856 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:22.693235 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:22.693326 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:22.697593 (+ 4267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:22.697608 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:22.697625 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:22.697663 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:22.700185 (+ 2522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:22.700807 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:22.700813 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:22.700816 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:22.700946 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:22.701256 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:22.701259 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:22.701261 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:22.701610 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:22.701815 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:22.702055 (+ 240us) server_negotiation.cc:299] Negotiation successful
0809 20:14:22.702215 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 20:14:22.703200 6208 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:14:22.789129 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 6015
I20260809 20:14:22.812623 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 5458
I20260809 20:14:22.813724 5557 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:14:22.922019 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 5458
I20260809 20:14:22.946883 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:39017
--webserver_interface=127.14.181.62
--webserver_port=41363
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:39017
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:14:23.260295 6290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:14:23.260557 6290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:14:23.260694 6290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:14:23.267624 6290 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:14:23.267725 6290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:14:23.267800 6290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:14:23.267879 6290 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:14:23.267940 6290 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:14:23.277201 6290 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:39017
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:39017
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=41363
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:14:23.278373 6290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:14:23.279543 6290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:14:23.301826 6304 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:23.301885 6299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:23.301864 6300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:23.302672 6290 server_base.cc:1034] running on GCE node
I20260809 20:14:23.303460 6290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:14:23.304919 6290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:14:23.306126 6290 hybrid_clock.cc:648] HybridClock initialized: now 1786306463306061 us; error 51 us; skew 500 ppm
I20260809 20:14:23.306552 6290 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:14:23 dist-test-slave-6zbq krb5kdc[5440](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306463, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:23.309887 6290 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:14:23.311437 6290 webserver.cc:460] Webserver started at http://127.14.181.62:41363/ using document root <none> and password file <none>
I20260809 20:14:23.312126 6290 fs_manager.cc:359] Metadata directory not provided
I20260809 20:14:23.312259 6290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:14:23.318091 6290 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 20:14:23.320847 6312 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:23.322098 6290 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 20:14:23.322263 6290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "f0d4629efcfb411888390125cdec16fa"
format_stamp: "Formatted at 2026-08-09 20:14:20 on dist-test-slave-6zbq"
server_key: "cfa351bda5dc272808ef45d7529cd984"
server_key_iv: "5c194ca549cda59941de04c0d755d719"
server_key_version: "encryptionkey@0"
I20260809 20:14:23.323308 6290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:14:23.342285 6290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:14:23.345830 6290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:14:23.346060 6290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:14:23.363090 6290 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:39017
I20260809 20:14:23.363107 6408 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:39017 every 8 connection(s)
I20260809 20:14:23.364411 6290 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:14:23.368026 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 6290
I20260809 20:14:23.368961 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:41995
--local_ip_for_outbound_sockets=127.14.181.1
--tserver_master_addrs=127.14.181.62:39017
--webserver_port=37639
--webserver_interface=127.14.181.1
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 20:14:23.372220 6409 sys_catalog.cc:263] Verifying existing consensus state
I20260809 20:14:23.376433 6409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa: Bootstrap starting.
I20260809 20:14:23.396229 6409 log.cc:824] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa: Log is configured to *not* fsync() on all Append() calls
I20260809 20:14:23.408026 6409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 20:14:23.408497 6409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa: Bootstrap complete.
I20260809 20:14:23.417194 6409 raft_consensus.cc:348] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d4629efcfb411888390125cdec16fa" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39017 } }
I20260809 20:14:23.417975 6409 raft_consensus.cc:729] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0d4629efcfb411888390125cdec16fa, State: Initialized, Role: FOLLOWER
I20260809 20:14:23.418561 6409 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d4629efcfb411888390125cdec16fa" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39017 } }
I20260809 20:14:23.418780 6409 raft_consensus.cc:388] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:14:23.418893 6409 raft_consensus.cc:482] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:14:23.419039 6409 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [term 1 FOLLOWER]: Advancing to term 2
I20260809 20:14:23.422670 6409 raft_consensus.cc:504] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d4629efcfb411888390125cdec16fa" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39017 } }
I20260809 20:14:23.423136 6409 leader_election.cc:302] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f0d4629efcfb411888390125cdec16fa; no voters:
I20260809 20:14:23.423697 6409 leader_election.cc:288] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 20:14:23.423848 6418 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [term 2 FOLLOWER]: Leader election won for term 2
I20260809 20:14:23.424697 6418 raft_consensus.cc:686] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [term 2 LEADER]: Becoming Leader. State: Replica: f0d4629efcfb411888390125cdec16fa, State: Running, Role: LEADER
I20260809 20:14:23.425221 6418 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d4629efcfb411888390125cdec16fa" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39017 } }
I20260809 20:14:23.425815 6409 sys_catalog.cc:564] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:14:23.427609 6419 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f0d4629efcfb411888390125cdec16fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d4629efcfb411888390125cdec16fa" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39017 } } }
I20260809 20:14:23.427968 6419 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [sys.catalog]: This master's current role is: LEADER
I20260809 20:14:23.428417 6422 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0d4629efcfb411888390125cdec16fa. Latest consensus state: current_term: 2 leader_uuid: "f0d4629efcfb411888390125cdec16fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d4629efcfb411888390125cdec16fa" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39017 } } }
I20260809 20:14:23.428681 6422 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [sys.catalog]: This master's current role is: LEADER
I20260809 20:14:23.431893 6426 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:14:23.439989 6426 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:14:23.441978 6426 catalog_manager.cc:1259] Loaded cluster ID: e75124fba42e424bafcdd84da9e6ba85
I20260809 20:14:23.442073 6426 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:14:23.445477 6426 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260809 20:14:23.464597 6426 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260809 20:14:23.480530 6426 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:14:23.482251 6426 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa: Loaded TSK: 0
I20260809 20:14:23.483764 6426 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 20:14:23.717869 6413 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:14:23.718127 6413 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:14:23.718266 6413 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:14:23.725258 6413 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:14:23.725373 6413 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:14:23.725512 6413 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:14:23.734958 6413 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:41995
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=37639
--tserver_master_addrs=127.14.181.62:39017
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:14:23.736099 6413 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:14:23.737330 6413 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:14:23.751235 6452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:23.751230 6453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:23.751756 6456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:23.752161 6413 server_base.cc:1034] running on GCE node
I20260809 20:14:23.752867 6413 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:14:23.754050 6413 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:14:23.755293 6413 hybrid_clock.cc:648] HybridClock initialized: now 1786306463755204 us; error 73 us; skew 500 ppm
I20260809 20:14:23.755653 6413 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:14:23 dist-test-slave-6zbq krb5kdc[5440](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306463, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:23.759349 6413 init.cc:377] Logged in from keytab as kudu/127.14.181.1@KRBTEST.COM (short username kudu)
I20260809 20:14:23.760697 6413 webserver.cc:460] Webserver started at http://127.14.181.1:37639/ using document root <none> and password file <none>
I20260809 20:14:23.761322 6413 fs_manager.cc:359] Metadata directory not provided
I20260809 20:14:23.761442 6413 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:14:23.766671 6413 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 20:14:23.769209 6465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:23.770510 6413 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 20:14:23.770651 6413 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "0d6f9c34eccf4ebea1ce5255be6958e7"
format_stamp: "Formatted at 2026-08-09 20:14:21 on dist-test-slave-6zbq"
server_key: "e01b109ec5841da3d5615003cab799cf"
server_key_iv: "304d541b445f0829ca4fac3d15579f9b"
server_key_version: "encryptionkey@0"
I20260809 20:14:23.771552 6413 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:14:23.798553 6413 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:14:23.802448 6413 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:14:23.802692 6413 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:14:23.803586 6413 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:14:23.804826 6413 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:14:23.804932 6413 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:23.805029 6413 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:14:23.805095 6413 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:23.833369 6413 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:41995
I20260809 20:14:23.833420 6644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:41995 every 8 connection(s)
I20260809 20:14:23.834661 6413 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:14:23.845118 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 6413
I20260809 20:14:23.845867 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:37017
--local_ip_for_outbound_sockets=127.14.181.2
--tserver_master_addrs=127.14.181.62:39017
--webserver_port=37413
--webserver_interface=127.14.181.2
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 20:14:23 dist-test-slave-6zbq krb5kdc[5440](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306463, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:14:23.855837 6655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:23.837359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.1:60061)
0809 20:14:23.838136 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:23.838196 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:23.839853 (+ 1657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:23.840952 (+ 1099us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:23.840959 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:23.841441 (+ 482us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:14:23.841928 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:23.841944 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:23.843390 (+ 1446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:23.843393 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:23.844540 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:23.844552 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:23.845804 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:23.845809 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:23.846003 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:23.846621 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:14:23.846642 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:14:23.848603 (+ 1961us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:14:23.852409 (+ 3806us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:23.852415 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:23.852424 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:23.852805 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:23.853218 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:23.853221 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:23.853223 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:23.853379 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:23.854133 (+ 754us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:14:23.854138 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:14:23.854439 (+ 301us) client_negotiation.cc:769] Sending connection context
0809 20:14:23.854646 (+ 207us) client_negotiation.cc:240] Negotiation successful
0809 20:14:23.854971 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":310,"threads_started":1}
I20260809 20:14:23.856247 6654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:23.837130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:60061 (local address 127.14.181.62:39017)
0809 20:14:23.837631 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:23.837642 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:23.838293 (+ 651us) server_negotiation.cc:407] Connection header received
0809 20:14:23.840269 (+ 1976us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:23.840280 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:23.840563 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:23.840840 (+ 277us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:23.842098 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:23.843264 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:23.844674 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:23.845620 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:23.845815 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:23.848881 (+ 3066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:23.848890 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:23.848906 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:23.848944 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:23.852277 (+ 3333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:23.852923 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:23.852930 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:23.852938 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:23.853125 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:23.853470 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:23.853474 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:23.853477 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:23.854021 (+ 544us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:23.854196 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:23.854871 (+ 675us) server_negotiation.cc:299] Negotiation successful
0809 20:14:23.855226 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":215,"threads_started":1}
I20260809 20:14:23.858691 6650 heartbeater.cc:347] Connected to a master server at 127.14.181.62:39017
I20260809 20:14:23.858948 6650 heartbeater.cc:464] Registering TS with master...
I20260809 20:14:23.859570 6650 heartbeater.cc:511] Master 127.14.181.62:39017 requested a full tablet report, sending...
I20260809 20:14:23.861730 6336 ts_manager.cc:194] Registered new tserver with Master: 0d6f9c34eccf4ebea1ce5255be6958e7 (127.14.181.1:41995)
I20260809 20:14:23.863656 6336 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.1@KRBTEST.COM'} at 127.14.181.1:60061
W20260809 20:14:24.160730 6656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:14:24.160965 6656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:14:24.161054 6656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:14:24.167876 6656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:14:24.167968 6656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:14:24.168128 6656 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:14:24.177134 6656 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:37017
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=37413
--tserver_master_addrs=127.14.181.62:39017
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:14:24.178162 6656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:14:24.179378 6656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:14:24.191234 6663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:24.191282 6664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:24.191304 6667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:24.192195 6656 server_base.cc:1034] running on GCE node
I20260809 20:14:24.192699 6656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:14:24.193473 6656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:14:24.194660 6656 hybrid_clock.cc:648] HybridClock initialized: now 1786306464194623 us; error 34 us; skew 500 ppm
I20260809 20:14:24.194931 6656 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:14:24 dist-test-slave-6zbq krb5kdc[5440](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306464, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:24.197791 6656 init.cc:377] Logged in from keytab as kudu/127.14.181.2@KRBTEST.COM (short username kudu)
I20260809 20:14:24.199079 6656 webserver.cc:460] Webserver started at http://127.14.181.2:37413/ using document root <none> and password file <none>
I20260809 20:14:24.199662 6656 fs_manager.cc:359] Metadata directory not provided
I20260809 20:14:24.199770 6656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:14:24.204558 6656 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 20:14:24.207221 6681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:24.208524 6656 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 20:14:24.208680 6656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "51a737fe8d8848b9aa4481b384e4ed6e"
format_stamp: "Formatted at 2026-08-09 20:14:21 on dist-test-slave-6zbq"
server_key: "ebfb159ebd8b1b47b43af2b640533172"
server_key_iv: "da78999324edb0427e6a2f674a043d94"
server_key_version: "encryptionkey@0"
I20260809 20:14:24.209586 6656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:14:24.222285 6656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:14:24.226068 6656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:14:24.226298 6656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:14:24.227253 6656 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:14:24.228435 6656 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:14:24.228536 6656 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:24.228636 6656 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:14:24.228724 6656 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:24.259801 6656 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:37017
I20260809 20:14:24.259862 6852 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:37017 every 8 connection(s)
I20260809 20:14:24.261124 6656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:14:24.262260 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 6656
I20260809 20:14:24.263010 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:35267
--local_ip_for_outbound_sockets=127.14.181.3
--tserver_master_addrs=127.14.181.62:39017
--webserver_port=35507
--webserver_interface=127.14.181.3
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 20:14:24 dist-test-slave-6zbq krb5kdc[5440](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306464, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:14:24.281700 6654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:24.263809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:52465 (local address 127.14.181.62:39017)
0809 20:14:24.264011 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:24.264018 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:24.265163 (+ 1145us) server_negotiation.cc:407] Connection header received
0809 20:14:24.267419 (+ 2256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:24.267423 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:24.267493 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:24.267574 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:24.269409 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.270096 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.272075 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.272492 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.272583 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:24.276452 (+ 3869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:24.276457 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:24.276460 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:24.276491 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:24.278821 (+ 2330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:24.279561 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:24.279565 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:24.279567 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:24.279698 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:24.280094 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:24.280098 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:24.280100 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:24.280353 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:24.280483 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:24.281137 (+ 654us) server_negotiation.cc:299] Negotiation successful
0809 20:14:24.281365 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 20:14:24.282521 6859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:24.264217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.2:52465)
0809 20:14:24.264964 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:24.265008 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:24.267145 (+ 2137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:24.267826 (+ 681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:24.267838 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:24.268512 (+ 674us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:14:24.269234 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:24.269257 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.270254 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.270259 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:24.271935 (+ 1676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:24.271949 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.272700 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.272706 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:24.272956 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:24.273623 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:14:24.273653 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:14:24.276261 (+ 2608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:14:24.278941 (+ 2680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:24.278950 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:24.278964 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:24.279445 (+ 481us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:24.279799 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:24.279805 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:24.279809 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:24.279983 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:24.280479 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:14:24.280486 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:14:24.280774 (+ 288us) client_negotiation.cc:769] Sending connection context
0809 20:14:24.280991 (+ 217us) client_negotiation.cc:240] Negotiation successful
0809 20:14:24.281463 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":279,"threads_started":1}
I20260809 20:14:24.283850 6854 heartbeater.cc:347] Connected to a master server at 127.14.181.62:39017
I20260809 20:14:24.284103 6854 heartbeater.cc:464] Registering TS with master...
I20260809 20:14:24.284785 6854 heartbeater.cc:511] Master 127.14.181.62:39017 requested a full tablet report, sending...
I20260809 20:14:24.286324 6336 ts_manager.cc:194] Registered new tserver with Master: 51a737fe8d8848b9aa4481b384e4ed6e (127.14.181.2:37017)
I20260809 20:14:24.287464 6336 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.2@KRBTEST.COM'} at 127.14.181.2:52465
W20260809 20:14:24.573868 6861 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:14:24.574110 6861 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:14:24.574205 6861 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:14:24.581231 6861 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:14:24.581322 6861 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:14:24.581431 6861 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:14:24.590644 6861 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:35267
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=35507
--tserver_master_addrs=127.14.181.62:39017
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:14:24.591640 6861 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:14:24.592756 6861 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:14:24.607807 6871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:24.608201 6861 server_base.cc:1034] running on GCE node
W20260809 20:14:24.607826 6870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:24.608719 6874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:24.609447 6861 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:14:24.610455 6861 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:14:24.611668 6861 hybrid_clock.cc:648] HybridClock initialized: now 1786306464611615 us; error 46 us; skew 500 ppm
I20260809 20:14:24.611953 6861 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:14:24 dist-test-slave-6zbq krb5kdc[5440](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306464, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:24.614758 6861 init.cc:377] Logged in from keytab as kudu/127.14.181.3@KRBTEST.COM (short username kudu)
I20260809 20:14:24.616030 6861 webserver.cc:460] Webserver started at http://127.14.181.3:35507/ using document root <none> and password file <none>
I20260809 20:14:24.616627 6861 fs_manager.cc:359] Metadata directory not provided
I20260809 20:14:24.616746 6861 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:14:24.621577 6861 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 20:14:24.624001 6885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:24.625149 6861 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 20:14:24.625293 6861 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "8e2c799d0c2c480c905b712b42a36347"
format_stamp: "Formatted at 2026-08-09 20:14:22 on dist-test-slave-6zbq"
server_key: "b92f679409aa4d0b5c5a5694df3a1bed"
server_key_iv: "bfd4e0194a2daa5445be4d34cf477006"
server_key_version: "encryptionkey@0"
I20260809 20:14:24.626219 6861 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:14:24.645254 6861 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:14:24.648747 6861 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:14:24.648973 6861 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:14:24.649816 6861 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:14:24.651010 6861 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:14:24.651101 6861 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:24.651207 6861 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:14:24.651276 6861 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:24.680536 6861 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:35267
I20260809 20:14:24.680603 7057 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:35267 every 8 connection(s)
I20260809 20:14:24.681818 6861 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:14:24.688844 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 6861
Aug 09 20:14:24 dist-test-slave-6zbq krb5kdc[5440](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306464, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:14:24.700582 6654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:24.684092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:34405 (local address 127.14.181.62:39017)
0809 20:14:24.684268 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:24.684273 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:24.685331 (+ 1058us) server_negotiation.cc:407] Connection header received
0809 20:14:24.687062 (+ 1731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:24.687067 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:24.687134 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:24.687209 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:24.688481 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.689472 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.691309 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.691737 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.691840 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:24.695110 (+ 3270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:24.695117 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:24.695121 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:24.695160 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:24.697626 (+ 2466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:24.698267 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:24.698271 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:24.698274 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:24.698492 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:24.698981 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:24.698985 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:24.698987 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:24.699251 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:24.699378 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:24.699994 (+ 616us) server_negotiation.cc:299] Negotiation successful
0809 20:14:24.700258 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 20:14:24.701323 7060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:24.684535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.3:34405)
0809 20:14:24.685188 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:24.685222 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:24.686822 (+ 1600us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:24.687387 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:24.687394 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:24.687838 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:14:24.688341 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:24.688358 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.689627 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.689632 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:24.691175 (+ 1543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:24.691188 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.691952 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.691961 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:24.692167 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:24.692735 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:14:24.692762 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:14:24.694926 (+ 2164us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:14:24.697755 (+ 2829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:24.697761 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:24.697770 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:24.698144 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:24.698615 (+ 471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:24.698620 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:24.698623 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:24.698866 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:24.699373 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:14:24.699380 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:14:24.699650 (+ 270us) client_negotiation.cc:769] Sending connection context
0809 20:14:24.699863 (+ 213us) client_negotiation.cc:240] Negotiation successful
0809 20:14:24.700313 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":245,"threads_started":1}
I20260809 20:14:24.702643 7058 heartbeater.cc:347] Connected to a master server at 127.14.181.62:39017
I20260809 20:14:24.702939 7058 heartbeater.cc:464] Registering TS with master...
I20260809 20:14:24.703269 7064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:24.689776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37318 (local address 127.14.181.62:39017)
0809 20:14:24.690666 (+ 890us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:24.690670 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:24.690683 (+ 13us) server_negotiation.cc:407] Connection header received
0809 20:14:24.690720 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:24.690723 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:24.690779 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:24.690867 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:24.692322 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.693005 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.694641 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.695077 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.695195 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:24.697715 (+ 2520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:24.697722 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:24.697726 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:24.697761 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:24.700448 (+ 2687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:24.701134 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:24.701139 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:24.701143 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:24.701253 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:24.701956 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:24.701960 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:24.701962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:24.702273 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:24.702570 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:24.702815 (+ 245us) server_negotiation.cc:299] Negotiation successful
0809 20:14:24.702963 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":801,"thread_start_us":686,"threads_started":1}
I20260809 20:14:24.703732 7058 heartbeater.cc:511] Master 127.14.181.62:39017 requested a full tablet report, sending...
I20260809 20:14:24.705163 6334 ts_manager.cc:194] Registered new tserver with Master: 8e2c799d0c2c480c905b712b42a36347 (127.14.181.3:35267)
I20260809 20:14:24.706089 6334 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.3@KRBTEST.COM'} at 127.14.181.3:34405
I20260809 20:14:24.717334 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 20:14:24.722934 7064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:24.718188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37326 (local address 127.14.181.62:39017)
0809 20:14:24.718392 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:24.718397 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:24.718621 (+ 224us) server_negotiation.cc:407] Connection header received
0809 20:14:24.718758 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:24.718761 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:24.718865 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:24.718968 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:14:24.719320 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.719921 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.721228 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.721600 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.721679 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:24.722037 (+ 358us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:14:24.722487 (+ 450us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:14:24.722582 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:24.722670 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 20:14:24.722722 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 20:14:24.723690 6334 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:37326:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 20:14:24.730737 6334 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 20:14:24.765933 7082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:24.741511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36042 (local address 127.14.181.3:35267)
0809 20:14:24.758876 (+ 17365us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:24.758884 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:24.758916 (+ 32us) server_negotiation.cc:407] Connection header received
0809 20:14:24.759005 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:24.759012 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:24.759216 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:24.759397 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:14:24.759989 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.761518 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.763837 (+ 2319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.764879 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.764985 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:24.765199 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:24.765488 (+ 289us) server_negotiation.cc:299] Negotiation successful
0809 20:14:24.765641 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17214,"thread_start_us":17079,"threads_started":1}
I20260809 20:14:24.766014 7081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:24.740916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:35267 (local address 127.0.0.1:36042)
0809 20:14:24.757628 (+ 16712us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:24.757645 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:24.757755 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:24.759396 (+ 1641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:24.759400 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:24.759421 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:14:24.759800 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:24.759811 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.761677 (+ 1866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.761681 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:24.763694 (+ 2013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:24.763707 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.765071 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.765077 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:24.765268 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:24.765320 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 20:14:24.765433 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 20:14:24.765599 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16589,"mutex_wait_us":133,"thread_start_us":17062,"threads_started":1}
I20260809 20:14:24.766600 7080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:24.741287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:37017 (local address 127.0.0.1:53208)
0809 20:14:24.758211 (+ 16924us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:24.758225 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:24.758362 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:24.759232 (+ 870us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:24.759239 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:24.759262 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:14:24.759667 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:24.759688 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.761662 (+ 1974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.761668 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:24.764175 (+ 2507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:24.764190 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.765793 (+ 1603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.765800 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:24.765991 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:24.766029 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 20:14:24.766111 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 20:14:24.766227 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16817,"mutex_wait_us":25,"thread_start_us":16064,"threads_started":1}
I20260809 20:14:24.767403 7083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:24.741902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53208 (local address 127.14.181.2:37017)
0809 20:14:24.757185 (+ 15283us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:24.757194 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:24.758324 (+ 1130us) server_negotiation.cc:407] Connection header received
0809 20:14:24.758530 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:24.758538 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:24.758787 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:24.758974 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:14:24.759923 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.761507 (+ 1584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.764366 (+ 2859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.765568 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.765685 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:24.765888 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:24.766919 (+ 1031us) server_negotiation.cc:299] Negotiation successful
0809 20:14:24.767082 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15091,"thread_start_us":14968,"threads_started":1}
I20260809 20:14:24.768359 7078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:24.740647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:41995 (local address 127.0.0.1:42748)
0809 20:14:24.755836 (+ 15189us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:24.755874 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:24.756032 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:24.759759 (+ 3727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:24.759763 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:24.759791 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:14:24.760142 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:24.760151 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.761644 (+ 1493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.761650 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:24.764177 (+ 2527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:24.764190 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.767580 (+ 3390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.767587 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:24.767761 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:24.767794 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 20:14:24.767891 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 20:14:24.768009 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14945,"mutex_wait_us":75,"thread_start_us":15549,"threads_started":1}
I20260809 20:14:24.769124 7079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:24.740887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42748 (local address 127.14.181.1:41995)
0809 20:14:24.759227 (+ 18340us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:24.759235 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:24.759260 (+ 25us) server_negotiation.cc:407] Connection header received
0809 20:14:24.759347 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:24.759354 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:24.759561 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:24.759742 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:14:24.760299 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.761482 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.765969 (+ 4487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.767364 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.767509 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:24.767680 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:24.767942 (+ 262us) server_negotiation.cc:299] Negotiation successful
0809 20:14:24.768098 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18192,"thread_start_us":18046,"threads_started":1}
I20260809 20:14:24.769804 6962 tablet_service.cc:1467] Processing CreateTablet for tablet 92d31c837f164b2a91ab8c38812f445c (DEFAULT_TABLE table=test-table [id=97bc699c10c14490b3791b69303e723b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:14:24.770761 6752 tablet_service.cc:1467] Processing CreateTablet for tablet 92d31c837f164b2a91ab8c38812f445c (DEFAULT_TABLE table=test-table [id=97bc699c10c14490b3791b69303e723b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:14:24.771171 6962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92d31c837f164b2a91ab8c38812f445c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:14:24.771795 6752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92d31c837f164b2a91ab8c38812f445c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:14:24.772644 6538 tablet_service.cc:1467] Processing CreateTablet for tablet 92d31c837f164b2a91ab8c38812f445c (DEFAULT_TABLE table=test-table [id=97bc699c10c14490b3791b69303e723b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:14:24.773898 6538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92d31c837f164b2a91ab8c38812f445c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:14:24.783613 7084 tablet_bootstrap.cc:492] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e: Bootstrap starting.
I20260809 20:14:24.785806 7085 tablet_bootstrap.cc:492] T 92d31c837f164b2a91ab8c38812f445c P 8e2c799d0c2c480c905b712b42a36347: Bootstrap starting.
I20260809 20:14:24.787007 7084 tablet_bootstrap.cc:654] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e: Neither blocks nor log segments found. Creating new log.
I20260809 20:14:24.788295 7084 log.cc:824] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e: Log is configured to *not* fsync() on all Append() calls
I20260809 20:14:24.788324 7086 tablet_bootstrap.cc:492] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7: Bootstrap starting.
I20260809 20:14:24.789318 7085 tablet_bootstrap.cc:654] T 92d31c837f164b2a91ab8c38812f445c P 8e2c799d0c2c480c905b712b42a36347: Neither blocks nor log segments found. Creating new log.
I20260809 20:14:24.790326 7085 log.cc:824] T 92d31c837f164b2a91ab8c38812f445c P 8e2c799d0c2c480c905b712b42a36347: Log is configured to *not* fsync() on all Append() calls
I20260809 20:14:24.791361 7086 tablet_bootstrap.cc:654] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7: Neither blocks nor log segments found. Creating new log.
I20260809 20:14:24.791669 7084 tablet_bootstrap.cc:492] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e: No bootstrap required, opened a new log
I20260809 20:14:24.791919 7084 ts_tablet_manager.cc:1397] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260809 20:14:24.792321 7086 log.cc:824] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7: Log is configured to *not* fsync() on all Append() calls
I20260809 20:14:24.793102 7085 tablet_bootstrap.cc:492] T 92d31c837f164b2a91ab8c38812f445c P 8e2c799d0c2c480c905b712b42a36347: No bootstrap required, opened a new log
I20260809 20:14:24.793367 7085 ts_tablet_manager.cc:1397] T 92d31c837f164b2a91ab8c38812f445c P 8e2c799d0c2c480c905b712b42a36347: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.002s
I20260809 20:14:24.794564 7086 tablet_bootstrap.cc:492] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7: No bootstrap required, opened a new log
I20260809 20:14:24.794802 7086 ts_tablet_manager.cc:1397] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260809 20:14:24.801818 7084 raft_consensus.cc:348] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41995 } } peers { permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 } } peers { permanent_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37017 } }
I20260809 20:14:24.801961 7086 raft_consensus.cc:348] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41995 } } peers { permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 } } peers { permanent_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37017 } }
I20260809 20:14:24.802208 7084 raft_consensus.cc:374] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:14:24.802286 7086 raft_consensus.cc:374] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:14:24.802294 7084 raft_consensus.cc:729] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51a737fe8d8848b9aa4481b384e4ed6e, State: Initialized, Role: FOLLOWER
I20260809 20:14:24.802402 7086 raft_consensus.cc:729] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d6f9c34eccf4ebea1ce5255be6958e7, State: Initialized, Role: FOLLOWER
I20260809 20:14:24.802886 7084 consensus_queue.cc:260] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41995 } } peers { permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 } } peers { permanent_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37017 } }
I20260809 20:14:24.802950 7086 consensus_queue.cc:260] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41995 } } peers { permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 } } peers { permanent_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37017 } }
I20260809 20:14:24.803180 7085 raft_consensus.cc:348] T 92d31c837f164b2a91ab8c38812f445c P 8e2c799d0c2c480c905b712b42a36347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41995 } } peers { permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 } } peers { permanent_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37017 } }
I20260809 20:14:24.803570 7085 raft_consensus.cc:374] T 92d31c837f164b2a91ab8c38812f445c P 8e2c799d0c2c480c905b712b42a36347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:14:24.803676 7085 raft_consensus.cc:729] T 92d31c837f164b2a91ab8c38812f445c P 8e2c799d0c2c480c905b712b42a36347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e2c799d0c2c480c905b712b42a36347, State: Initialized, Role: FOLLOWER
I20260809 20:14:24.804049 6650 heartbeater.cc:503] Master 127.14.181.62:39017 was elected leader, sending a full tablet report...
I20260809 20:14:24.804320 7085 consensus_queue.cc:260] T 92d31c837f164b2a91ab8c38812f445c P 8e2c799d0c2c480c905b712b42a36347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41995 } } peers { permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 } } peers { permanent_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37017 } }
I20260809 20:14:24.804536 7086 ts_tablet_manager.cc:1428] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7: Time spent starting tablet: real 0.009s user 0.004s sys 0.004s
I20260809 20:14:24.808526 7058 heartbeater.cc:503] Master 127.14.181.62:39017 was elected leader, sending a full tablet report...
I20260809 20:14:24.809453 7085 ts_tablet_manager.cc:1428] T 92d31c837f164b2a91ab8c38812f445c P 8e2c799d0c2c480c905b712b42a36347: Time spent starting tablet: real 0.016s user 0.007s sys 0.009s
I20260809 20:14:24.810231 6854 heartbeater.cc:503] Master 127.14.181.62:39017 was elected leader, sending a full tablet report...
I20260809 20:14:24.810842 7084 ts_tablet_manager.cc:1428] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e: Time spent starting tablet: real 0.019s user 0.007s sys 0.013s
W20260809 20:14:24.836712 6653 tablet.cc:2369] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:14:24.927582 7095 raft_consensus.cc:482] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:14:24.927868 7095 raft_consensus.cc:504] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41995 } } peers { permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 } } peers { permanent_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37017 } }
I20260809 20:14:24.929553 7095 leader_election.cc:288] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d6f9c34eccf4ebea1ce5255be6958e7 (127.14.181.1:41995), 8e2c799d0c2c480c905b712b42a36347 (127.14.181.3:35267)
W20260809 20:14:24.933262 7059 tablet.cc:2369] T 92d31c837f164b2a91ab8c38812f445c P 8e2c799d0c2c480c905b712b42a36347: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:14:24.936331 7079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:24.929909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:60975 (local address 127.14.181.1:41995)
0809 20:14:24.930126 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:24.930133 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:24.930998 (+ 865us) server_negotiation.cc:407] Connection header received
0809 20:14:24.931164 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:24.931167 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:24.931228 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:24.931314 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:14:24.931910 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.932581 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.934541 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.935413 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.935522 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:24.935573 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:24.935948 (+ 375us) server_negotiation.cc:299] Negotiation successful
0809 20:14:24.936072 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 20:14:24.936399 7098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:24.929862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:41995 (local address 127.14.181.2:60975)
0809 20:14:24.930906 (+ 1044us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:24.930919 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:24.931032 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:24.931344 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:24.931348 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:24.931375 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:14:24.931754 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:24.931764 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.932714 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.932719 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:24.934396 (+ 1677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:24.934408 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.935618 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.935624 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:24.935784 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:24.935819 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 20:14:24.935905 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 20:14:24.935989 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":932,"mutex_wait_us":43,"thread_start_us":696,"threads_started":1}
I20260809 20:14:24.936457 7082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:24.930047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:57957 (local address 127.14.181.3:35267)
0809 20:14:24.930265 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:24.930272 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:24.930900 (+ 628us) server_negotiation.cc:407] Connection header received
0809 20:14:24.931112 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:24.931118 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:24.931187 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:24.931249 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:14:24.931835 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.932550 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.934825 (+ 2275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.935602 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.935768 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:24.935836 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:24.936110 (+ 274us) server_negotiation.cc:299] Negotiation successful
0809 20:14:24.936233 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 20:14:24.936553 7097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:24.929828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:35267 (local address 127.14.181.2:57957)
0809 20:14:24.930795 (+ 967us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:24.930810 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:24.930949 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:24.931283 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:24.931288 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:24.931312 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:14:24.931699 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:24.931712 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.932695 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.932700 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:24.934683 (+ 1983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:24.934698 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.935803 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.935808 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:24.935951 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:24.935982 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 20:14:24.936066 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 20:14:24.936180 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":854,"mutex_wait_us":85,"thread_start_us":466,"threads_started":1}
I20260809 20:14:24.937328 6987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92d31c837f164b2a91ab8c38812f445c" candidate_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e2c799d0c2c480c905b712b42a36347" is_pre_election: true
I20260809 20:14:24.937564 6573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92d31c837f164b2a91ab8c38812f445c" candidate_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" is_pre_election: true
I20260809 20:14:24.937759 6987 raft_consensus.cc:2454] T 92d31c837f164b2a91ab8c38812f445c P 8e2c799d0c2c480c905b712b42a36347 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51a737fe8d8848b9aa4481b384e4ed6e in term 0.
I20260809 20:14:24.938021 6573 raft_consensus.cc:2454] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51a737fe8d8848b9aa4481b384e4ed6e in term 0.
I20260809 20:14:24.938359 6686 leader_election.cc:302] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51a737fe8d8848b9aa4481b384e4ed6e, 8e2c799d0c2c480c905b712b42a36347; no voters:
I20260809 20:14:24.938737 7095 raft_consensus.cc:2781] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:14:24.938849 7095 raft_consensus.cc:482] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:14:24.938939 7095 raft_consensus.cc:3037] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:14:24.941004 7095 raft_consensus.cc:504] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41995 } } peers { permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 } } peers { permanent_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37017 } }
I20260809 20:14:24.941597 7095 leader_election.cc:288] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e [CANDIDATE]: Term 1 election: Requested vote from peers 0d6f9c34eccf4ebea1ce5255be6958e7 (127.14.181.1:41995), 8e2c799d0c2c480c905b712b42a36347 (127.14.181.3:35267)
I20260809 20:14:24.941959 6573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92d31c837f164b2a91ab8c38812f445c" candidate_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7"
I20260809 20:14:24.942065 6987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92d31c837f164b2a91ab8c38812f445c" candidate_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e2c799d0c2c480c905b712b42a36347"
I20260809 20:14:24.942164 6573 raft_consensus.cc:3037] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:14:24.942270 6987 raft_consensus.cc:3037] T 92d31c837f164b2a91ab8c38812f445c P 8e2c799d0c2c480c905b712b42a36347 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:14:24.945232 6987 raft_consensus.cc:2454] T 92d31c837f164b2a91ab8c38812f445c P 8e2c799d0c2c480c905b712b42a36347 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51a737fe8d8848b9aa4481b384e4ed6e in term 1.
I20260809 20:14:24.945232 6573 raft_consensus.cc:2454] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51a737fe8d8848b9aa4481b384e4ed6e in term 1.
I20260809 20:14:24.945607 6687 leader_election.cc:302] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0d6f9c34eccf4ebea1ce5255be6958e7, 51a737fe8d8848b9aa4481b384e4ed6e, 8e2c799d0c2c480c905b712b42a36347; no voters:
I20260809 20:14:24.945940 7095 raft_consensus.cc:2781] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:14:24.946381 7095 raft_consensus.cc:686] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e [term 1 LEADER]: Becoming Leader. State: Replica: 51a737fe8d8848b9aa4481b384e4ed6e, State: Running, Role: LEADER
I20260809 20:14:24.946802 7095 consensus_queue.cc:237] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41995 } } peers { permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 } } peers { permanent_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37017 } }
I20260809 20:14:24.951059 6336 catalog_manager.cc:5495] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e reported cstate change: term changed from 0 to 1, leader changed from <none> to 51a737fe8d8848b9aa4481b384e4ed6e (127.14.181.2). New cstate: current_term: 1 leader_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37017 } health_report { overall_health: HEALTHY } } }
I20260809 20:14:25.000082 7083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:24.995210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53216 (local address 127.14.181.2:37017)
0809 20:14:24.995374 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:24.995379 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:24.995461 (+ 82us) server_negotiation.cc:407] Connection header received
0809 20:14:24.995625 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:24.995629 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:24.995715 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:24.995838 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:14:24.996117 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.996822 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.998231 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:24.998667 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:24.998759 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:24.999187 (+ 428us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:14:24.999670 (+ 483us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:14:24.999772 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:24.999824 (+ 52us) server_negotiation.cc:299] Negotiation successful
0809 20:14:24.999885 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 20:14:25.007810 6573 raft_consensus.cc:1261] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 1 FOLLOWER]: Refusing update from remote peer 51a737fe8d8848b9aa4481b384e4ed6e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:14:25.007819 6987 raft_consensus.cc:1261] T 92d31c837f164b2a91ab8c38812f445c P 8e2c799d0c2c480c905b712b42a36347 [term 1 FOLLOWER]: Refusing update from remote peer 51a737fe8d8848b9aa4481b384e4ed6e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:14:25.008680 7099 consensus_queue.cc:1035] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:14:25.008991 7095 consensus_queue.cc:1035] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 20:14:25.012827 6858 tablet.cc:2369] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:14:25.019943 7105 mvcc.cc:205] Tried to move back new op lower bound from 7316711280662630400 to 7316711280425422848. Current Snapshot: MvccSnapshot[applied={T|T < 7316711280662630400}]
I20260809 20:14:25.032933 6334 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:37326:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:14:25.033214 6334 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:37326:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:14:25.036753 6334 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa: Sending DeleteTablet for 3 replicas of tablet 92d31c837f164b2a91ab8c38812f445c
I20260809 20:14:25.037789 6538 tablet_service.cc:1514] Processing DeleteTablet for tablet 92d31c837f164b2a91ab8c38812f445c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:14:25 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:42748
I20260809 20:14:25.037961 6752 tablet_service.cc:1514] Processing DeleteTablet for tablet 92d31c837f164b2a91ab8c38812f445c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:14:25 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:53208
I20260809 20:14:25.038219 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 6413
I20260809 20:14:25.038918 6962 tablet_service.cc:1514] Processing DeleteTablet for tablet 92d31c837f164b2a91ab8c38812f445c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:14:25 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:36042
I20260809 20:14:25.048769 7117 tablet_replica.cc:330] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e: stopping tablet replica
I20260809 20:14:25.049186 7116 tablet_replica.cc:330] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7: stopping tablet replica
I20260809 20:14:25.049388 7117 raft_consensus.cc:2229] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e [term 1 LEADER]: Raft consensus shutting down.
I20260809 20:14:25.049825 7116 raft_consensus.cc:2229] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:14:25.050137 7117 raft_consensus.cc:2258] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:14:25.050316 7116 raft_consensus.cc:2258] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:14:25.052199 7117 ts_tablet_manager.cc:1905] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:14:25.052644 7116 ts_tablet_manager.cc:1905] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:14:25.055677 7079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:25.039012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42756 (local address 127.14.181.1:41995)
0809 20:14:25.039441 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:25.039447 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:25.039466 (+ 19us) server_negotiation.cc:407] Connection header received
0809 20:14:25.039521 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:25.039526 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:25.039600 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:25.039697 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:25.041470 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:25.042650 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:25.044533 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:25.045188 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:25.045312 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:25.048717 (+ 3405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:25.048731 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:25.048747 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:25.048795 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:25.052652 (+ 3857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:25.053449 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:25.053458 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:25.053462 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:25.053611 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:25.053982 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:25.053986 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:25.053990 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:25.054496 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:25.054787 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:25.055109 (+ 322us) server_negotiation.cc:299] Negotiation successful
0809 20:14:25.055329 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311}
I20260809 20:14:25.056327 6638 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:14:25.060135 7119 tablet_replica.cc:330] T 92d31c837f164b2a91ab8c38812f445c P 8e2c799d0c2c480c905b712b42a36347: stopping tablet replica
I20260809 20:14:25.060508 7117 ts_tablet_manager.cc:1918] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:14:25.060544 7119 raft_consensus.cc:2229] T 92d31c837f164b2a91ab8c38812f445c P 8e2c799d0c2c480c905b712b42a36347 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:14:25.060788 7117 log.cc:1196] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/wal/wals/92d31c837f164b2a91ab8c38812f445c
I20260809 20:14:25.061017 7119 raft_consensus.cc:2258] T 92d31c837f164b2a91ab8c38812f445c P 8e2c799d0c2c480c905b712b42a36347 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:14:25.061501 7117 ts_tablet_manager.cc:1939] T 92d31c837f164b2a91ab8c38812f445c P 51a737fe8d8848b9aa4481b384e4ed6e: Deleting consensus metadata
I20260809 20:14:25.063319 6314 catalog_manager.cc:4841] TS 51a737fe8d8848b9aa4481b384e4ed6e (127.14.181.2:37017): tablet 92d31c837f164b2a91ab8c38812f445c (table test-table [id=97bc699c10c14490b3791b69303e723b]) successfully deleted
I20260809 20:14:25.063827 7119 ts_tablet_manager.cc:1905] T 92d31c837f164b2a91ab8c38812f445c P 8e2c799d0c2c480c905b712b42a36347: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:14:25.070755 7119 ts_tablet_manager.cc:1918] T 92d31c837f164b2a91ab8c38812f445c P 8e2c799d0c2c480c905b712b42a36347: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:14:25.070926 7119 log.cc:1196] T 92d31c837f164b2a91ab8c38812f445c P 8e2c799d0c2c480c905b712b42a36347: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/wal/wals/92d31c837f164b2a91ab8c38812f445c
I20260809 20:14:25.071456 7119 ts_tablet_manager.cc:1939] T 92d31c837f164b2a91ab8c38812f445c P 8e2c799d0c2c480c905b712b42a36347: Deleting consensus metadata
I20260809 20:14:25.073186 6315 catalog_manager.cc:4841] TS 8e2c799d0c2c480c905b712b42a36347 (127.14.181.3:35267): tablet 92d31c837f164b2a91ab8c38812f445c (table test-table [id=97bc699c10c14490b3791b69303e723b]) successfully deleted
I20260809 20:14:25.166615 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 6413
I20260809 20:14:25.189670 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 6656
W20260809 20:14:25.189909 6317 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.181.1:41995 (error 108)
I20260809 20:14:25.192566 7078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:25.192087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:41995 (local address 127.0.0.1:42758)
0809 20:14:25.192277 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:25.192397 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:41995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260809 20:14:25.192889 6317 catalog_manager.cc:4584] TS 0d6f9c34eccf4ebea1ce5255be6958e7 (127.14.181.1:41995): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 92d31c837f164b2a91ab8c38812f445c: Network error: Client connection negotiation failed: client connection to 127.14.181.1:41995: connect: Connection refused (error 111)
I20260809 20:14:25.203719 7083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:25.190472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53224 (local address 127.14.181.2:37017)
0809 20:14:25.190639 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:25.190645 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:25.190769 (+ 124us) server_negotiation.cc:407] Connection header received
0809 20:14:25.190965 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:25.190971 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:25.191060 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:25.191143 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:25.192877 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:25.193705 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:25.195122 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:25.195550 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:25.195656 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:25.198007 (+ 2351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:25.198019 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:25.198033 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:25.198067 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:25.201040 (+ 2973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:25.201679 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:25.201688 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:25.201691 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:25.201842 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:25.202178 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:25.202182 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:25.202184 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:25.202648 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:25.202950 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:25.203194 (+ 244us) server_negotiation.cc:299] Negotiation successful
0809 20:14:25.203399 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 20:14:25.204361 6847 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:14:25.246358 7078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:25.245920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:41995 (local address 127.0.0.1:42774)
0809 20:14:25.246101 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:25.246190 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:41995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260809 20:14:25.247273 7078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:25.246952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:41995 (local address 127.0.0.1:42782)
0809 20:14:25.247097 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:25.247171 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:41995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260809 20:14:25.307711 7078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:25.307268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:41995 (local address 127.0.0.1:42790)
0809 20:14:25.307476 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:25.307564 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:41995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260809 20:14:25.308724 7078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:25.308380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:41995 (local address 127.0.0.1:42796)
0809 20:14:25.308545 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:25.308615 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:41995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260809 20:14:25.313807 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 6656
I20260809 20:14:25.335984 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 6861
I20260809 20:14:25.347895 7082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:25.336657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36058 (local address 127.14.181.3:35267)
0809 20:14:25.336816 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:25.336821 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:25.336839 (+ 18us) server_negotiation.cc:407] Connection header received
0809 20:14:25.336980 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:25.336984 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:25.337056 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:25.337148 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:25.338381 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:25.339089 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:25.340402 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:25.340773 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:25.340862 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:25.343337 (+ 2475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:25.343350 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:25.343365 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:25.343395 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:25.345753 (+ 2358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:25.346375 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:25.346384 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:25.346388 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:25.346517 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:25.346796 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:25.346799 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:25.346801 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:25.347110 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:25.347329 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:25.347514 (+ 185us) server_negotiation.cc:299] Negotiation successful
0809 20:14:25.347661 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 20:14:25.348454 7051 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:14:25.388994 7078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:25.388513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:41995 (local address 127.0.0.1:42800)
0809 20:14:25.388713 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:25.388825 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:41995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260809 20:14:25.390055 7078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:25.389643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:41995 (local address 127.0.0.1:42804)
0809 20:14:25.389843 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:25.389929 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:41995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260809 20:14:25.433892 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 6861
I20260809 20:14:25.456195 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 6290
I20260809 20:14:25.457240 6402 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:14:25.566797 7078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:25.566232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:41995 (local address 127.0.0.1:42820)
0809 20:14:25.566518 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:25.566639 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:41995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140}
I20260809 20:14:25.566881 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 6290
I20260809 20:14:25.592692 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:39017
--webserver_interface=127.14.181.62
--webserver_port=41363
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:39017
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:14:25.903084 7126 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:14:25.903357 7126 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:14:25.903491 7126 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:14:25.910511 7126 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:14:25.910611 7126 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:14:25.910687 7126 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:14:25.910765 7126 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:14:25.910825 7126 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:14:25.920042 7126 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:39017
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:39017
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=41363
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:14:25.921207 7126 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:14:25.922410 7126 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:14:25.932991 7133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:25.933038 7137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:25.933064 7134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:25.933790 7126 server_base.cc:1034] running on GCE node
I20260809 20:14:25.934535 7126 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:14:25.935745 7126 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:14:25.936944 7126 hybrid_clock.cc:648] HybridClock initialized: now 1786306465936905 us; error 27 us; skew 500 ppm
I20260809 20:14:25.937227 7126 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:14:25 dist-test-slave-6zbq krb5kdc[5440](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306465, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:25.940114 7126 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:14:25.941407 7126 webserver.cc:460] Webserver started at http://127.14.181.62:41363/ using document root <none> and password file <none>
I20260809 20:14:25.941978 7126 fs_manager.cc:359] Metadata directory not provided
I20260809 20:14:25.942078 7126 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:14:25.947046 7126 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 20:14:25.949586 7147 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:25.950834 7126 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 20:14:25.950971 7126 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "f0d4629efcfb411888390125cdec16fa"
format_stamp: "Formatted at 2026-08-09 20:14:20 on dist-test-slave-6zbq"
server_key: "cfa351bda5dc272808ef45d7529cd984"
server_key_iv: "5c194ca549cda59941de04c0d755d719"
server_key_version: "encryptionkey@0"
I20260809 20:14:25.951838 7126 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:14:25.964411 7126 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:14:25.968128 7126 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:14:25.968335 7126 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:14:25.984288 7126 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:39017
I20260809 20:14:25.984295 7234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:39017 every 8 connection(s)
I20260809 20:14:25.985564 7126 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:14:25.992163 7235 sys_catalog.cc:263] Verifying existing consensus state
I20260809 20:14:25.993701 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 7126
I20260809 20:14:25.994691 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:41995
--local_ip_for_outbound_sockets=127.14.181.1
--tserver_master_addrs=127.14.181.62:39017
--webserver_port=37639
--webserver_interface=127.14.181.1
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 20:14:25.996209 7235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa: Bootstrap starting.
I20260809 20:14:26.018184 7235 log.cc:824] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa: Log is configured to *not* fsync() on all Append() calls
I20260809 20:14:26.034250 7235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 20:14:26.034766 7235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa: Bootstrap complete.
I20260809 20:14:26.043466 7235 raft_consensus.cc:348] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d4629efcfb411888390125cdec16fa" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39017 } }
I20260809 20:14:26.044296 7235 raft_consensus.cc:729] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0d4629efcfb411888390125cdec16fa, State: Initialized, Role: FOLLOWER
I20260809 20:14:26.044831 7235 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d4629efcfb411888390125cdec16fa" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39017 } }
I20260809 20:14:26.045046 7235 raft_consensus.cc:388] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:14:26.045150 7235 raft_consensus.cc:482] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:14:26.045315 7235 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [term 2 FOLLOWER]: Advancing to term 3
I20260809 20:14:26.049106 7235 raft_consensus.cc:504] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d4629efcfb411888390125cdec16fa" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39017 } }
I20260809 20:14:26.049566 7235 leader_election.cc:302] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f0d4629efcfb411888390125cdec16fa; no voters:
I20260809 20:14:26.050174 7235 leader_election.cc:288] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 20:14:26.050310 7239 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [term 3 FOLLOWER]: Leader election won for term 3
I20260809 20:14:26.051400 7239 raft_consensus.cc:686] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [term 3 LEADER]: Becoming Leader. State: Replica: f0d4629efcfb411888390125cdec16fa, State: Running, Role: LEADER
I20260809 20:14:26.051931 7239 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d4629efcfb411888390125cdec16fa" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39017 } }
I20260809 20:14:26.052246 7235 sys_catalog.cc:564] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:14:26.054432 7243 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0d4629efcfb411888390125cdec16fa. Latest consensus state: current_term: 3 leader_uuid: "f0d4629efcfb411888390125cdec16fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d4629efcfb411888390125cdec16fa" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39017 } } }
I20260809 20:14:26.054844 7243 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [sys.catalog]: This master's current role is: LEADER
I20260809 20:14:26.060564 7241 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "f0d4629efcfb411888390125cdec16fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0d4629efcfb411888390125cdec16fa" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39017 } } }
I20260809 20:14:26.060865 7241 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0d4629efcfb411888390125cdec16fa [sys.catalog]: This master's current role is: LEADER
I20260809 20:14:26.063400 7248 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:14:26.071947 7248 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:14:26.073444 7248 catalog_manager.cc:1259] Loaded cluster ID: e75124fba42e424bafcdd84da9e6ba85
I20260809 20:14:26.073540 7248 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260809 20:14:26.075685 7248 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fe379a679ad google::LogMessage::Fail() at ??:0
@ 0x7fe379a6a88a google::LogMessage::SendToLog() at ??:0
@ 0x7fe379a674de google::LogMessage::Flush() at ??:0
@ 0x7fe379a68a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fe38f49e512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7fe38f49b976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fe38f523610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7fe38f523439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fe37c6b3345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fe37c6b691c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fe37c6b6799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fe37c691eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fe37f96b6db start_thread at ??:0
@ 0x7fe37890161f clone at ??:0
W20260809 20:14:26.364207 7237 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:14:26.364454 7237 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:14:26.364574 7237 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:14:26.371645 7237 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:14:26.371748 7237 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:14:26.371898 7237 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:14:26.381248 7237 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:41995
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=37639
--tserver_master_addrs=127.14.181.62:39017
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:14:26.382402 7237 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:14:26.383692 7237 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:14:26.395741 7305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:26.395741 7308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:26.395938 7310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:26.396696 7237 server_base.cc:1034] running on GCE node
I20260809 20:14:26.397225 7237 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:14:26.398021 7237 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:14:26.399219 7237 hybrid_clock.cc:648] HybridClock initialized: now 1786306466399173 us; error 40 us; skew 500 ppm
I20260809 20:14:26.399504 7237 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:14:26 dist-test-slave-6zbq krb5kdc[5440](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306466, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:26.402393 7237 init.cc:377] Logged in from keytab as kudu/127.14.181.1@KRBTEST.COM (short username kudu)
I20260809 20:14:26.403702 7237 webserver.cc:460] Webserver started at http://127.14.181.1:37639/ using document root <none> and password file <none>
I20260809 20:14:26.404310 7237 fs_manager.cc:359] Metadata directory not provided
I20260809 20:14:26.404428 7237 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:14:26.409389 7237 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 20:14:26.412115 7321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:26.413292 7237 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 20:14:26.413429 7237 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "0d6f9c34eccf4ebea1ce5255be6958e7"
format_stamp: "Formatted at 2026-08-09 20:14:21 on dist-test-slave-6zbq"
server_key: "e01b109ec5841da3d5615003cab799cf"
server_key_iv: "304d541b445f0829ca4fac3d15579f9b"
server_key_version: "encryptionkey@0"
I20260809 20:14:26.414359 7237 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:14:26.433007 7237 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:14:26.436486 7237 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:14:26.436721 7237 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:14:26.437609 7237 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:14:26.439271 7332 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260809 20:14:26.444746 7237 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 20:14:26.444855 7237 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.001s
I20260809 20:14:26.444957 7237 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 20:14:26.447872 7237 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 20:14:26.447947 7237 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.001s sys 0.001s
I20260809 20:14:26.448276 7332 tablet_bootstrap.cc:492] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7: Bootstrap starting.
I20260809 20:14:26.455950 7332 log.cc:824] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7: Log is configured to *not* fsync() on all Append() calls
I20260809 20:14:26.470407 7332 tablet_bootstrap.cc:492] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 20:14:26.471199 7332 tablet_bootstrap.cc:492] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7: Bootstrap complete.
I20260809 20:14:26.471781 7332 ts_tablet_manager.cc:1397] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7: Time spent bootstrapping tablet: real 0.024s user 0.021s sys 0.000s
I20260809 20:14:26.483475 7332 raft_consensus.cc:348] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41995 } } peers { permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 } } peers { permanent_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37017 } }
I20260809 20:14:26.485193 7332 raft_consensus.cc:729] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d6f9c34eccf4ebea1ce5255be6958e7, State: Initialized, Role: FOLLOWER
I20260809 20:14:26.485968 7332 consensus_queue.cc:260] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41995 } } peers { permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 } } peers { permanent_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37017 } }
I20260809 20:14:26.486935 7237 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:41995
I20260809 20:14:26.487001 7491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:41995 every 8 connection(s)
I20260809 20:14:26.487901 7332 ts_tablet_manager.cc:1428] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7: Time spent starting tablet: real 0.016s user 0.016s sys 0.000s
I20260809 20:14:26.488358 7237 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:14:26.492707 7497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:26.490950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.1:35949)
0809 20:14:26.491704 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:26.491937 (+ 233us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":300,"threads_started":1}
I20260809 20:14:26.492727 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 7237
W20260809 20:14:26.493238 7492 heartbeater.cc:644] Failed to heartbeat to 127.14.181.62:39017 (0 consecutive failures): Network error: Failed to ping master at 127.14.181.62:39017: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
I20260809 20:14:26.493456 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:37017
--local_ip_for_outbound_sockets=127.14.181.2
--tserver_master_addrs=127.14.181.62:39017
--webserver_port=37413
--webserver_interface=127.14.181.2
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 20:14:26.494035 7497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:26.493737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.1:42807)
0809 20:14:26.493870 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:26.493936 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 20:14:26.494859 7497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:26.494527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.1:38353)
0809 20:14:26.494670 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:26.494743 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 20:14:26.495074 7492 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 20:14:26.812153 7501 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:14:26.812407 7501 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:14:26.812539 7501 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:14:26.819567 7501 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:14:26.819662 7501 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:14:26.819814 7501 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:14:26.829027 7501 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:37017
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=37413
--tserver_master_addrs=127.14.181.62:39017
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:14:26.830173 7501 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:14:26.831404 7501 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:14:26.843451 7511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:26.843495 7508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:26.843516 7507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:26.844259 7501 server_base.cc:1034] running on GCE node
I20260809 20:14:26.844838 7501 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:14:26.845671 7501 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:14:26.846861 7501 hybrid_clock.cc:648] HybridClock initialized: now 1786306466846812 us; error 43 us; skew 500 ppm
I20260809 20:14:26.847141 7501 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:14:26 dist-test-slave-6zbq krb5kdc[5440](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306466, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:26.849985 7501 init.cc:377] Logged in from keytab as kudu/127.14.181.2@KRBTEST.COM (short username kudu)
I20260809 20:14:26.851294 7501 webserver.cc:460] Webserver started at http://127.14.181.2:37413/ using document root <none> and password file <none>
I20260809 20:14:26.851907 7501 fs_manager.cc:359] Metadata directory not provided
I20260809 20:14:26.852021 7501 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:14:26.856946 7501 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 20:14:26.859634 7522 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:26.860888 7501 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 20:14:26.861034 7501 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "51a737fe8d8848b9aa4481b384e4ed6e"
format_stamp: "Formatted at 2026-08-09 20:14:21 on dist-test-slave-6zbq"
server_key: "ebfb159ebd8b1b47b43af2b640533172"
server_key_iv: "da78999324edb0427e6a2f674a043d94"
server_key_version: "encryptionkey@0"
I20260809 20:14:26.861980 7501 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:14:26.905689 7501 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:14:26.910017 7501 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:14:26.910265 7501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:14:26.911226 7501 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:14:26.912571 7501 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:14:26.912675 7501 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:26.912776 7501 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:14:26.912844 7501 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:26.942180 7501 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:37017
I20260809 20:14:26.942257 7705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:37017 every 8 connection(s)
I20260809 20:14:26.943538 7501 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:14:26.947985 7712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:26.946243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.2:53683)
0809 20:14:26.946960 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:26.947210 (+ 250us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":264,"threads_started":1}
I20260809 20:14:26.948329 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 7501
W20260809 20:14:26.948673 7709 heartbeater.cc:644] Failed to heartbeat to 127.14.181.62:39017 (0 consecutive failures): Network error: Failed to ping master at 127.14.181.62:39017: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
I20260809 20:14:26.949014 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:35267
--local_ip_for_outbound_sockets=127.14.181.3
--tserver_master_addrs=127.14.181.62:39017
--webserver_port=35507
--webserver_interface=127.14.181.3
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 20:14:26.949589 7712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:26.949171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.2:59729)
0809 20:14:26.949386 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:26.949458 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126}
I20260809 20:14:26.950533 7712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:26.950145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.2:56489)
0809 20:14:26.950288 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:26.950397 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 20:14:26.950810 7709 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 20:14:27.262217 7713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:14:27.262540 7713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:14:27.262648 7713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:14:27.269927 7713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:14:27.270040 7713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:14:27.270170 7713 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:14:27.279768 7713 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:35267
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=35507
--tserver_master_addrs=127.14.181.62:39017
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:14:27.280984 7713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:14:27.282294 7713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:14:27.294911 7720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:27.295370 7730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:27.295393 7721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:27.295477 7713 server_base.cc:1034] running on GCE node
I20260809 20:14:27.296254 7713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:14:27.297106 7713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:14:27.298309 7713 hybrid_clock.cc:648] HybridClock initialized: now 1786306467298255 us; error 39 us; skew 500 ppm
I20260809 20:14:27.298635 7713 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:14:27 dist-test-slave-6zbq krb5kdc[5440](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306467, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:27.304499 7713 init.cc:377] Logged in from keytab as kudu/127.14.181.3@KRBTEST.COM (short username kudu)
I20260809 20:14:27.305959 7713 webserver.cc:460] Webserver started at http://127.14.181.3:35507/ using document root <none> and password file <none>
I20260809 20:14:27.306694 7713 fs_manager.cc:359] Metadata directory not provided
I20260809 20:14:27.306804 7713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:14:27.311981 7713 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 20:14:27.314651 7743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:27.315949 7713 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 20:14:27.316110 7713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "8e2c799d0c2c480c905b712b42a36347"
format_stamp: "Formatted at 2026-08-09 20:14:22 on dist-test-slave-6zbq"
server_key: "b92f679409aa4d0b5c5a5694df3a1bed"
server_key_iv: "bfd4e0194a2daa5445be4d34cf477006"
server_key_version: "encryptionkey@0"
I20260809 20:14:27.317051 7713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:14:27.332501 7713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:14:27.336328 7713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:14:27.336570 7713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:14:27.337466 7713 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:14:27.338760 7713 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:14:27.338848 7713 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:27.338953 7713 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:14:27.339025 7713 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:27.368757 7713 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:35267
I20260809 20:14:27.368829 7901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:35267 every 8 connection(s)
I20260809 20:14:27.370105 7713 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:14:27.373153 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 7713
I20260809 20:14:27.374708 7904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:27.372792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.3:44317)
0809 20:14:27.373567 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:27.373821 (+ 254us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":311,"threads_started":1}
W20260809 20:14:27.375322 7902 heartbeater.cc:644] Failed to heartbeat to 127.14.181.62:39017 (0 consecutive failures): Network error: Failed to ping master at 127.14.181.62:39017: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
I20260809 20:14:27.375988 7904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:27.375717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.3:53901)
0809 20:14:27.375834 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:27.375893 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 20:14:27.376684 7904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:27.376422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.3:57979)
0809 20:14:27.376522 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:27.376588 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260809 20:14:27.376888 7902 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 20:14:27.496234 7908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:27.495519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.1:38829)
0809 20:14:27.495916 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:27.496028 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":183,"threads_started":1}
I20260809 20:14:27.951982 7909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:27.951248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.2:39497)
0809 20:14:27.951672 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:27.951765 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":185,"threads_started":1}
I20260809 20:14:28.115561 7911 raft_consensus.cc:482] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:14:28.115856 7911 raft_consensus.cc:504] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41995 } } peers { permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 } } peers { permanent_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37017 } }
I20260809 20:14:28.117427 7911 leader_election.cc:288] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e2c799d0c2c480c905b712b42a36347 (127.14.181.3:35267), 51a737fe8d8848b9aa4481b384e4ed6e (127.14.181.2:37017)
Aug 09 20:14:28 dist-test-slave-6zbq krb5kdc[5440](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306466, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for kudu/127.14.181.2@KRBTEST.COM
Aug 09 20:14:28 dist-test-slave-6zbq krb5kdc[5440](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306466, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for kudu/127.14.181.3@KRBTEST.COM
I20260809 20:14:28.137377 7918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:28.118132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:55513 (local address 127.14.181.2:37017)
0809 20:14:28.119418 (+ 1286us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:28.119429 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:28.119465 (+ 36us) server_negotiation.cc:407] Connection header received
0809 20:14:28.121206 (+ 1741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:28.121215 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:28.121550 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:28.121850 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:28.123756 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:28.124878 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:28.126640 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:28.127249 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:28.127413 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:28.130861 (+ 3448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:28.130871 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:28.130887 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:28.130932 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:28.133890 (+ 2958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:28.134721 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:28.134727 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:28.134732 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:28.134872 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:28.135305 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:28.135308 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:28.135310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:28.135753 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:28.135918 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:28.136668 (+ 750us) server_negotiation.cc:299] Negotiation successful
0809 20:14:28.136993 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1040,"thread_start_us":875,"threads_started":1}
I20260809 20:14:28.137380 7915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:28.117618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:35267 (local address 127.14.181.1:45271)
0809 20:14:28.118312 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:28.118392 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:28.118944 (+ 552us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:28.122005 (+ 3061us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:28.122015 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:28.122854 (+ 839us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:14:28.123572 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:28.123592 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:28.125027 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:28.125031 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:28.126523 (+ 1492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:28.126536 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:28.127497 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:28.127505 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:28.127674 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:28.128404 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:14:28.128421 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:14:28.130871 (+ 2450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:14:28.134036 (+ 3165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:28.134041 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:28.134045 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:28.134584 (+ 539us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:28.134994 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:28.134999 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:28.135003 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:28.135183 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:28.135884 (+ 701us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:14:28.135891 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:14:28.136181 (+ 290us) client_negotiation.cc:769] Sending connection context
0809 20:14:28.136407 (+ 226us) client_negotiation.cc:240] Negotiation successful
0809 20:14:28.136890 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"mutex_wait_us":149,"spinlock_wait_cycles":16128,"thread_start_us":771,"threads_started":1}
I20260809 20:14:28.137422 7916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:28.117882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:45271 (local address 127.14.181.3:35267)
0809 20:14:28.119616 (+ 1734us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:28.119632 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:28.119671 (+ 39us) server_negotiation.cc:407] Connection header received
0809 20:14:28.121360 (+ 1689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:28.121369 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:28.121718 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:28.122009 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:28.123752 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:28.124849 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:28.126650 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:28.127263 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:28.127427 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:28.131113 (+ 3686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:28.131119 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:28.131130 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:28.131162 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:28.133911 (+ 2749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:28.134714 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:28.134720 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:28.134726 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:28.134885 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:28.135292 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:28.135295 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:28.135297 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:28.135743 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:28.135920 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:28.136670 (+ 750us) server_negotiation.cc:299] Negotiation successful
0809 20:14:28.137042 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1578,"thread_start_us":1468,"threads_started":1}
I20260809 20:14:28.137440 7913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:28.117772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:37017 (local address 127.14.181.1:55513)
0809 20:14:28.118622 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:28.118637 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:28.119276 (+ 639us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:28.122004 (+ 2728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:28.122015 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:28.122857 (+ 842us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:14:28.123572 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:28.123592 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:28.125028 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:28.125032 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:28.126516 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:28.126529 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:28.127439 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:28.127446 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:28.127678 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:28.128347 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:14:28.128369 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:14:28.130583 (+ 2214us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:14:28.134017 (+ 3434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:28.134025 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:28.134038 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:28.134588 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:28.134977 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:28.134982 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:28.134986 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:28.135192 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:28.135882 (+ 690us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:14:28.135890 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:14:28.136182 (+ 292us) client_negotiation.cc:769] Sending connection context
0809 20:14:28.136407 (+ 225us) client_negotiation.cc:240] Negotiation successful
0809 20:14:28.137033 (+ 626us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":747,"mutex_wait_us":419,"spinlock_wait_cycles":79488,"thread_start_us":255,"threads_started":1}
W20260809 20:14:28.140347 7322 leader_election.cc:341] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 51a737fe8d8848b9aa4481b384e4ed6e (127.14.181.2:37017): Not found: Tablet not found: 92d31c837f164b2a91ab8c38812f445c
W20260809 20:14:28.140617 7324 leader_election.cc:341] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8e2c799d0c2c480c905b712b42a36347 (127.14.181.3:35267): Not found: Tablet not found: 92d31c837f164b2a91ab8c38812f445c
I20260809 20:14:28.140739 7324 leader_election.cc:302] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d6f9c34eccf4ebea1ce5255be6958e7; no voters: 51a737fe8d8848b9aa4481b384e4ed6e, 8e2c799d0c2c480c905b712b42a36347
I20260809 20:14:28.141124 7911 raft_consensus.cc:2726] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 20:14:28.378103 7919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:28.377328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.3:59583)
0809 20:14:28.377754 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:28.377881 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":204,"threads_started":1}
I20260809 20:14:28.497380 7913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:28.497001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.1:56995)
0809 20:14:28.497160 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:28.497254 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 20:14:28.953356 7920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:28.952730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.2:42603)
0809 20:14:28.953129 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:28.953207 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":210,"threads_started":1}
I20260809 20:14:29.379516 7921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:29.378893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.3:53291)
0809 20:14:29.379286 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:29.379364 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":213,"threads_started":1}
I20260809 20:14:29.498805 7924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:29.498093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.1:33153)
0809 20:14:29.498560 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:29.498636 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":242,"threads_started":1}
I20260809 20:14:29.728458 7925 raft_consensus.cc:482] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:14:29.728689 7925 raft_consensus.cc:504] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41995 } } peers { permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 } } peers { permanent_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37017 } }
I20260809 20:14:29.729355 7925 leader_election.cc:288] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e2c799d0c2c480c905b712b42a36347 (127.14.181.3:35267), 51a737fe8d8848b9aa4481b384e4ed6e (127.14.181.2:37017)
W20260809 20:14:29.730418 7322 leader_election.cc:341] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 51a737fe8d8848b9aa4481b384e4ed6e (127.14.181.2:37017): Not found: Tablet not found: 92d31c837f164b2a91ab8c38812f445c
W20260809 20:14:29.730633 7324 leader_election.cc:341] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8e2c799d0c2c480c905b712b42a36347 (127.14.181.3:35267): Not found: Tablet not found: 92d31c837f164b2a91ab8c38812f445c
I20260809 20:14:29.730757 7324 leader_election.cc:302] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d6f9c34eccf4ebea1ce5255be6958e7; no voters: 51a737fe8d8848b9aa4481b384e4ed6e, 8e2c799d0c2c480c905b712b42a36347
I20260809 20:14:29.730996 7925 raft_consensus.cc:2726] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 20:14:29.954768 7927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:29.954079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.2:57555)
0809 20:14:29.954523 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:29.954605 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":257,"threads_started":1}
I20260809 20:14:30.380846 7928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:30.380232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.3:38729)
0809 20:14:30.380627 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:30.380704 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":197,"threads_started":1}
I20260809 20:14:30.500160 7929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:30.499534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.1:59299)
0809 20:14:30.499918 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:30.500002 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":204,"threads_started":1}
I20260809 20:14:30.956111 7931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:30.955459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.2:55391)
0809 20:14:30.955873 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:30.955954 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":201,"threads_started":1}
I20260809 20:14:31.372907 7932 raft_consensus.cc:482] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:14:31.373083 7932 raft_consensus.cc:504] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41995 } } peers { permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 } } peers { permanent_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37017 } }
I20260809 20:14:31.373713 7932 leader_election.cc:288] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e2c799d0c2c480c905b712b42a36347 (127.14.181.3:35267), 51a737fe8d8848b9aa4481b384e4ed6e (127.14.181.2:37017)
W20260809 20:14:31.374586 7324 leader_election.cc:341] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8e2c799d0c2c480c905b712b42a36347 (127.14.181.3:35267): Not found: Tablet not found: 92d31c837f164b2a91ab8c38812f445c
W20260809 20:14:31.374766 7322 leader_election.cc:341] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 51a737fe8d8848b9aa4481b384e4ed6e (127.14.181.2:37017): Not found: Tablet not found: 92d31c837f164b2a91ab8c38812f445c
I20260809 20:14:31.374907 7322 leader_election.cc:302] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d6f9c34eccf4ebea1ce5255be6958e7; no voters: 51a737fe8d8848b9aa4481b384e4ed6e, 8e2c799d0c2c480c905b712b42a36347
I20260809 20:14:31.375119 7932 raft_consensus.cc:2726] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 20:14:31.382169 7933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:31.381537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.3:41145)
0809 20:14:31.381921 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:31.381995 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":188,"threads_started":1}
I20260809 20:14:31.501716 7934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:31.500969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.1:33563)
0809 20:14:31.501426 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:31.501525 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":202,"threads_started":1}
I20260809 20:14:31.957660 7935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:31.956906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.2:43303)
0809 20:14:31.957416 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:31.957510 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":232,"threads_started":1}
I20260809 20:14:32.383562 7936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:32.382921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.3:43323)
0809 20:14:32.383334 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:32.383412 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":226,"threads_started":1}
I20260809 20:14:32.503109 7937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:32.502475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.1:50217)
0809 20:14:32.502877 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:32.502954 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":192,"threads_started":1}
I20260809 20:14:32.959120 7938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:32.958441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.2:36315)
0809 20:14:32.958864 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:32.958948 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":220,"threads_started":1}
I20260809 20:14:33.384924 7939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:33.384282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.3:35725)
0809 20:14:33.384676 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:33.384761 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":208,"threads_started":1}
I20260809 20:14:33.504498 7940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:33.503812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.1:51473)
0809 20:14:33.504234 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:33.504319 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":214,"threads_started":1}
I20260809 20:14:33.960626 7942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:33.959880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.2:46857)
0809 20:14:33.960345 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:33.960433 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":209,"threads_started":1}
I20260809 20:14:34.386328 7945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:34.385671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.3:43113)
0809 20:14:34.386086 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:34.386164 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":176,"threads_started":1}
I20260809 20:14:34.505930 7947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:34.505221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.1:48593)
0809 20:14:34.505654 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:34.505776 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":180,"threads_started":1}
I20260809 20:14:34.820082 7948 raft_consensus.cc:482] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:14:34.820294 7948 raft_consensus.cc:504] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41995 } } peers { permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 } } peers { permanent_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37017 } }
I20260809 20:14:34.820912 7948 leader_election.cc:288] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e2c799d0c2c480c905b712b42a36347 (127.14.181.3:35267), 51a737fe8d8848b9aa4481b384e4ed6e (127.14.181.2:37017)
W20260809 20:14:34.821846 7322 leader_election.cc:341] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 51a737fe8d8848b9aa4481b384e4ed6e (127.14.181.2:37017): Not found: Tablet not found: 92d31c837f164b2a91ab8c38812f445c
W20260809 20:14:34.822026 7324 leader_election.cc:341] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8e2c799d0c2c480c905b712b42a36347 (127.14.181.3:35267): Not found: Tablet not found: 92d31c837f164b2a91ab8c38812f445c
I20260809 20:14:34.822176 7324 leader_election.cc:302] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d6f9c34eccf4ebea1ce5255be6958e7; no voters: 51a737fe8d8848b9aa4481b384e4ed6e, 8e2c799d0c2c480c905b712b42a36347
I20260809 20:14:34.822433 7948 raft_consensus.cc:2726] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 20:14:34.962086 7949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:34.961432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.2:34099)
0809 20:14:34.961837 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:34.961916 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":213,"threads_started":1}
I20260809 20:14:35.387815 7951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:35.387150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.3:57083)
0809 20:14:35.387563 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:35.387641 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":214,"threads_started":1}
I20260809 20:14:35.507361 7952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:35.506702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.1:40249)
0809 20:14:35.507117 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:35.507204 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":213,"threads_started":1}
I20260809 20:14:35.963542 7954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:35.962850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.2:49361)
0809 20:14:35.963311 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:35.963393 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":207,"threads_started":1}
I20260809 20:14:36.389237 7958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:36.388530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.3:55673)
0809 20:14:36.389008 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:36.389084 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":222,"threads_started":1}
I20260809 20:14:36.508782 7959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:36.508170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.1:50303)
0809 20:14:36.508545 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:36.508630 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":185,"threads_started":1}
I20260809 20:14:36.965190 7961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:36.964454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.2:55999)
0809 20:14:36.964915 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:36.965005 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":253,"threads_started":1}
I20260809 20:14:37.390705 7962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:37.390018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.3:57811)
0809 20:14:37.390436 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:37.390519 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":195,"threads_started":1}
I20260809 20:14:37.510259 7963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:37.509585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.1:38673)
0809 20:14:37.509986 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:37.510074 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":210,"threads_started":1}
I20260809 20:14:37.966679 7964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:37.965942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.2:41837)
0809 20:14:37.966429 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:37.966519 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":264,"threads_started":1}
I20260809 20:14:38.392097 7965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:38.391431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.3:35411)
0809 20:14:38.391865 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:38.391944 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":217,"threads_started":1}
I20260809 20:14:38.511806 7966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:38.511157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.1:41811)
0809 20:14:38.511563 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:38.511649 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":208,"threads_started":1}
I20260809 20:14:38.968050 7967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:38.967392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.2:55985)
0809 20:14:38.967816 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:38.967891 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":202,"threads_started":1}
I20260809 20:14:39.393560 7968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:39.392865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.3:58669)
0809 20:14:39.393299 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:39.393376 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":236,"threads_started":1}
I20260809 20:14:39.513267 7969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:39.512571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.1:55515)
0809 20:14:39.513016 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:39.513103 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":224,"threads_started":1}
I20260809 20:14:39.969491 7970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:39.968826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.2:44001)
0809 20:14:39.969246 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:39.969334 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":199,"threads_started":1}
I20260809 20:14:40.395027 7972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:40.394384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.3:51739)
0809 20:14:40.394785 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:40.394878 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":210,"threads_started":1}
I20260809 20:14:40.514708 7975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:40.513995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.1:39747)
0809 20:14:40.514462 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:40.514540 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":254,"threads_started":1}
I20260809 20:14:40.970973 7976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:40.970251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.2:60595)
0809 20:14:40.970709 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:40.970788 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":246,"threads_started":1}
I20260809 20:14:41.396497 7978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:41.395807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.3:38077)
0809 20:14:41.396238 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:41.396314 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":209,"threads_started":1}
I20260809 20:14:41.516485 7979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:41.515702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.1:42755)
0809 20:14:41.516155 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:41.516247 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":203,"threads_started":1}
I20260809 20:14:41.972615 7981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:41.971912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.2:47201)
0809 20:14:41.972354 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:41.972453 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":212,"threads_started":1}
I20260809 20:14:42.261255 7983 raft_consensus.cc:482] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:14:42.261440 7983 raft_consensus.cc:504] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d6f9c34eccf4ebea1ce5255be6958e7" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41995 } } peers { permanent_uuid: "8e2c799d0c2c480c905b712b42a36347" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35267 } } peers { permanent_uuid: "51a737fe8d8848b9aa4481b384e4ed6e" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 37017 } }
I20260809 20:14:42.262060 7983 leader_election.cc:288] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e2c799d0c2c480c905b712b42a36347 (127.14.181.3:35267), 51a737fe8d8848b9aa4481b384e4ed6e (127.14.181.2:37017)
W20260809 20:14:42.263068 7324 leader_election.cc:341] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8e2c799d0c2c480c905b712b42a36347 (127.14.181.3:35267): Not found: Tablet not found: 92d31c837f164b2a91ab8c38812f445c
W20260809 20:14:42.263247 7322 leader_election.cc:341] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 51a737fe8d8848b9aa4481b384e4ed6e (127.14.181.2:37017): Not found: Tablet not found: 92d31c837f164b2a91ab8c38812f445c
I20260809 20:14:42.263362 7322 leader_election.cc:302] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d6f9c34eccf4ebea1ce5255be6958e7; no voters: 51a737fe8d8848b9aa4481b384e4ed6e, 8e2c799d0c2c480c905b712b42a36347
I20260809 20:14:42.263574 7983 raft_consensus.cc:2726] T 92d31c837f164b2a91ab8c38812f445c P 0d6f9c34eccf4ebea1ce5255be6958e7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 20:14:42.380618 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 7237
I20260809 20:14:42.395674 7985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:42.381661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50766 (local address 127.14.181.1:41995)
0809 20:14:42.382658 (+ 997us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:42.382670 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:42.382707 (+ 37us) server_negotiation.cc:407] Connection header received
0809 20:14:42.382796 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:42.382806 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:42.383093 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:42.383281 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:42.385163 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:42.386183 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:42.387450 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:42.388031 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:42.388137 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:42.390668 (+ 2531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:42.390681 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:42.390694 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:42.390727 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:42.393281 (+ 2554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:42.393890 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:42.393896 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:42.393899 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:42.394051 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:42.394372 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:42.394377 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:42.394380 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:42.394730 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:42.394959 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:42.395177 (+ 218us) server_negotiation.cc:299] Negotiation successful
0809 20:14:42.395367 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":793,"thread_start_us":625,"threads_started":1}
I20260809 20:14:42.396884 7481 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:14:42.398401 7988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:42.397569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39017 (local address 127.14.181.3:36271)
0809 20:14:42.398047 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:42.398193 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:39017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":262,"threads_started":1}
I20260809 20:14:42.483750 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 7237
I20260809 20:14:42.507725 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 7501
I20260809 20:14:42.520980 7989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:42.508454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39396 (local address 127.14.181.2:37017)
0809 20:14:42.508878 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:42.508883 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:42.508899 (+ 16us) server_negotiation.cc:407] Connection header received
0809 20:14:42.508954 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:42.508957 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:42.509016 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:42.509103 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:42.510984 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:42.511744 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:42.512933 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:42.513369 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:42.513458 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:42.516042 (+ 2584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:42.516047 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:42.516050 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:42.516099 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:42.518717 (+ 2618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:42.519329 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:42.519333 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:42.519336 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:42.519477 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:42.519776 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:42.519779 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:42.519781 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:42.520026 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:42.520270 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:42.520453 (+ 183us) server_negotiation.cc:299] Negotiation successful
0809 20:14:42.520626 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":216,"threads_started":1}
I20260809 20:14:42.521684 7701 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:14:42.601790 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 7501
I20260809 20:14:42.626272 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 7713
I20260809 20:14:42.639057 7993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:42.627063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41236 (local address 127.14.181.3:35267)
0809 20:14:42.627593 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:42.627598 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:42.627615 (+ 17us) server_negotiation.cc:407] Connection header received
0809 20:14:42.627671 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:42.627674 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:42.627741 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:42.627836 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:42.629190 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:42.629983 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:42.631395 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:42.631836 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:42.631939 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:42.634403 (+ 2464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:42.634408 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:42.634412 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:42.634443 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:42.636812 (+ 2369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:42.637403 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:42.637407 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:42.637409 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:42.637541 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:42.637814 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:42.637817 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:42.637818 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:42.638063 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:42.638265 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:42.638620 (+ 355us) server_negotiation.cc:299] Negotiation successful
0809 20:14:42.638780 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":279,"threads_started":1}
I20260809 20:14:42.639730 7893 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:14:42.719686 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 7713
2026-08-09T20:14:42Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (23926 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:14:42 dist-test-slave-6zbq krb5kdc[7999](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:14:42 dist-test-slave-6zbq krb5kdc[7999](info): set up 2 sockets
Aug 09 20:14:42 dist-test-slave-6zbq krb5kdc[7999](info): commencing operation
krb5kdc: starting...
W20260809 20:14:43.916935 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.000s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:14:44 dist-test-slave-6zbq krb5kdc[7999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306484, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:14:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:14:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:14:44.143013 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:34277
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:34277
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:14:44.448410 8021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:14:44.448673 8021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:14:44.448810 8021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:14:44.455549 8021 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 20:14:44.455638 8021 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 20:14:44.455715 8021 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 20:14:44.455785 8021 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:14:44.455859 8021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:14:44.455950 8021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:14:44.456009 8021 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:14:44.456081 8021 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:14:44.465122 8021 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:34277
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:34277
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:14:44.466159 8021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:14:44.467357 8021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:14:44.477985 8029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:44.477958 8030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:44.478024 8032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:44.478789 8021 server_base.cc:1034] running on GCE node
I20260809 20:14:44.479444 8021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:14:44.480614 8021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:14:44.481808 8021 hybrid_clock.cc:648] HybridClock initialized: now 1786306484481745 us; error 43 us; skew 500 ppm
I20260809 20:14:44.482085 8021 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:14:44 dist-test-slave-6zbq krb5kdc[7999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306484, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:44.484941 8021 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:14:44.486176 8021 webserver.cc:460] Webserver started at http://127.14.181.62:44143/ using document root <none> and password file <none>
I20260809 20:14:44.486810 8021 fs_manager.cc:359] Metadata directory not provided
I20260809 20:14:44.486894 8021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:14:44.487135 8021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:14:44.489823 8021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "2950368f271942b0b719dddf2f9438b4"
format_stamp: "Formatted at 2026-08-09 20:14:44 on dist-test-slave-6zbq"
server_key: "07b88106491f31fa1462a9ced654115f"
server_key_iv: "02adb96c78dab0e4c495af6574a0b7b2"
server_key_version: "encryptionkey@0"
I20260809 20:14:44.490535 8021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "2950368f271942b0b719dddf2f9438b4"
format_stamp: "Formatted at 2026-08-09 20:14:44 on dist-test-slave-6zbq"
server_key: "07b88106491f31fa1462a9ced654115f"
server_key_iv: "02adb96c78dab0e4c495af6574a0b7b2"
server_key_version: "encryptionkey@0"
I20260809 20:14:44.495082 8021 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 20:14:44.498109 8039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:44.499264 8021 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 20:14:44.499388 8021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "2950368f271942b0b719dddf2f9438b4"
format_stamp: "Formatted at 2026-08-09 20:14:44 on dist-test-slave-6zbq"
server_key: "07b88106491f31fa1462a9ced654115f"
server_key_iv: "02adb96c78dab0e4c495af6574a0b7b2"
server_key_version: "encryptionkey@0"
I20260809 20:14:44.499550 8021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:14:44.515318 8021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:14:44.518887 8021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:14:44.519086 8021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:14:44.535918 8021 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:34277
I20260809 20:14:44.535929 8118 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:34277 every 8 connection(s)
I20260809 20:14:44.537124 8021 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:14:44.540537 8119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:14:44.540668 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 8021
I20260809 20:14:44.540860 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:14:44.541502 15060 external_mini_cluster.cc:1428] Setting key 2d92ab2c63351bd03e4883e4fc7e3b75
I20260809 20:14:44.553494 8119 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4: Bootstrap starting.
Aug 09 20:14:44 dist-test-slave-6zbq krb5kdc[7999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306484, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:14:44.557003 8119 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4: Neither blocks nor log segments found. Creating new log.
I20260809 20:14:44.558039 8119 log.cc:824] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4: Log is configured to *not* fsync() on all Append() calls
I20260809 20:14:44.560734 8119 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4: No bootstrap required, opened a new log
I20260809 20:14:44.564657 8122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:44.543329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42192 (local address 127.14.181.62:34277)
0809 20:14:44.544064 (+ 735us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:44.544078 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:44.544117 (+ 39us) server_negotiation.cc:407] Connection header received
0809 20:14:44.546124 (+ 2007us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:44.546146 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:44.546559 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:44.546878 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:44.548569 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:44.549821 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:44.551843 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:44.552481 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:44.552604 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:44.557251 (+ 4647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:44.557259 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:44.557273 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:44.557313 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:44.560269 (+ 2956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:44.560929 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:44.560937 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:44.560945 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:44.561184 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:44.561554 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:44.561559 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:44.561562 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:44.562249 (+ 687us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:44.562587 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:44.562932 (+ 345us) server_negotiation.cc:299] Negotiation successful
0809 20:14:44.563367 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":320,"threads_started":1}
I20260809 20:14:44.569679 8119 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2950368f271942b0b719dddf2f9438b4" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 34277 } }
I20260809 20:14:44.569991 8119 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:14:44.570060 8119 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2950368f271942b0b719dddf2f9438b4, State: Initialized, Role: FOLLOWER
I20260809 20:14:44.570538 8119 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2950368f271942b0b719dddf2f9438b4" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 34277 } }
I20260809 20:14:44.570762 8119 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:14:44.570858 8119 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:14:44.570968 8119 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:14:44.573097 8119 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2950368f271942b0b719dddf2f9438b4" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 34277 } }
I20260809 20:14:44.573499 8119 leader_election.cc:302] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2950368f271942b0b719dddf2f9438b4; no voters:
I20260809 20:14:44.573995 8119 leader_election.cc:288] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:14:44.574117 8126 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:14:44.574757 8126 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [term 1 LEADER]: Becoming Leader. State: Replica: 2950368f271942b0b719dddf2f9438b4, State: Running, Role: LEADER
I20260809 20:14:44.575366 8126 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2950368f271942b0b719dddf2f9438b4" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 34277 } }
I20260809 20:14:44.576066 8119 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:14:44.578091 8127 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2950368f271942b0b719dddf2f9438b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2950368f271942b0b719dddf2f9438b4" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 34277 } } }
I20260809 20:14:44.578583 8127 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [sys.catalog]: This master's current role is: LEADER
I20260809 20:14:44.578529 8129 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2950368f271942b0b719dddf2f9438b4. Latest consensus state: current_term: 1 leader_uuid: "2950368f271942b0b719dddf2f9438b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2950368f271942b0b719dddf2f9438b4" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 34277 } } }
I20260809 20:14:44.582680 8129 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [sys.catalog]: This master's current role is: LEADER
I20260809 20:14:44.583648 8136 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:14:44.588971 8136 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:14:44.597313 8136 catalog_manager.cc:1347] Generated new cluster ID: 9dae74d05cb94e2cbb46109817b32cf0
I20260809 20:14:44.597415 8136 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:14:44.618825 8136 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:14:44.620157 8136 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:14:44.627054 8136 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4: Generated new TSK 0
I20260809 20:14:44.627709 8136 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.181.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
I20260809 20:14:44.681257 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:0
--local_ip_for_outbound_sockets=127.14.181.1
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:34277
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:14:44.987205 8156 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:14:44.987452 8156 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:14:44.987581 8156 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:14:44.994442 8156 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:14:44.994556 8156 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:14:44.994714 8156 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:14:45.004205 8156 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:34277
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:14:45.005297 8156 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:14:45.006531 8156 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:14:45.018354 8163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:45.018392 8166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:45.018419 8168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:45.019060 8156 server_base.cc:1034] running on GCE node
I20260809 20:14:45.019567 8156 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:14:45.020366 8156 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:14:45.021564 8156 hybrid_clock.cc:648] HybridClock initialized: now 1786306485021510 us; error 46 us; skew 500 ppm
I20260809 20:14:45.021822 8156 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:14:45 dist-test-slave-6zbq krb5kdc[7999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306485, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:45.024798 8156 init.cc:377] Logged in from keytab as kudu/127.14.181.1@KRBTEST.COM (short username kudu)
I20260809 20:14:45.026012 8156 webserver.cc:460] Webserver started at http://127.14.181.1:44681/ using document root <none> and password file <none>
I20260809 20:14:45.026634 8156 fs_manager.cc:359] Metadata directory not provided
I20260809 20:14:45.026736 8156 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:14:45.026968 8156 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:14:45.029582 8156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/data/instance:
uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12"
format_stamp: "Formatted at 2026-08-09 20:14:45 on dist-test-slave-6zbq"
server_key: "b64d587bbe654d4e22c732153dac6618"
server_key_iv: "84a146044467ae28ebcbabf4f30ce80c"
server_key_version: "encryptionkey@0"
I20260809 20:14:45.030265 8156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance:
uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12"
format_stamp: "Formatted at 2026-08-09 20:14:45 on dist-test-slave-6zbq"
server_key: "b64d587bbe654d4e22c732153dac6618"
server_key_iv: "84a146044467ae28ebcbabf4f30ce80c"
server_key_version: "encryptionkey@0"
I20260809 20:14:45.034816 8156 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 20:14:45.037786 8178 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:45.038926 8156 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:14:45.039070 8156 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12"
format_stamp: "Formatted at 2026-08-09 20:14:45 on dist-test-slave-6zbq"
server_key: "b64d587bbe654d4e22c732153dac6618"
server_key_iv: "84a146044467ae28ebcbabf4f30ce80c"
server_key_version: "encryptionkey@0"
I20260809 20:14:45.039240 8156 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:14:45.066733 8156 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:14:45.070462 8156 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:14:45.070698 8156 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:14:45.071514 8156 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:14:45.072655 8156 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:14:45.072731 8156 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:45.072842 8156 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:14:45.072894 8156 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:45.101529 8156 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:43147
I20260809 20:14:45.101585 8350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:43147 every 8 connection(s)
I20260809 20:14:45.102705 8156 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:14:45.111716 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 8156
I20260809 20:14:45.111902 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance
I20260809 20:14:45.112553 15060 external_mini_cluster.cc:1428] Setting key 9c677251944f676408ed183f17864c32
Aug 09 20:14:45 dist-test-slave-6zbq krb5kdc[7999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306485, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:14:45.121034 8354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:45.104999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:57531 (local address 127.14.181.62:34277)
0809 20:14:45.105385 (+ 386us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:45.105389 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:45.106267 (+ 878us) server_negotiation.cc:407] Connection header received
0809 20:14:45.108094 (+ 1827us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:45.108100 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:45.108184 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:45.108289 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:45.109664 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:45.110406 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:45.111870 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:45.112320 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:45.112429 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:45.115915 (+ 3486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:45.115920 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:45.115923 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:45.115954 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:45.118215 (+ 2261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:45.118876 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:45.118880 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:45.118883 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:45.118998 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:45.119408 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:45.119412 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:45.119414 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:45.119679 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:45.119817 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:45.120435 (+ 618us) server_negotiation.cc:299] Negotiation successful
0809 20:14:45.120667 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":207,"threads_started":1}
I20260809 20:14:45.121847 8355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:45.105452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.1:57531)
0809 20:14:45.106120 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:45.106155 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:45.107836 (+ 1681us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:45.108523 (+ 687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:45.108531 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:45.108999 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:14:45.109499 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:45.109515 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:45.110554 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:45.110558 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:45.111732 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:45.111744 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:45.112525 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:45.112533 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:45.112776 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:45.113379 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:14:45.113400 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:14:45.115720 (+ 2320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:14:45.118365 (+ 2645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:45.118374 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:45.118387 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:45.118766 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:45.119098 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:45.119103 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:45.119107 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:45.119295 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:45.119809 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:14:45.119816 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:14:45.120091 (+ 275us) client_negotiation.cc:769] Sending connection context
0809 20:14:45.120312 (+ 221us) client_negotiation.cc:240] Negotiation successful
0809 20:14:45.120750 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":263,"threads_started":1}
I20260809 20:14:45.123154 8351 heartbeater.cc:347] Connected to a master server at 127.14.181.62:34277
I20260809 20:14:45.123443 8351 heartbeater.cc:464] Registering TS with master...
I20260809 20:14:45.124169 8351 heartbeater.cc:511] Master 127.14.181.62:34277 requested a full tablet report, sending...
I20260809 20:14:45.126062 8066 ts_manager.cc:194] Registered new tserver with Master: 4d4ed6835ecc4df2a9f21d7f9c363c12 (127.14.181.1:43147)
I20260809 20:14:45.127573 8066 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.1@KRBTEST.COM'} at 127.14.181.1:57531
WARNING: no policy specified for kudu/127.14.181.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
I20260809 20:14:45.165483 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:0
--local_ip_for_outbound_sockets=127.14.181.2
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:34277
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:14:45.466130 8360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:14:45.466394 8360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:14:45.466540 8360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:14:45.473302 8360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:14:45.473387 8360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:14:45.473526 8360 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:14:45.482658 8360 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:34277
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:14:45.483690 8360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:14:45.484807 8360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:14:45.496450 8365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:45.496490 8366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:45.496450 8371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:45.497284 8360 server_base.cc:1034] running on GCE node
I20260809 20:14:45.497833 8360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:14:45.498685 8360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:14:45.499867 8360 hybrid_clock.cc:648] HybridClock initialized: now 1786306485499824 us; error 37 us; skew 500 ppm
I20260809 20:14:45.500111 8360 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:14:45 dist-test-slave-6zbq krb5kdc[7999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306485, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:45.507562 8360 init.cc:377] Logged in from keytab as kudu/127.14.181.2@KRBTEST.COM (short username kudu)
I20260809 20:14:45.508854 8360 webserver.cc:460] Webserver started at http://127.14.181.2:34295/ using document root <none> and password file <none>
I20260809 20:14:45.509593 8360 fs_manager.cc:359] Metadata directory not provided
I20260809 20:14:45.509732 8360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:14:45.510012 8360 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:14:45.512828 8360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/data/instance:
uuid: "951707e4604548e0b4ae1abb91d30820"
format_stamp: "Formatted at 2026-08-09 20:14:45 on dist-test-slave-6zbq"
server_key: "7850959f85ae7ab4f7fd5dce375c7f89"
server_key_iv: "17b774ae9870db928f5abc57ffe5dc52"
server_key_version: "encryptionkey@0"
I20260809 20:14:45.513512 8360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance:
uuid: "951707e4604548e0b4ae1abb91d30820"
format_stamp: "Formatted at 2026-08-09 20:14:45 on dist-test-slave-6zbq"
server_key: "7850959f85ae7ab4f7fd5dce375c7f89"
server_key_iv: "17b774ae9870db928f5abc57ffe5dc52"
server_key_version: "encryptionkey@0"
I20260809 20:14:45.518074 8360 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.002s
I20260809 20:14:45.521137 8382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:45.522257 8360 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:14:45.522428 8360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "951707e4604548e0b4ae1abb91d30820"
format_stamp: "Formatted at 2026-08-09 20:14:45 on dist-test-slave-6zbq"
server_key: "7850959f85ae7ab4f7fd5dce375c7f89"
server_key_iv: "17b774ae9870db928f5abc57ffe5dc52"
server_key_version: "encryptionkey@0"
I20260809 20:14:45.522584 8360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:14:45.542517 8360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:14:45.546212 8360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:14:45.546474 8360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:14:45.547369 8360 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:14:45.548555 8360 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:14:45.548629 8360 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:45.548735 8360 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:14:45.548784 8360 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:45.578408 8360 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:46735
I20260809 20:14:45.578491 8555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:46735 every 8 connection(s)
I20260809 20:14:45.579520 8360 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:14:45.583495 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 8360
I20260809 20:14:45.583663 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance
I20260809 20:14:45.584156 15060 external_mini_cluster.cc:1428] Setting key 527abfb5af84509eddd777e41d7655a3
Aug 09 20:14:45 dist-test-slave-6zbq krb5kdc[7999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306485, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:14:45.598034 8354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:45.581717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:38561 (local address 127.14.181.62:34277)
0809 20:14:45.581870 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:45.581875 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:45.582942 (+ 1067us) server_negotiation.cc:407] Connection header received
0809 20:14:45.584957 (+ 2015us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:45.584966 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:45.585053 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:45.585157 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:45.586897 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:45.587621 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:45.589070 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:45.589464 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:45.589571 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:45.592765 (+ 3194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:45.592771 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:45.592774 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:45.592803 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:45.595199 (+ 2396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:45.595862 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:45.595866 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:45.595868 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:45.595995 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:45.596416 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:45.596420 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:45.596422 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:45.596674 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:45.596803 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:45.597474 (+ 671us) server_negotiation.cc:299] Negotiation successful
0809 20:14:45.597709 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 20:14:45.598863 8559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:45.582114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.2:38561)
0809 20:14:45.582802 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:45.582838 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:45.584658 (+ 1820us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:45.585399 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:45.585409 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:45.586093 (+ 684us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:14:45.586734 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:45.586751 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:45.587758 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:45.587764 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:45.588933 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:45.588945 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:45.589667 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:45.589675 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:45.589954 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:45.590593 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:14:45.590615 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:14:45.592564 (+ 1949us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:14:45.595332 (+ 2768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:45.595340 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:45.595353 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:45.595740 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:45.596119 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:45.596122 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:45.596124 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:45.596301 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:45.596794 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:14:45.596802 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:14:45.597112 (+ 310us) client_negotiation.cc:769] Sending connection context
0809 20:14:45.597330 (+ 218us) client_negotiation.cc:240] Negotiation successful
0809 20:14:45.597780 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":263,"threads_started":1}
I20260809 20:14:45.600134 8556 heartbeater.cc:347] Connected to a master server at 127.14.181.62:34277
I20260809 20:14:45.600423 8556 heartbeater.cc:464] Registering TS with master...
I20260809 20:14:45.601186 8556 heartbeater.cc:511] Master 127.14.181.62:34277 requested a full tablet report, sending...
I20260809 20:14:45.602717 8066 ts_manager.cc:194] Registered new tserver with Master: 951707e4604548e0b4ae1abb91d30820 (127.14.181.2:46735)
I20260809 20:14:45.603751 8066 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.2@KRBTEST.COM'} at 127.14.181.2:38561
WARNING: no policy specified for kudu/127.14.181.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
I20260809 20:14:45.640708 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:0
--local_ip_for_outbound_sockets=127.14.181.3
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:34277
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:14:45.946381 8563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:14:45.946625 8563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:14:45.946738 8563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:14:45.953460 8563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:14:45.953562 8563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:14:45.953708 8563 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:14:45.962639 8563 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:34277
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:14:45.963657 8563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:14:45.964792 8563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:14:45.976529 8575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:45.976616 8571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:14:45.976835 8570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:14:45.977355 8563 server_base.cc:1034] running on GCE node
I20260809 20:14:45.977872 8563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:14:45.978732 8563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:14:45.979930 8563 hybrid_clock.cc:648] HybridClock initialized: now 1786306485979885 us; error 37 us; skew 500 ppm
I20260809 20:14:45.980211 8563 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:14:45 dist-test-slave-6zbq krb5kdc[7999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306485, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:14:45.983098 8563 init.cc:377] Logged in from keytab as kudu/127.14.181.3@KRBTEST.COM (short username kudu)
I20260809 20:14:45.984356 8563 webserver.cc:460] Webserver started at http://127.14.181.3:39583/ using document root <none> and password file <none>
I20260809 20:14:45.984939 8563 fs_manager.cc:359] Metadata directory not provided
I20260809 20:14:45.985060 8563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:14:45.985342 8563 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:14:45.987970 8563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/data/instance:
uuid: "98d26b7cf7f743d7be1a2ec392f9441f"
format_stamp: "Formatted at 2026-08-09 20:14:45 on dist-test-slave-6zbq"
server_key: "1bf48bcbeaf08085a5d6cd606f3a7dbd"
server_key_iv: "b28e3ebab5feea3d2f37d355f5e26482"
server_key_version: "encryptionkey@0"
I20260809 20:14:45.988672 8563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance:
uuid: "98d26b7cf7f743d7be1a2ec392f9441f"
format_stamp: "Formatted at 2026-08-09 20:14:45 on dist-test-slave-6zbq"
server_key: "1bf48bcbeaf08085a5d6cd606f3a7dbd"
server_key_iv: "b28e3ebab5feea3d2f37d355f5e26482"
server_key_version: "encryptionkey@0"
I20260809 20:14:45.993359 8563 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 20:14:45.996502 8584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:45.997668 8563 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 20:14:45.997812 8563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "98d26b7cf7f743d7be1a2ec392f9441f"
format_stamp: "Formatted at 2026-08-09 20:14:45 on dist-test-slave-6zbq"
server_key: "1bf48bcbeaf08085a5d6cd606f3a7dbd"
server_key_iv: "b28e3ebab5feea3d2f37d355f5e26482"
server_key_version: "encryptionkey@0"
I20260809 20:14:45.997993 8563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:14:46.029592 8563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:14:46.033506 8563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:14:46.033746 8563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:14:46.034600 8563 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:14:46.035768 8563 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:14:46.035847 8563 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:46.035965 8563 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:14:46.036018 8563 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:14:46.064555 8563 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:45397
I20260809 20:14:46.064608 8756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:45397 every 8 connection(s)
I20260809 20:14:46.065646 8563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:14:46.070699 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 8563
I20260809 20:14:46.070874 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance
I20260809 20:14:46.071327 15060 external_mini_cluster.cc:1428] Setting key 31dea1e1c0daaaaf8ffce74a45105797
Aug 09 20:14:46 dist-test-slave-6zbq krb5kdc[7999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306485, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:14:46.083307 8354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:46.067779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:32855 (local address 127.14.181.62:34277)
0809 20:14:46.067983 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:46.067990 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:46.069006 (+ 1016us) server_negotiation.cc:407] Connection header received
0809 20:14:46.070739 (+ 1733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:46.070745 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:46.070835 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:46.070947 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:46.072358 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.073278 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.074886 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.075334 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.075440 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:46.078541 (+ 3101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:46.078546 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:46.078550 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:46.078583 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:46.080854 (+ 2271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:46.081490 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:46.081493 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:46.081496 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:46.081622 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:46.081942 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:46.081945 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:46.081946 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:46.082196 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:46.082302 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:46.082907 (+ 605us) server_negotiation.cc:299] Negotiation successful
0809 20:14:46.083061 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 20:14:46.084086 8761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:46.068241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.3:32855)
0809 20:14:46.068855 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:46.068893 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:46.070477 (+ 1584us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:46.071130 (+ 653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:46.071137 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:46.071607 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:14:46.072198 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:46.072224 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.073425 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.073429 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:46.074736 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:46.074749 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.075515 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.075520 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:46.075705 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:46.076250 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:14:46.076287 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:14:46.078324 (+ 2037us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:14:46.080988 (+ 2664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:46.080994 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:46.081004 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:46.081390 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:46.081697 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:14:46.081700 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:14:46.081703 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:14:46.081863 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:14:46.082279 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:14:46.082283 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:14:46.082591 (+ 308us) client_negotiation.cc:769] Sending connection context
0809 20:14:46.082804 (+ 213us) client_negotiation.cc:240] Negotiation successful
0809 20:14:46.083158 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":249,"threads_started":1}
I20260809 20:14:46.085310 8758 heartbeater.cc:347] Connected to a master server at 127.14.181.62:34277
I20260809 20:14:46.085577 8758 heartbeater.cc:464] Registering TS with master...
I20260809 20:14:46.086302 8758 heartbeater.cc:511] Master 127.14.181.62:34277 requested a full tablet report, sending...
I20260809 20:14:46.087561 8066 ts_manager.cc:194] Registered new tserver with Master: 98d26b7cf7f743d7be1a2ec392f9441f (127.14.181.3:45397)
I20260809 20:14:46.088304 8066 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.3@KRBTEST.COM'} at 127.14.181.3:32855
I20260809 20:14:46.097849 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 20:14:46.113858 8354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:46.102495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48928 (local address 127.14.181.62:34277)
0809 20:14:46.102654 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:46.102660 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:46.103124 (+ 464us) server_negotiation.cc:407] Connection header received
0809 20:14:46.103265 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:46.103269 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:46.103336 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:46.103434 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:46.104837 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.105863 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.107241 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.107638 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.107729 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:46.109784 (+ 2055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:46.109788 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:46.109791 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:46.109818 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:46.111924 (+ 2106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:46.112467 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:46.112470 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:46.112472 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:46.112585 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:46.112850 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:46.112852 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:46.112854 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:46.113122 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:46.113297 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:46.113512 (+ 215us) server_negotiation.cc:299] Negotiation successful
0809 20:14:46.113650 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 20:14:46.117197 8066 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48928:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 20:14:46.123659 8066 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 20:14:46.130503 8351 heartbeater.cc:503] Master 127.14.181.62:34277 was elected leader, sending a full tablet report...
I20260809 20:14:46.155133 8783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:46.134138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:43147 (local address 127.0.0.1:58464)
0809 20:14:46.147387 (+ 13249us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:46.147438 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:46.147592 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:46.148510 (+ 918us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:46.148516 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:46.148553 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:14:46.149021 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:46.149039 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.150826 (+ 1787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.150831 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:46.152778 (+ 1947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:46.152790 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.154009 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.154016 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:46.154385 (+ 369us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:46.154445 (+ 60us) client_negotiation.cc:769] Sending connection context
0809 20:14:46.154566 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 20:14:46.154740 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13048,"mutex_wait_us":66,"thread_start_us":15225,"threads_started":1}
I20260809 20:14:46.156000 8780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:46.134429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58464 (local address 127.14.181.1:43147)
0809 20:14:46.146894 (+ 12465us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:46.146902 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:46.147921 (+ 1019us) server_negotiation.cc:407] Connection header received
0809 20:14:46.148010 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:46.148018 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:46.148328 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:46.148485 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:14:46.149231 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.150666 (+ 1435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.152925 (+ 2259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.153803 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.153924 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:46.154146 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:46.155530 (+ 1384us) server_negotiation.cc:299] Negotiation successful
0809 20:14:46.155692 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12309,"thread_start_us":13293,"threads_started":1}
I20260809 20:14:46.157233 8782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:46.134813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:45397 (local address 127.0.0.1:59162)
0809 20:14:46.149228 (+ 14415us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:46.149245 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:46.149355 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:46.149853 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:46.149858 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:46.149884 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:14:46.150224 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:46.150236 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.152081 (+ 1845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.152087 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:46.154828 (+ 2741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:46.154840 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.156450 (+ 1610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.156456 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:46.156610 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:46.156639 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 20:14:46.156728 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 20:14:46.156849 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14279,"mutex_wait_us":61,"thread_start_us":12245,"threads_started":1}
I20260809 20:14:46.157856 8784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:46.135319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55074 (local address 127.14.181.2:46735)
0809 20:14:46.144005 (+ 8686us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:46.144014 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:46.149238 (+ 5224us) server_negotiation.cc:407] Connection header received
0809 20:14:46.149680 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:46.149687 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:46.149884 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:46.150048 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:14:46.150899 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.151995 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.154629 (+ 2634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.155737 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.155816 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:46.155933 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:46.157173 (+ 1240us) server_negotiation.cc:299] Negotiation successful
0809 20:14:46.157417 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8506,"thread_start_us":8369,"threads_started":1}
I20260809 20:14:46.157953 8786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:46.135645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59162 (local address 127.14.181.3:45397)
0809 20:14:46.144472 (+ 8827us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:46.144480 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:46.149312 (+ 4832us) server_negotiation.cc:407] Connection header received
0809 20:14:46.149498 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:46.149503 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:46.149673 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:46.149853 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:14:46.150451 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.151947 (+ 1496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.154982 (+ 3035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.156272 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.156369 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:46.156512 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:46.157520 (+ 1008us) server_negotiation.cc:299] Negotiation successful
0809 20:14:46.157670 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8663,"thread_start_us":8514,"threads_started":1}
I20260809 20:14:46.158437 8778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:46.134557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:46735 (local address 127.0.0.1:55074)
0809 20:14:46.149134 (+ 14577us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:46.149149 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:46.149277 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:46.150274 (+ 997us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:46.150278 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:46.150303 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:14:46.150719 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:46.150732 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.152162 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.152166 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:46.154456 (+ 2290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:46.154474 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.156077 (+ 1603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.156082 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:46.156926 (+ 844us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:46.156965 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 20:14:46.157053 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 20:14:46.157182 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14471,"mutex_wait_us":68,"thread_start_us":14292,"threads_started":1}
I20260809 20:14:46.160135 8244 tablet_service.cc:1467] Processing CreateTablet for tablet b7404db1fc46486c8e4c6e4d83da36e6 (DEFAULT_TABLE table=test-table [id=64c0e8495b0e44ec909a93c851b7355e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:14:46.161665 8244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7404db1fc46486c8e4c6e4d83da36e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:14:46.162858 8461 tablet_service.cc:1467] Processing CreateTablet for tablet b7404db1fc46486c8e4c6e4d83da36e6 (DEFAULT_TABLE table=test-table [id=64c0e8495b0e44ec909a93c851b7355e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:14:46.164121 8461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7404db1fc46486c8e4c6e4d83da36e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:14:46.164844 8662 tablet_service.cc:1467] Processing CreateTablet for tablet b7404db1fc46486c8e4c6e4d83da36e6 (DEFAULT_TABLE table=test-table [id=64c0e8495b0e44ec909a93c851b7355e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:14:46.165838 8662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7404db1fc46486c8e4c6e4d83da36e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:14:46.175935 8787 tablet_bootstrap.cc:492] T b7404db1fc46486c8e4c6e4d83da36e6 P 98d26b7cf7f743d7be1a2ec392f9441f: Bootstrap starting.
I20260809 20:14:46.178894 8789 tablet_bootstrap.cc:492] T b7404db1fc46486c8e4c6e4d83da36e6 P 951707e4604548e0b4ae1abb91d30820: Bootstrap starting.
I20260809 20:14:46.179054 8787 tablet_bootstrap.cc:654] T b7404db1fc46486c8e4c6e4d83da36e6 P 98d26b7cf7f743d7be1a2ec392f9441f: Neither blocks nor log segments found. Creating new log.
I20260809 20:14:46.180150 8788 tablet_bootstrap.cc:492] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12: Bootstrap starting.
I20260809 20:14:46.180761 8787 log.cc:824] T b7404db1fc46486c8e4c6e4d83da36e6 P 98d26b7cf7f743d7be1a2ec392f9441f: Log is configured to *not* fsync() on all Append() calls
I20260809 20:14:46.182026 8789 tablet_bootstrap.cc:654] T b7404db1fc46486c8e4c6e4d83da36e6 P 951707e4604548e0b4ae1abb91d30820: Neither blocks nor log segments found. Creating new log.
I20260809 20:14:46.183216 8789 log.cc:824] T b7404db1fc46486c8e4c6e4d83da36e6 P 951707e4604548e0b4ae1abb91d30820: Log is configured to *not* fsync() on all Append() calls
I20260809 20:14:46.183467 8788 tablet_bootstrap.cc:654] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12: Neither blocks nor log segments found. Creating new log.
I20260809 20:14:46.183938 8787 tablet_bootstrap.cc:492] T b7404db1fc46486c8e4c6e4d83da36e6 P 98d26b7cf7f743d7be1a2ec392f9441f: No bootstrap required, opened a new log
I20260809 20:14:46.184159 8787 ts_tablet_manager.cc:1397] T b7404db1fc46486c8e4c6e4d83da36e6 P 98d26b7cf7f743d7be1a2ec392f9441f: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260809 20:14:46.184571 8788 log.cc:824] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12: Log is configured to *not* fsync() on all Append() calls
I20260809 20:14:46.186055 8789 tablet_bootstrap.cc:492] T b7404db1fc46486c8e4c6e4d83da36e6 P 951707e4604548e0b4ae1abb91d30820: No bootstrap required, opened a new log
I20260809 20:14:46.186307 8789 ts_tablet_manager.cc:1397] T b7404db1fc46486c8e4c6e4d83da36e6 P 951707e4604548e0b4ae1abb91d30820: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260809 20:14:46.186801 8788 tablet_bootstrap.cc:492] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12: No bootstrap required, opened a new log
I20260809 20:14:46.187016 8788 ts_tablet_manager.cc:1397] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260809 20:14:46.193758 8788 raft_consensus.cc:348] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 43147 } } peers { permanent_uuid: "951707e4604548e0b4ae1abb91d30820" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 46735 } } peers { permanent_uuid: "98d26b7cf7f743d7be1a2ec392f9441f" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 45397 } }
I20260809 20:14:46.194056 8788 raft_consensus.cc:374] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:14:46.194152 8788 raft_consensus.cc:729] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4ed6835ecc4df2a9f21d7f9c363c12, State: Initialized, Role: FOLLOWER
I20260809 20:14:46.194105 8787 raft_consensus.cc:348] T b7404db1fc46486c8e4c6e4d83da36e6 P 98d26b7cf7f743d7be1a2ec392f9441f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 43147 } } peers { permanent_uuid: "951707e4604548e0b4ae1abb91d30820" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 46735 } } peers { permanent_uuid: "98d26b7cf7f743d7be1a2ec392f9441f" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 45397 } }
I20260809 20:14:46.194499 8787 raft_consensus.cc:374] T b7404db1fc46486c8e4c6e4d83da36e6 P 98d26b7cf7f743d7be1a2ec392f9441f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:14:46.194597 8787 raft_consensus.cc:729] T b7404db1fc46486c8e4c6e4d83da36e6 P 98d26b7cf7f743d7be1a2ec392f9441f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98d26b7cf7f743d7be1a2ec392f9441f, State: Initialized, Role: FOLLOWER
I20260809 20:14:46.194736 8788 consensus_queue.cc:260] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 43147 } } peers { permanent_uuid: "951707e4604548e0b4ae1abb91d30820" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 46735 } } peers { permanent_uuid: "98d26b7cf7f743d7be1a2ec392f9441f" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 45397 } }
I20260809 20:14:46.195117 8787 consensus_queue.cc:260] T b7404db1fc46486c8e4c6e4d83da36e6 P 98d26b7cf7f743d7be1a2ec392f9441f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 43147 } } peers { permanent_uuid: "951707e4604548e0b4ae1abb91d30820" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 46735 } } peers { permanent_uuid: "98d26b7cf7f743d7be1a2ec392f9441f" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 45397 } }
I20260809 20:14:46.196058 8789 raft_consensus.cc:348] T b7404db1fc46486c8e4c6e4d83da36e6 P 951707e4604548e0b4ae1abb91d30820 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 43147 } } peers { permanent_uuid: "951707e4604548e0b4ae1abb91d30820" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 46735 } } peers { permanent_uuid: "98d26b7cf7f743d7be1a2ec392f9441f" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 45397 } }
I20260809 20:14:46.196332 8788 ts_tablet_manager.cc:1428] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12: Time spent starting tablet: real 0.009s user 0.009s sys 0.000s
I20260809 20:14:46.196458 8789 raft_consensus.cc:374] T b7404db1fc46486c8e4c6e4d83da36e6 P 951707e4604548e0b4ae1abb91d30820 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:14:46.196542 8789 raft_consensus.cc:729] T b7404db1fc46486c8e4c6e4d83da36e6 P 951707e4604548e0b4ae1abb91d30820 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 951707e4604548e0b4ae1abb91d30820, State: Initialized, Role: FOLLOWER
I20260809 20:14:46.197190 8789 consensus_queue.cc:260] T b7404db1fc46486c8e4c6e4d83da36e6 P 951707e4604548e0b4ae1abb91d30820 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 43147 } } peers { permanent_uuid: "951707e4604548e0b4ae1abb91d30820" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 46735 } } peers { permanent_uuid: "98d26b7cf7f743d7be1a2ec392f9441f" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 45397 } }
I20260809 20:14:46.198969 8556 heartbeater.cc:503] Master 127.14.181.62:34277 was elected leader, sending a full tablet report...
I20260809 20:14:46.199596 8789 ts_tablet_manager.cc:1428] T b7404db1fc46486c8e4c6e4d83da36e6 P 951707e4604548e0b4ae1abb91d30820: Time spent starting tablet: real 0.013s user 0.010s sys 0.002s
I20260809 20:14:46.200232 8758 heartbeater.cc:503] Master 127.14.181.62:34277 was elected leader, sending a full tablet report...
I20260809 20:14:46.202014 8787 ts_tablet_manager.cc:1428] T b7404db1fc46486c8e4c6e4d83da36e6 P 98d26b7cf7f743d7be1a2ec392f9441f: Time spent starting tablet: real 0.018s user 0.013s sys 0.004s
I20260809 20:14:46.222858 8793 raft_consensus.cc:482] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:14:46.223058 8793 raft_consensus.cc:504] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 43147 } } peers { permanent_uuid: "951707e4604548e0b4ae1abb91d30820" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 46735 } } peers { permanent_uuid: "98d26b7cf7f743d7be1a2ec392f9441f" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 45397 } }
I20260809 20:14:46.224440 8793 leader_election.cc:288] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 951707e4604548e0b4ae1abb91d30820 (127.14.181.2:46735), 98d26b7cf7f743d7be1a2ec392f9441f (127.14.181.3:45397)
I20260809 20:14:46.232666 8784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:46.224840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:35129 (local address 127.14.181.2:46735)
0809 20:14:46.225007 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:46.225013 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:46.225760 (+ 747us) server_negotiation.cc:407] Connection header received
0809 20:14:46.225886 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:46.225891 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:46.225954 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:46.226029 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:14:46.226814 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.227802 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.230454 (+ 2652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.231648 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.231769 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:46.231837 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:46.232307 (+ 470us) server_negotiation.cc:299] Negotiation successful
0809 20:14:46.232426 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 20:14:46.232677 8786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:46.224871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:40037 (local address 127.14.181.3:45397)
0809 20:14:46.225012 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:46.225017 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:46.225629 (+ 612us) server_negotiation.cc:407] Connection header received
0809 20:14:46.225805 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:46.225808 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:46.225871 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:46.225963 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:14:46.226681 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.227743 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.230454 (+ 2711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.231633 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.231780 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:46.231838 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:46.232307 (+ 469us) server_negotiation.cc:299] Negotiation successful
0809 20:14:46.232426 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 20:14:46.232801 8798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:46.224654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:45397 (local address 127.14.181.1:40037)
0809 20:14:46.225515 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:46.225535 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:46.225679 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:46.225983 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:46.225988 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:46.226015 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:14:46.226535 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:46.226550 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.227863 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.227869 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:46.230311 (+ 2442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:46.230321 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.231841 (+ 1520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.231848 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:46.232131 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:46.232187 (+ 56us) client_negotiation.cc:769] Sending connection context
0809 20:14:46.232272 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 20:14:46.232435 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":738,"mutex_wait_us":169,"thread_start_us":556,"threads_started":1}
I20260809 20:14:46.233145 8801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:46.224768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:46735 (local address 127.14.181.1:35129)
0809 20:14:46.225681 (+ 913us) negotiation.cc:107] Waiting for socket to connect
0809 20:14:46.225696 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:14:46.225793 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:14:46.226037 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:14:46.226041 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:14:46.226061 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:14:46.226648 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:46.226660 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.227910 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.227914 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:46.230286 (+ 2372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:14:46.230306 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.231880 (+ 1574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.231886 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:14:46.232137 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:46.232182 (+ 45us) client_negotiation.cc:769] Sending connection context
0809 20:14:46.232270 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 20:14:46.232435 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":779,"mutex_wait_us":220,"thread_start_us":479,"threads_started":1}
I20260809 20:14:46.233665 8685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7404db1fc46486c8e4c6e4d83da36e6" candidate_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98d26b7cf7f743d7be1a2ec392f9441f" is_pre_election: true
I20260809 20:14:46.234133 8685 raft_consensus.cc:2454] T b7404db1fc46486c8e4c6e4d83da36e6 P 98d26b7cf7f743d7be1a2ec392f9441f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d4ed6835ecc4df2a9f21d7f9c363c12 in term 0.
I20260809 20:14:46.234057 8488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7404db1fc46486c8e4c6e4d83da36e6" candidate_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951707e4604548e0b4ae1abb91d30820" is_pre_election: true
I20260809 20:14:46.234544 8488 raft_consensus.cc:2454] T b7404db1fc46486c8e4c6e4d83da36e6 P 951707e4604548e0b4ae1abb91d30820 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d4ed6835ecc4df2a9f21d7f9c363c12 in term 0.
I20260809 20:14:46.234779 8182 leader_election.cc:302] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4ed6835ecc4df2a9f21d7f9c363c12, 98d26b7cf7f743d7be1a2ec392f9441f; no voters:
I20260809 20:14:46.235129 8793 raft_consensus.cc:2781] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:14:46.235262 8793 raft_consensus.cc:482] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:14:46.235363 8793 raft_consensus.cc:3037] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:14:46.237437 8793 raft_consensus.cc:504] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 43147 } } peers { permanent_uuid: "951707e4604548e0b4ae1abb91d30820" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 46735 } } peers { permanent_uuid: "98d26b7cf7f743d7be1a2ec392f9441f" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 45397 } }
I20260809 20:14:46.237965 8793 leader_election.cc:288] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [CANDIDATE]: Term 1 election: Requested vote from peers 951707e4604548e0b4ae1abb91d30820 (127.14.181.2:46735), 98d26b7cf7f743d7be1a2ec392f9441f (127.14.181.3:45397)
I20260809 20:14:46.238291 8488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7404db1fc46486c8e4c6e4d83da36e6" candidate_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951707e4604548e0b4ae1abb91d30820"
I20260809 20:14:46.238430 8685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7404db1fc46486c8e4c6e4d83da36e6" candidate_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98d26b7cf7f743d7be1a2ec392f9441f"
I20260809 20:14:46.238479 8488 raft_consensus.cc:3037] T b7404db1fc46486c8e4c6e4d83da36e6 P 951707e4604548e0b4ae1abb91d30820 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:14:46.238608 8685 raft_consensus.cc:3037] T b7404db1fc46486c8e4c6e4d83da36e6 P 98d26b7cf7f743d7be1a2ec392f9441f [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:14:46.240463 8488 raft_consensus.cc:2454] T b7404db1fc46486c8e4c6e4d83da36e6 P 951707e4604548e0b4ae1abb91d30820 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4ed6835ecc4df2a9f21d7f9c363c12 in term 1.
I20260809 20:14:46.240553 8685 raft_consensus.cc:2454] T b7404db1fc46486c8e4c6e4d83da36e6 P 98d26b7cf7f743d7be1a2ec392f9441f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4ed6835ecc4df2a9f21d7f9c363c12 in term 1.
I20260809 20:14:46.240793 8186 leader_election.cc:302] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4ed6835ecc4df2a9f21d7f9c363c12, 951707e4604548e0b4ae1abb91d30820; no voters:
I20260809 20:14:46.241043 8793 raft_consensus.cc:2781] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:14:46.241434 8793 raft_consensus.cc:686] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [term 1 LEADER]: Becoming Leader. State: Replica: 4d4ed6835ecc4df2a9f21d7f9c363c12, State: Running, Role: LEADER
I20260809 20:14:46.241843 8793 consensus_queue.cc:237] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 43147 } } peers { permanent_uuid: "951707e4604548e0b4ae1abb91d30820" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 46735 } } peers { permanent_uuid: "98d26b7cf7f743d7be1a2ec392f9441f" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 45397 } }
I20260809 20:14:46.245486 8063 catalog_manager.cc:5495] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d4ed6835ecc4df2a9f21d7f9c363c12 (127.14.181.1). New cstate: current_term: 1 leader_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 43147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "951707e4604548e0b4ae1abb91d30820" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 46735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98d26b7cf7f743d7be1a2ec392f9441f" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 45397 } health_report { overall_health: UNKNOWN } } }
I20260809 20:14:46.265806 8780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:46.260665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58476 (local address 127.14.181.1:43147)
0809 20:14:46.260841 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:46.260847 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:46.260923 (+ 76us) server_negotiation.cc:407] Connection header received
0809 20:14:46.261140 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:46.261143 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:46.261208 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:46.261320 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:14:46.261707 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.262396 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.263879 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.264281 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.264382 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:46.264861 (+ 479us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:14:46.265291 (+ 430us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:14:46.265420 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:46.265520 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 20:14:46.265592 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 20:14:46.272334 8488 raft_consensus.cc:1261] T b7404db1fc46486c8e4c6e4d83da36e6 P 951707e4604548e0b4ae1abb91d30820 [term 1 FOLLOWER]: Refusing update from remote peer 4d4ed6835ecc4df2a9f21d7f9c363c12: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:14:46.272333 8685 raft_consensus.cc:1261] T b7404db1fc46486c8e4c6e4d83da36e6 P 98d26b7cf7f743d7be1a2ec392f9441f [term 1 FOLLOWER]: Refusing update from remote peer 4d4ed6835ecc4df2a9f21d7f9c363c12: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:14:46.273108 8802 consensus_queue.cc:1035] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98d26b7cf7f743d7be1a2ec392f9441f" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 45397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:14:46.273396 8793 consensus_queue.cc:1035] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "951707e4604548e0b4ae1abb91d30820" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 46735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:14:46.285969 8806 mvcc.cc:205] Tried to move back new op lower bound from 7316711367764127744 to 7316711367649992704. Current Snapshot: MvccSnapshot[applied={T|T < 7316711367764127744}]
I20260809 20:14:46.299324 8066 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48928:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:14:46.299568 8066 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48928:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:14:46.303004 8066 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4: Sending DeleteTablet for 3 replicas of tablet b7404db1fc46486c8e4c6e4d83da36e6
I20260809 20:14:46.304054 8244 tablet_service.cc:1514] Processing DeleteTablet for tablet b7404db1fc46486c8e4c6e4d83da36e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:14:46 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:58464
I20260809 20:14:46.304049 8461 tablet_service.cc:1514] Processing DeleteTablet for tablet b7404db1fc46486c8e4c6e4d83da36e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:14:46 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:55074
I20260809 20:14:46.306038 8662 tablet_service.cc:1514] Processing DeleteTablet for tablet b7404db1fc46486c8e4c6e4d83da36e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:14:46 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:59162
I20260809 20:14:46.306529 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 8156
I20260809 20:14:46.320127 8823 tablet_replica.cc:330] T b7404db1fc46486c8e4c6e4d83da36e6 P 951707e4604548e0b4ae1abb91d30820: stopping tablet replica
I20260809 20:14:46.321524 8821 tablet_replica.cc:330] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12: stopping tablet replica
I20260809 20:14:46.321949 8821 raft_consensus.cc:2229] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [term 1 LEADER]: Raft consensus shutting down.
I20260809 20:14:46.322003 8823 raft_consensus.cc:2229] T b7404db1fc46486c8e4c6e4d83da36e6 P 951707e4604548e0b4ae1abb91d30820 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:14:46.322499 8824 tablet_replica.cc:330] T b7404db1fc46486c8e4c6e4d83da36e6 P 98d26b7cf7f743d7be1a2ec392f9441f: stopping tablet replica
I20260809 20:14:46.322675 8821 raft_consensus.cc:2258] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:14:46.322863 8824 raft_consensus.cc:2229] T b7404db1fc46486c8e4c6e4d83da36e6 P 98d26b7cf7f743d7be1a2ec392f9441f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:14:46.323104 8823 raft_consensus.cc:2258] T b7404db1fc46486c8e4c6e4d83da36e6 P 951707e4604548e0b4ae1abb91d30820 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:14:46.323940 8824 raft_consensus.cc:2258] T b7404db1fc46486c8e4c6e4d83da36e6 P 98d26b7cf7f743d7be1a2ec392f9441f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:14:46.325868 8821 ts_tablet_manager.cc:1905] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:14:46.326049 8824 ts_tablet_manager.cc:1905] T b7404db1fc46486c8e4c6e4d83da36e6 P 98d26b7cf7f743d7be1a2ec392f9441f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:14:46.326903 8823 ts_tablet_manager.cc:1905] T b7404db1fc46486c8e4c6e4d83da36e6 P 951707e4604548e0b4ae1abb91d30820: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 20:14:46 dist-test-slave-6zbq krb5kdc[7999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306484, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.1@KRBTEST.COM
I20260809 20:14:46.332825 8824 ts_tablet_manager.cc:1918] T b7404db1fc46486c8e4c6e4d83da36e6 P 98d26b7cf7f743d7be1a2ec392f9441f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:14:46.332968 8824 log.cc:1196] T b7404db1fc46486c8e4c6e4d83da36e6 P 98d26b7cf7f743d7be1a2ec392f9441f: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/wal/wals/b7404db1fc46486c8e4c6e4d83da36e6
I20260809 20:14:46.333117 8821 ts_tablet_manager.cc:1918] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:14:46.333309 8821 log.cc:1196] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/wal/wals/b7404db1fc46486c8e4c6e4d83da36e6
I20260809 20:14:46.333451 8824 ts_tablet_manager.cc:1939] T b7404db1fc46486c8e4c6e4d83da36e6 P 98d26b7cf7f743d7be1a2ec392f9441f: Deleting consensus metadata
I20260809 20:14:46.333954 8821 ts_tablet_manager.cc:1939] T b7404db1fc46486c8e4c6e4d83da36e6 P 4d4ed6835ecc4df2a9f21d7f9c363c12: Deleting consensus metadata
I20260809 20:14:46.335136 8041 catalog_manager.cc:4841] TS 98d26b7cf7f743d7be1a2ec392f9441f (127.14.181.3:45397): tablet b7404db1fc46486c8e4c6e4d83da36e6 (table test-table [id=64c0e8495b0e44ec909a93c851b7355e]) successfully deleted
I20260809 20:14:46.335575 8042 catalog_manager.cc:4841] TS 4d4ed6835ecc4df2a9f21d7f9c363c12 (127.14.181.1:43147): tablet b7404db1fc46486c8e4c6e4d83da36e6 (table test-table [id=64c0e8495b0e44ec909a93c851b7355e]) successfully deleted
I20260809 20:14:46.338482 8823 ts_tablet_manager.cc:1918] T b7404db1fc46486c8e4c6e4d83da36e6 P 951707e4604548e0b4ae1abb91d30820: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:14:46.338625 8823 log.cc:1196] T b7404db1fc46486c8e4c6e4d83da36e6 P 951707e4604548e0b4ae1abb91d30820: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/wal/wals/b7404db1fc46486c8e4c6e4d83da36e6
I20260809 20:14:46.339017 8823 ts_tablet_manager.cc:1939] T b7404db1fc46486c8e4c6e4d83da36e6 P 951707e4604548e0b4ae1abb91d30820: Deleting consensus metadata
I20260809 20:14:46.340394 8043 catalog_manager.cc:4841] TS 951707e4604548e0b4ae1abb91d30820 (127.14.181.2:46735): tablet b7404db1fc46486c8e4c6e4d83da36e6 (table test-table [id=64c0e8495b0e44ec909a93c851b7355e]) successfully deleted
I20260809 20:14:46.342447 8780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:46.307645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58482 (local address 127.14.181.1:43147)
0809 20:14:46.307833 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:46.307840 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:46.313494 (+ 5654us) server_negotiation.cc:407] Connection header received
0809 20:14:46.314423 (+ 929us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:46.314429 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:46.314515 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:46.314587 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:46.318672 (+ 4085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.320074 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.323811 (+ 3737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.324487 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.324591 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:46.335840 (+ 11249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:46.335853 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:46.335868 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:46.335919 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:46.339568 (+ 3649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:46.340376 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:46.340382 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:46.340385 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:46.340546 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:46.340906 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:46.340915 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:46.340918 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:46.341271 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:46.341549 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:46.341876 (+ 327us) server_negotiation.cc:299] Negotiation successful
0809 20:14:46.342093 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 20:14:46.343158 8345 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:14:46.437657 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 8156
I20260809 20:14:46.456795 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 8360
Aug 09 20:14:46 dist-test-slave-6zbq krb5kdc[7999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306484, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.2@KRBTEST.COM
I20260809 20:14:46.471184 8784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:46.457473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55084 (local address 127.14.181.2:46735)
0809 20:14:46.457659 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:46.457665 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:46.457685 (+ 20us) server_negotiation.cc:407] Connection header received
0809 20:14:46.457834 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:46.457839 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:46.457906 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:46.458003 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:46.459372 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.460099 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.461513 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.461908 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.462016 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:46.466068 (+ 4052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:46.466083 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:46.466098 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:46.466134 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:46.468548 (+ 2414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:46.469191 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:46.469198 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:46.469201 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:46.469324 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:46.469676 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:46.469680 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:46.469682 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:46.470044 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:46.470330 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:46.470660 (+ 330us) server_negotiation.cc:299] Negotiation successful
0809 20:14:46.470862 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 20:14:46.471788 8549 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:14:46.560271 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 8360
I20260809 20:14:46.578976 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 8563
Aug 09 20:14:46 dist-test-slave-6zbq krb5kdc[7999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306484, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.3@KRBTEST.COM
I20260809 20:14:46.593065 8786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:14:46.579703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59168 (local address 127.14.181.3:45397)
0809 20:14:46.579878 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 20:14:46.579883 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:14:46.579900 (+ 17us) server_negotiation.cc:407] Connection header received
0809 20:14:46.579985 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:14:46.579989 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:14:46.580052 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:14:46.580150 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:14:46.581405 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.582164 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.583483 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:14:46.583904 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:14:46.584006 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:14:46.588179 (+ 4173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:14:46.588198 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:14:46.588215 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:14:46.588251 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:14:46.590876 (+ 2625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:46.591462 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:46.591468 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:46.591471 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:46.591594 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:14:46.591863 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:14:46.591866 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:14:46.591867 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:14:46.592208 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:14:46.592431 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0809 20:14:46.592607 (+ 176us) server_negotiation.cc:299] Negotiation successful
0809 20:14:46.592761 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 20:14:46.593688 8751 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:14:46.681717 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 8563
I20260809 20:14:46.702440 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 8021
I20260809 20:14:46.703548 8113 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:14:46.809348 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 8021
I20260809 20:15:06.836889 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:34277
--webserver_interface=127.14.181.62
--webserver_port=44143
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:34277
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:15:07.155326 8835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:15:07.155587 8835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:15:07.155725 8835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:15:07.162668 8835 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 20:15:07.162756 8835 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 20:15:07.162812 8835 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 20:15:07.162883 8835 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:15:07.162957 8835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:15:07.163050 8835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:15:07.163110 8835 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:15:07.163183 8835 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:15:07.172308 8835 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:34277
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:34277
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=44143
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:15:07.173354 8835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:15:07.174551 8835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:15:07.196677 8846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:07.196755 8849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:07.196710 8847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:15:07.197569 8835 server_base.cc:1034] running on GCE node
I20260809 20:15:07.198390 8835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:15:07.199843 8835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:15:07.201107 8835 hybrid_clock.cc:648] HybridClock initialized: now 1786306507201027 us; error 34 us; skew 500 ppm
I20260809 20:15:07.201470 8835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:15:07 dist-test-slave-6zbq krb5kdc[7999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306507, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:15:07.209321 8835 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:15:07.210929 8835 webserver.cc:460] Webserver started at http://127.14.181.62:44143/ using document root <none> and password file <none>
I20260809 20:15:07.211632 8835 fs_manager.cc:359] Metadata directory not provided
I20260809 20:15:07.211731 8835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:15:07.217231 8835 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 20:15:07.219949 8857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:07.221242 8835 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 20:15:07.221410 8835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "2950368f271942b0b719dddf2f9438b4"
format_stamp: "Formatted at 2026-08-09 20:14:44 on dist-test-slave-6zbq"
server_key: "07b88106491f31fa1462a9ced654115f"
server_key_iv: "02adb96c78dab0e4c495af6574a0b7b2"
server_key_version: "encryptionkey@0"
I20260809 20:15:07.222446 8835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:15:07.245316 8835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:15:07.249483 8835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:15:07.249752 8835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:15:07.267450 8835 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:34277
I20260809 20:15:07.267481 8943 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:34277 every 8 connection(s)
I20260809 20:15:07.268851 8835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:15:07.271672 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 8835
I20260809 20:15:07.272454 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:43147
--local_ip_for_outbound_sockets=127.14.181.1
--tserver_master_addrs=127.14.181.62:34277
--webserver_port=44681
--webserver_interface=127.14.181.1
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 20:15:07.276081 8944 sys_catalog.cc:263] Verifying existing consensus state
I20260809 20:15:07.279294 8944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4: Bootstrap starting.
I20260809 20:15:07.298483 8944 log.cc:824] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4: Log is configured to *not* fsync() on all Append() calls
I20260809 20:15:07.310281 8944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 20:15:07.310791 8944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4: Bootstrap complete.
I20260809 20:15:07.319435 8944 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2950368f271942b0b719dddf2f9438b4" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 34277 } }
I20260809 20:15:07.320227 8944 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2950368f271942b0b719dddf2f9438b4, State: Initialized, Role: FOLLOWER
I20260809 20:15:07.320771 8944 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2950368f271942b0b719dddf2f9438b4" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 34277 } }
I20260809 20:15:07.320995 8944 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:15:07.321126 8944 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:15:07.321288 8944 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [term 1 FOLLOWER]: Advancing to term 2
I20260809 20:15:07.324904 8944 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2950368f271942b0b719dddf2f9438b4" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 34277 } }
I20260809 20:15:07.325376 8944 leader_election.cc:302] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2950368f271942b0b719dddf2f9438b4; no voters:
I20260809 20:15:07.325956 8944 leader_election.cc:288] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 20:15:07.326081 8954 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 20:15:07.327265 8954 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [term 2 LEADER]: Becoming Leader. State: Replica: 2950368f271942b0b719dddf2f9438b4, State: Running, Role: LEADER
I20260809 20:15:07.327814 8954 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2950368f271942b0b719dddf2f9438b4" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 34277 } }
I20260809 20:15:07.328142 8944 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:15:07.330086 8955 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "2950368f271942b0b719dddf2f9438b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2950368f271942b0b719dddf2f9438b4" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 34277 } } }
I20260809 20:15:07.330462 8955 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [sys.catalog]: This master's current role is: LEADER
I20260809 20:15:07.332026 8959 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:15:07.331858 8956 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2950368f271942b0b719dddf2f9438b4. Latest consensus state: current_term: 2 leader_uuid: "2950368f271942b0b719dddf2f9438b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2950368f271942b0b719dddf2f9438b4" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 34277 } } }
I20260809 20:15:07.332607 8956 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [sys.catalog]: This master's current role is: LEADER
I20260809 20:15:07.340731 8959 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:15:07.342108 8959 catalog_manager.cc:1259] Loaded cluster ID: 9dae74d05cb94e2cbb46109817b32cf0
I20260809 20:15:07.342356 8959 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:15:07.346307 8959 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:15:07.347877 8959 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4: Loaded TSK: 0
I20260809 20:15:07.377745 8983 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 20:15:07.379637 8959 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4: Generated new TSK 1
I20260809 20:15:07.379989 8959 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 20:15:07.605104 8950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:15:07.605366 8950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:15:07.605502 8950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:15:07.612524 8950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:15:07.612630 8950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:15:07.612775 8950 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:15:07.621973 8950 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:43147
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=44681
--tserver_master_addrs=127.14.181.62:34277
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:15:07.623077 8950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:15:07.624248 8950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:15:07.638562 8993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:07.638801 8989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:07.639113 8991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:15:07.639533 8950 server_base.cc:1034] running on GCE node
I20260809 20:15:07.640107 8950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:15:07.641013 8950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:15:07.642243 8950 hybrid_clock.cc:648] HybridClock initialized: now 1786306507642178 us; error 53 us; skew 500 ppm
I20260809 20:15:07.642551 8950 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:15:07 dist-test-slave-6zbq krb5kdc[7999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306507, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:15:07.645469 8950 init.cc:377] Logged in from keytab as kudu/127.14.181.1@KRBTEST.COM (short username kudu)
I20260809 20:15:07.646981 8950 webserver.cc:460] Webserver started at http://127.14.181.1:44681/ using document root <none> and password file <none>
I20260809 20:15:07.647603 8950 fs_manager.cc:359] Metadata directory not provided
I20260809 20:15:07.647732 8950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:15:07.652752 8950 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 20:15:07.655287 9006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:07.656545 8950 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 20:15:07.656704 8950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12"
format_stamp: "Formatted at 2026-08-09 20:14:45 on dist-test-slave-6zbq"
server_key: "b64d587bbe654d4e22c732153dac6618"
server_key_iv: "84a146044467ae28ebcbabf4f30ce80c"
server_key_version: "encryptionkey@0"
I20260809 20:15:07.657583 8950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:15:07.680716 8950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:15:07.684494 8950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:15:07.684727 8950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:15:07.685588 8950 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:15:07.686836 8950 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:15:07.686925 8950 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:07.687022 8950 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:15:07.687091 8950 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:07.716662 8950 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:43147
I20260809 20:15:07.716744 9181 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:43147 every 8 connection(s)
I20260809 20:15:07.717917 8950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:15:07.728114 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 8950
I20260809 20:15:07.728881 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:46735
--local_ip_for_outbound_sockets=127.14.181.2
--tserver_master_addrs=127.14.181.62:34277
--webserver_port=34295
--webserver_interface=127.14.181.2
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 20:15:07 dist-test-slave-6zbq krb5kdc[7999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306507, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:15:07.740110 9188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:07.720825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.1:42553)
0809 20:15:07.721627 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:07.721670 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:07.723348 (+ 1678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:07.724479 (+ 1131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:07.724485 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:07.724936 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:15:07.725426 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:07.725443 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:07.727023 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:07.727028 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:07.728711 (+ 1683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:07.728727 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:07.729879 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:07.729886 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:07.730152 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:07.730791 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:15:07.730817 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:15:07.733027 (+ 2210us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:15:07.736249 (+ 3222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:15:07.736257 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:15:07.736270 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:15:07.736644 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:15:07.737058 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:15:07.737063 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:15:07.737068 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:15:07.737254 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:15:07.737911 (+ 657us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:15:07.737919 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:15:07.738199 (+ 280us) client_negotiation.cc:769] Sending connection context
0809 20:15:07.738472 (+ 273us) client_negotiation.cc:240] Negotiation successful
0809 20:15:07.738931 (+ 459us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":335,"threads_started":1}
I20260809 20:15:07.740111 9187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:07.720561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:42553 (local address 127.14.181.62:34277)
0809 20:15:07.721113 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:07.721127 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:07.721787 (+ 660us) server_negotiation.cc:407] Connection header received
0809 20:15:07.723782 (+ 1995us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:07.723795 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:07.724079 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:07.724358 (+ 279us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:07.725578 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:07.726884 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:07.728843 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:07.729664 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:07.729791 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:07.733292 (+ 3501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:07.733300 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:07.733312 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:15:07.733346 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:07.736106 (+ 2760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:07.736781 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:07.736787 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:07.736792 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:07.736943 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:07.737366 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:07.737369 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:07.737371 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:07.737773 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:07.737949 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:07.738689 (+ 740us) server_negotiation.cc:299] Negotiation successful
0809 20:15:07.739061 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":306,"threads_started":1}
I20260809 20:15:07.742861 9182 heartbeater.cc:347] Connected to a master server at 127.14.181.62:34277
I20260809 20:15:07.743120 9182 heartbeater.cc:464] Registering TS with master...
I20260809 20:15:07.743738 9182 heartbeater.cc:511] Master 127.14.181.62:34277 requested a full tablet report, sending...
I20260809 20:15:07.745711 8881 ts_manager.cc:194] Registered new tserver with Master: 4d4ed6835ecc4df2a9f21d7f9c363c12 (127.14.181.1:43147)
I20260809 20:15:07.747150 8881 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.1@KRBTEST.COM'} at 127.14.181.1:42553
W20260809 20:15:08.041524 9189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:15:08.041764 9189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:15:08.041893 9189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:15:08.048834 9189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:15:08.048933 9189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:15:08.049103 9189 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:15:08.058171 9189 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:46735
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=34295
--tserver_master_addrs=127.14.181.62:34277
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:15:08.059266 9189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:15:08.060472 9189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:15:08.072387 9196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:08.072446 9197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:08.072888 9199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:15:08.073158 9189 server_base.cc:1034] running on GCE node
I20260809 20:15:08.073721 9189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:15:08.074586 9189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:15:08.075791 9189 hybrid_clock.cc:648] HybridClock initialized: now 1786306508075757 us; error 29 us; skew 500 ppm
I20260809 20:15:08.076076 9189 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:15:08 dist-test-slave-6zbq krb5kdc[7999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306508, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:15:08.078944 9189 init.cc:377] Logged in from keytab as kudu/127.14.181.2@KRBTEST.COM (short username kudu)
I20260809 20:15:08.080178 9189 webserver.cc:460] Webserver started at http://127.14.181.2:34295/ using document root <none> and password file <none>
I20260809 20:15:08.080776 9189 fs_manager.cc:359] Metadata directory not provided
I20260809 20:15:08.080902 9189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:15:08.085836 9189 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 20:15:08.088352 9210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:08.089485 9189 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 20:15:08.089638 9189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "951707e4604548e0b4ae1abb91d30820"
format_stamp: "Formatted at 2026-08-09 20:14:45 on dist-test-slave-6zbq"
server_key: "7850959f85ae7ab4f7fd5dce375c7f89"
server_key_iv: "17b774ae9870db928f5abc57ffe5dc52"
server_key_version: "encryptionkey@0"
I20260809 20:15:08.090564 9189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:15:08.104681 9189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:15:08.108110 9189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:15:08.108340 9189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:15:08.109187 9189 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:15:08.110417 9189 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:15:08.110509 9189 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:08.110617 9189 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:15:08.110692 9189 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:08.140199 9189 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:46735
I20260809 20:15:08.140264 9381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:46735 every 8 connection(s)
I20260809 20:15:08.141496 9189 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:15:08.145678 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 9189
I20260809 20:15:08.146454 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:45397
--local_ip_for_outbound_sockets=127.14.181.3
--tserver_master_addrs=127.14.181.62:34277
--webserver_port=39583
--webserver_interface=127.14.181.3
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 20:15:08 dist-test-slave-6zbq krb5kdc[7999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306508, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:15:08.161796 9187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:08.143732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:53707 (local address 127.14.181.62:34277)
0809 20:15:08.143911 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:08.143916 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:08.144958 (+ 1042us) server_negotiation.cc:407] Connection header received
0809 20:15:08.147275 (+ 2317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:08.147280 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:08.147349 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:08.147432 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:08.149255 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.149964 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.151955 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.152387 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.152483 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:08.156099 (+ 3616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:08.156104 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:08.156108 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:15:08.156140 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:08.158623 (+ 2483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:08.159407 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:08.159412 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:08.159414 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:08.159539 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:08.160006 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:08.160009 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:08.160011 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:08.160293 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:08.160420 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:08.161342 (+ 922us) server_negotiation.cc:299] Negotiation successful
0809 20:15:08.161527 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 20:15:08.162859 9384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:08.144142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.2:53707)
0809 20:15:08.144805 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:08.144840 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:08.146999 (+ 2159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:08.147701 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:08.147711 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:08.148356 (+ 645us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:15:08.149053 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:08.149076 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.150135 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.150139 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:08.151810 (+ 1671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:08.151825 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.152612 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.152618 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:08.152878 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:08.153501 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:15:08.153527 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:15:08.155870 (+ 2343us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:15:08.158757 (+ 2887us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:15:08.158765 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:15:08.158778 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:15:08.159273 (+ 495us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:15:08.159644 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:15:08.159648 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:15:08.159652 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:15:08.159904 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:15:08.160423 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:15:08.160431 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:15:08.160879 (+ 448us) client_negotiation.cc:769] Sending connection context
0809 20:15:08.161176 (+ 297us) client_negotiation.cc:240] Negotiation successful
0809 20:15:08.161624 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":252,"threads_started":1}
I20260809 20:15:08.164212 9382 heartbeater.cc:347] Connected to a master server at 127.14.181.62:34277
I20260809 20:15:08.164484 9382 heartbeater.cc:464] Registering TS with master...
I20260809 20:15:08.165107 9382 heartbeater.cc:511] Master 127.14.181.62:34277 requested a full tablet report, sending...
I20260809 20:15:08.166460 8881 ts_manager.cc:194] Registered new tserver with Master: 951707e4604548e0b4ae1abb91d30820 (127.14.181.2:46735)
I20260809 20:15:08.167253 8881 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.2@KRBTEST.COM'} at 127.14.181.2:53707
W20260809 20:15:08.465415 9387 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:15:08.465653 9387 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:15:08.465781 9387 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:15:08.472889 9387 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:15:08.472986 9387 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:15:08.473150 9387 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:15:08.482306 9387 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:45397
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=39583
--tserver_master_addrs=127.14.181.62:34277
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:15:08.483371 9387 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:15:08.484496 9387 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:15:08.496305 9396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:08.496426 9397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:08.496451 9399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:15:08.497402 9387 server_base.cc:1034] running on GCE node
I20260809 20:15:08.497915 9387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:15:08.498783 9387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:15:08.499967 9387 hybrid_clock.cc:648] HybridClock initialized: now 1786306508499913 us; error 53 us; skew 500 ppm
I20260809 20:15:08.500262 9387 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:15:08 dist-test-slave-6zbq krb5kdc[7999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306508, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:15:08.503173 9387 init.cc:377] Logged in from keytab as kudu/127.14.181.3@KRBTEST.COM (short username kudu)
I20260809 20:15:08.504603 9387 webserver.cc:460] Webserver started at http://127.14.181.3:39583/ using document root <none> and password file <none>
I20260809 20:15:08.505203 9387 fs_manager.cc:359] Metadata directory not provided
I20260809 20:15:08.505331 9387 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:15:08.510128 9387 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 20:15:08.512558 9411 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:08.513772 9387 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 20:15:08.513927 9387 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "98d26b7cf7f743d7be1a2ec392f9441f"
format_stamp: "Formatted at 2026-08-09 20:14:45 on dist-test-slave-6zbq"
server_key: "1bf48bcbeaf08085a5d6cd606f3a7dbd"
server_key_iv: "b28e3ebab5feea3d2f37d355f5e26482"
server_key_version: "encryptionkey@0"
I20260809 20:15:08.514882 9387 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:15:08.533787 9387 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:15:08.537566 9387 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:15:08.537798 9387 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:15:08.538681 9387 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:15:08.539876 9387 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:15:08.539968 9387 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:08.540076 9387 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:15:08.540146 9387 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:08.571645 9387 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:45397
I20260809 20:15:08.571704 9578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:45397 every 8 connection(s)
I20260809 20:15:08.572885 9387 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:15:08.574321 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 9387
Aug 09 20:15:08 dist-test-slave-6zbq krb5kdc[7999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306508, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:15:08.590394 9187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:08.575313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38528 (local address 127.14.181.62:34277)
0809 20:15:08.575499 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:08.575507 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:08.576365 (+ 858us) server_negotiation.cc:407] Connection header received
0809 20:15:08.576547 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:08.576551 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:08.576614 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:08.576696 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:08.578366 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.579219 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.580653 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.581152 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.581261 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:08.583981 (+ 2720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:08.583986 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:08.583989 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:15:08.584020 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:08.587643 (+ 3623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:08.588425 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:08.588430 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:08.588434 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:08.588594 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:08.588939 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:08.588944 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:08.588947 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:08.589266 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:08.589454 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:08.589808 (+ 354us) server_negotiation.cc:299] Negotiation successful
0809 20:15:08.590011 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":64}
I20260809 20:15:08.592144 9586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:08.575347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:47719 (local address 127.14.181.62:34277)
0809 20:15:08.575826 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:08.575832 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:08.576696 (+ 864us) server_negotiation.cc:407] Connection header received
0809 20:15:08.578453 (+ 1757us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:08.578459 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:08.578529 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:08.578636 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:08.579952 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.580701 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.582300 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.582794 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.582902 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:08.585946 (+ 3044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:08.585953 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:08.585958 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:15:08.586013 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:08.589095 (+ 3082us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:08.589865 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:08.589870 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:08.589873 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:08.589992 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:08.590441 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:08.590446 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:08.590449 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:08.590725 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:08.590866 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:08.591599 (+ 733us) server_negotiation.cc:299] Negotiation successful
0809 20:15:08.591812 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":394,"thread_start_us":267,"threads_started":1}
I20260809 20:15:08.593000 9587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:08.575784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.3:47719)
0809 20:15:08.576536 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:08.576577 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:08.578206 (+ 1629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:08.578825 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:08.578832 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:08.579273 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:15:08.579779 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:08.579796 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.580848 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.580851 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:08.582158 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:08.582171 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.583013 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.583021 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:08.583222 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:08.583754 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:15:08.583781 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:15:08.585705 (+ 1924us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:15:08.589219 (+ 3514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:15:08.589226 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:15:08.589237 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:15:08.589756 (+ 519us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:15:08.590113 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:15:08.590117 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:15:08.590120 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:15:08.590321 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:15:08.590857 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:15:08.590865 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:15:08.591216 (+ 351us) client_negotiation.cc:769] Sending connection context
0809 20:15:08.591517 (+ 301us) client_negotiation.cc:240] Negotiation successful
0809 20:15:08.591934 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":317,"threads_started":1}
I20260809 20:15:08.594323 9579 heartbeater.cc:347] Connected to a master server at 127.14.181.62:34277
I20260809 20:15:08.594619 9579 heartbeater.cc:464] Registering TS with master...
I20260809 20:15:08.595292 9579 heartbeater.cc:511] Master 127.14.181.62:34277 requested a full tablet report, sending...
I20260809 20:15:08.596555 8881 ts_manager.cc:194] Registered new tserver with Master: 98d26b7cf7f743d7be1a2ec392f9441f (127.14.181.3:45397)
I20260809 20:15:08.597311 8881 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.3@KRBTEST.COM'} at 127.14.181.3:47719
I20260809 20:15:08.605257 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 20:15:08.612536 9586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:08.606129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38530 (local address 127.14.181.62:34277)
0809 20:15:08.607233 (+ 1104us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:08.607238 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:08.607256 (+ 18us) server_negotiation.cc:407] Connection header received
0809 20:15:08.607351 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:08.607356 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:08.607519 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:08.607668 (+ 149us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:15:08.608129 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.609097 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.610958 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.611356 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.611444 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:08.611829 (+ 385us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:15:08.612054 (+ 225us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0809 20:15:08.612312 (+ 258us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38530: token expired
Metrics: {"server-negotiator.queue_time_us":975}
W20260809 20:15:08.612653 9586 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38530: token expired
W20260809 20:15:08.613212 8763 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.14.181.62:34277)
I20260809 20:15:08.624289 9586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:08.613658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38542 (local address 127.14.181.62:34277)
0809 20:15:08.613813 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:08.613816 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:08.613831 (+ 15us) server_negotiation.cc:407] Connection header received
0809 20:15:08.613919 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:08.613922 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:08.613968 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:08.614036 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:08.615256 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.615893 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.617089 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.617502 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.617588 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:08.620018 (+ 2430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:08.620023 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:08.620026 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:15:08.620052 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:08.622159 (+ 2107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:08.622772 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:08.622777 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:08.622779 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:08.622883 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:08.623166 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:08.623169 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:08.623171 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:08.623425 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:08.623609 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:08.623874 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 20:15:08.624011 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 20:15:08.627213 8881 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38542:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 20:15:08.634335 8881 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 20:15:08.671265 9604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:08.646231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36428 (local address 127.14.181.1:43147)
0809 20:15:08.661756 (+ 15525us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:08.661766 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:08.663546 (+ 1780us) server_negotiation.cc:407] Connection header received
0809 20:15:08.663629 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:08.663635 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:08.663810 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:08.663968 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:15:08.664603 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.665926 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.668967 (+ 3041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.670058 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.670138 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:08.670270 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:08.670798 (+ 528us) server_negotiation.cc:299] Negotiation successful
0809 20:15:08.670954 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15347,"thread_start_us":15529,"threads_started":1}
I20260809 20:15:08.671293 9597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:08.645702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:43147 (local address 127.0.0.1:36428)
0809 20:15:08.663321 (+ 17619us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:08.663338 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:08.663449 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:08.664008 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:08.664015 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:08.664044 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:15:08.664391 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:08.664405 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.666066 (+ 1661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.666071 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:08.668780 (+ 2709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:08.668798 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.670454 (+ 1656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.670458 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:08.670593 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:08.670625 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 20:15:08.670736 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 20:15:08.670909 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17522,"mutex_wait_us":8,"thread_start_us":17045,"threads_started":1}
I20260809 20:15:08.671921 9594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:08.644508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:45397 (local address 127.0.0.1:57922)
0809 20:15:08.645233 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:08.645275 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:08.645428 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:08.664945 (+ 19517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:08.664949 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:08.664973 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:15:08.665303 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:08.665316 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.666992 (+ 1676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.666998 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:08.669319 (+ 2321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:08.669333 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.671109 (+ 1776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.671116 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:08.671288 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:08.671321 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 20:15:08.671379 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 20:15:08.671494 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":494,"mutex_wait_us":69,"thread_start_us":520,"threads_started":1}
I20260809 20:15:08.672334 9599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:08.644956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:46735 (local address 127.0.0.1:41008)
0809 20:15:08.662462 (+ 17506us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:08.662483 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:08.662603 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:08.666048 (+ 3445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:08.666053 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:08.666079 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:15:08.666495 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:08.666507 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.667883 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.667888 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:08.669683 (+ 1795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:08.669698 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.671572 (+ 1874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.671578 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:08.671760 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:08.671792 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 20:15:08.671862 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 20:15:08.671981 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17344,"mutex_wait_us":1,"thread_start_us":18114,"threads_started":1}
I20260809 20:15:08.673014 9596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:08.644799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57922 (local address 127.14.181.3:45397)
0809 20:15:08.664490 (+ 19691us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:08.664497 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:08.664526 (+ 29us) server_negotiation.cc:407] Connection header received
0809 20:15:08.664610 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:08.664616 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:08.664760 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:08.664914 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:15:08.665501 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.666835 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.669485 (+ 2650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.670881 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.672240 (+ 1359us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:08.672460 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:08.672525 (+ 65us) server_negotiation.cc:299] Negotiation successful
0809 20:15:08.672672 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19532,"thread_start_us":18176,"threads_started":1}
I20260809 20:15:08.673172 9601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:08.645871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41008 (local address 127.14.181.2:46735)
0809 20:15:08.665502 (+ 19631us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:08.665510 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:08.665542 (+ 32us) server_negotiation.cc:407] Connection header received
0809 20:15:08.665629 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:08.665635 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:08.665844 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:08.666029 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:15:08.666656 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.667715 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.669884 (+ 2169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.671252 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.672549 (+ 1297us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:08.672711 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:08.672781 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 20:15:08.672921 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19488,"thread_start_us":19375,"threads_started":1}
I20260809 20:15:08.675029 9078 tablet_service.cc:1467] Processing CreateTablet for tablet 7395050c27754548b4a285f7f05fa1f3 (DEFAULT_TABLE table=test-table [id=e1e8018c71834f9f856c34864c7d6b0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:15:08.676446 9078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7395050c27754548b4a285f7f05fa1f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:15:08.676352 9480 tablet_service.cc:1467] Processing CreateTablet for tablet 7395050c27754548b4a285f7f05fa1f3 (DEFAULT_TABLE table=test-table [id=e1e8018c71834f9f856c34864c7d6b0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:15:08.677091 9280 tablet_service.cc:1467] Processing CreateTablet for tablet 7395050c27754548b4a285f7f05fa1f3 (DEFAULT_TABLE table=test-table [id=e1e8018c71834f9f856c34864c7d6b0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:15:08.677649 9480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7395050c27754548b4a285f7f05fa1f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:15:08.678025 9280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7395050c27754548b4a285f7f05fa1f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:15:08.689021 9605 tablet_bootstrap.cc:492] T 7395050c27754548b4a285f7f05fa1f3 P 951707e4604548e0b4ae1abb91d30820: Bootstrap starting.
I20260809 20:15:08.692126 9606 tablet_bootstrap.cc:492] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12: Bootstrap starting.
I20260809 20:15:08.692651 9605 tablet_bootstrap.cc:654] T 7395050c27754548b4a285f7f05fa1f3 P 951707e4604548e0b4ae1abb91d30820: Neither blocks nor log segments found. Creating new log.
I20260809 20:15:08.694308 9605 log.cc:824] T 7395050c27754548b4a285f7f05fa1f3 P 951707e4604548e0b4ae1abb91d30820: Log is configured to *not* fsync() on all Append() calls
I20260809 20:15:08.695675 9606 tablet_bootstrap.cc:654] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12: Neither blocks nor log segments found. Creating new log.
I20260809 20:15:08.696925 9606 log.cc:824] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12: Log is configured to *not* fsync() on all Append() calls
I20260809 20:15:08.698140 9607 tablet_bootstrap.cc:492] T 7395050c27754548b4a285f7f05fa1f3 P 98d26b7cf7f743d7be1a2ec392f9441f: Bootstrap starting.
I20260809 20:15:08.701632 9607 tablet_bootstrap.cc:654] T 7395050c27754548b4a285f7f05fa1f3 P 98d26b7cf7f743d7be1a2ec392f9441f: Neither blocks nor log segments found. Creating new log.
I20260809 20:15:08.702842 9607 log.cc:824] T 7395050c27754548b4a285f7f05fa1f3 P 98d26b7cf7f743d7be1a2ec392f9441f: Log is configured to *not* fsync() on all Append() calls
I20260809 20:15:08.704305 9606 tablet_bootstrap.cc:492] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12: No bootstrap required, opened a new log
I20260809 20:15:08.704581 9606 ts_tablet_manager.cc:1397] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.000s
I20260809 20:15:08.705315 9607 tablet_bootstrap.cc:492] T 7395050c27754548b4a285f7f05fa1f3 P 98d26b7cf7f743d7be1a2ec392f9441f: No bootstrap required, opened a new log
I20260809 20:15:08.705539 9607 ts_tablet_manager.cc:1397] T 7395050c27754548b4a285f7f05fa1f3 P 98d26b7cf7f743d7be1a2ec392f9441f: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 20:15:08.705808 9605 tablet_bootstrap.cc:492] T 7395050c27754548b4a285f7f05fa1f3 P 951707e4604548e0b4ae1abb91d30820: No bootstrap required, opened a new log
I20260809 20:15:08.706055 9605 ts_tablet_manager.cc:1397] T 7395050c27754548b4a285f7f05fa1f3 P 951707e4604548e0b4ae1abb91d30820: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.010s
I20260809 20:15:08.712447 9607 raft_consensus.cc:348] T 7395050c27754548b4a285f7f05fa1f3 P 98d26b7cf7f743d7be1a2ec392f9441f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d26b7cf7f743d7be1a2ec392f9441f" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 45397 } } peers { permanent_uuid: "951707e4604548e0b4ae1abb91d30820" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 46735 } } peers { permanent_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 43147 } }
I20260809 20:15:08.712762 9607 raft_consensus.cc:374] T 7395050c27754548b4a285f7f05fa1f3 P 98d26b7cf7f743d7be1a2ec392f9441f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:15:08.712853 9607 raft_consensus.cc:729] T 7395050c27754548b4a285f7f05fa1f3 P 98d26b7cf7f743d7be1a2ec392f9441f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98d26b7cf7f743d7be1a2ec392f9441f, State: Initialized, Role: FOLLOWER
I20260809 20:15:08.713380 9607 consensus_queue.cc:260] T 7395050c27754548b4a285f7f05fa1f3 P 98d26b7cf7f743d7be1a2ec392f9441f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d26b7cf7f743d7be1a2ec392f9441f" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 45397 } } peers { permanent_uuid: "951707e4604548e0b4ae1abb91d30820" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 46735 } } peers { permanent_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 43147 } }
I20260809 20:15:08.714372 9579 heartbeater.cc:503] Master 127.14.181.62:34277 was elected leader, sending a full tablet report...
I20260809 20:15:08.714578 9606 raft_consensus.cc:348] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d26b7cf7f743d7be1a2ec392f9441f" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 45397 } } peers { permanent_uuid: "951707e4604548e0b4ae1abb91d30820" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 46735 } } peers { permanent_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 43147 } }
I20260809 20:15:08.714962 9606 raft_consensus.cc:374] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:15:08.715070 9606 raft_consensus.cc:729] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d4ed6835ecc4df2a9f21d7f9c363c12, State: Initialized, Role: FOLLOWER
I20260809 20:15:08.716032 9607 ts_tablet_manager.cc:1428] T 7395050c27754548b4a285f7f05fa1f3 P 98d26b7cf7f743d7be1a2ec392f9441f: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260809 20:15:08.715999 9605 raft_consensus.cc:348] T 7395050c27754548b4a285f7f05fa1f3 P 951707e4604548e0b4ae1abb91d30820 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d26b7cf7f743d7be1a2ec392f9441f" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 45397 } } peers { permanent_uuid: "951707e4604548e0b4ae1abb91d30820" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 46735 } } peers { permanent_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 43147 } }
I20260809 20:15:08.716413 9605 raft_consensus.cc:374] T 7395050c27754548b4a285f7f05fa1f3 P 951707e4604548e0b4ae1abb91d30820 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:15:08.716517 9605 raft_consensus.cc:729] T 7395050c27754548b4a285f7f05fa1f3 P 951707e4604548e0b4ae1abb91d30820 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 951707e4604548e0b4ae1abb91d30820, State: Initialized, Role: FOLLOWER
I20260809 20:15:08.715721 9606 consensus_queue.cc:260] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d26b7cf7f743d7be1a2ec392f9441f" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 45397 } } peers { permanent_uuid: "951707e4604548e0b4ae1abb91d30820" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 46735 } } peers { permanent_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 43147 } }
I20260809 20:15:08.717175 9605 consensus_queue.cc:260] T 7395050c27754548b4a285f7f05fa1f3 P 951707e4604548e0b4ae1abb91d30820 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d26b7cf7f743d7be1a2ec392f9441f" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 45397 } } peers { permanent_uuid: "951707e4604548e0b4ae1abb91d30820" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 46735 } } peers { permanent_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 43147 } }
I20260809 20:15:08.721369 9182 heartbeater.cc:503] Master 127.14.181.62:34277 was elected leader, sending a full tablet report...
I20260809 20:15:08.721828 9382 heartbeater.cc:503] Master 127.14.181.62:34277 was elected leader, sending a full tablet report...
I20260809 20:15:08.722047 9606 ts_tablet_manager.cc:1428] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12: Time spent starting tablet: real 0.017s user 0.007s sys 0.010s
I20260809 20:15:08.722553 9605 ts_tablet_manager.cc:1428] T 7395050c27754548b4a285f7f05fa1f3 P 951707e4604548e0b4ae1abb91d30820: Time spent starting tablet: real 0.016s user 0.013s sys 0.005s
I20260809 20:15:08.798153 9614 raft_consensus.cc:482] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:15:08.798449 9614 raft_consensus.cc:504] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d26b7cf7f743d7be1a2ec392f9441f" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 45397 } } peers { permanent_uuid: "951707e4604548e0b4ae1abb91d30820" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 46735 } } peers { permanent_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 43147 } }
I20260809 20:15:08.800046 9614 leader_election.cc:288] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98d26b7cf7f743d7be1a2ec392f9441f (127.14.181.3:45397), 951707e4604548e0b4ae1abb91d30820 (127.14.181.2:46735)
I20260809 20:15:08.806685 9601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:08.800401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:43451 (local address 127.14.181.2:46735)
0809 20:15:08.800587 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:08.800594 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:08.801465 (+ 871us) server_negotiation.cc:407] Connection header received
0809 20:15:08.801616 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:08.801620 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:08.801678 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:08.801758 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:15:08.802448 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.803133 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.804988 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.805756 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.805884 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:08.805953 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:08.806287 (+ 334us) server_negotiation.cc:299] Negotiation successful
0809 20:15:08.806431 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 20:15:08.806712 9596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:08.800423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:34417 (local address 127.14.181.3:45397)
0809 20:15:08.800622 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:08.800628 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:08.801413 (+ 785us) server_negotiation.cc:407] Connection header received
0809 20:15:08.801575 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:08.801581 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:08.801661 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:08.801727 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:15:08.802370 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.803110 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.805016 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.805771 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.805919 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:08.805988 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:08.806360 (+ 372us) server_negotiation.cc:299] Negotiation successful
0809 20:15:08.806485 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 20:15:08.806810 9620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:08.800240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:45397 (local address 127.14.181.1:34417)
0809 20:15:08.801290 (+ 1050us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:08.801306 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:08.801429 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:08.801773 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:08.801777 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:08.801801 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:15:08.802191 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:08.802200 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.803254 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.803259 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:08.804845 (+ 1586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:08.804858 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.806017 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.806022 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:08.806171 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:08.806194 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 20:15:08.806285 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 20:15:08.806426 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":944,"mutex_wait_us":91,"thread_start_us":607,"threads_started":1}
I20260809 20:15:08.807096 9622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:08.800488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:46735 (local address 127.14.181.1:43451)
0809 20:15:08.801339 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:08.801355 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:08.801483 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:08.801790 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:08.801795 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:08.801818 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:15:08.802276 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:08.802288 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.803262 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.803265 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:08.804826 (+ 1561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:08.804838 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.805973 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.805979 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:08.806129 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:08.806153 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 20:15:08.806224 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 20:15:08.806334 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":741,"mutex_wait_us":34,"thread_start_us":536,"threads_started":1}
I20260809 20:15:08.807734 9504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7395050c27754548b4a285f7f05fa1f3" candidate_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98d26b7cf7f743d7be1a2ec392f9441f" is_pre_election: true
I20260809 20:15:08.808013 9311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7395050c27754548b4a285f7f05fa1f3" candidate_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951707e4604548e0b4ae1abb91d30820" is_pre_election: true
I20260809 20:15:08.808282 9504 raft_consensus.cc:2454] T 7395050c27754548b4a285f7f05fa1f3 P 98d26b7cf7f743d7be1a2ec392f9441f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d4ed6835ecc4df2a9f21d7f9c363c12 in term 0.
I20260809 20:15:08.808486 9311 raft_consensus.cc:2454] T 7395050c27754548b4a285f7f05fa1f3 P 951707e4604548e0b4ae1abb91d30820 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d4ed6835ecc4df2a9f21d7f9c363c12 in term 0.
I20260809 20:15:08.808975 9010 leader_election.cc:302] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4ed6835ecc4df2a9f21d7f9c363c12, 98d26b7cf7f743d7be1a2ec392f9441f; no voters:
I20260809 20:15:08.809331 9614 raft_consensus.cc:2781] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:15:08.809448 9614 raft_consensus.cc:482] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:15:08.809538 9614 raft_consensus.cc:3037] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:15:08.811656 9614 raft_consensus.cc:504] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d26b7cf7f743d7be1a2ec392f9441f" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 45397 } } peers { permanent_uuid: "951707e4604548e0b4ae1abb91d30820" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 46735 } } peers { permanent_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 43147 } }
I20260809 20:15:08.812179 9614 leader_election.cc:288] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [CANDIDATE]: Term 1 election: Requested vote from peers 98d26b7cf7f743d7be1a2ec392f9441f (127.14.181.3:45397), 951707e4604548e0b4ae1abb91d30820 (127.14.181.2:46735)
I20260809 20:15:08.812577 9504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7395050c27754548b4a285f7f05fa1f3" candidate_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98d26b7cf7f743d7be1a2ec392f9441f"
I20260809 20:15:08.812628 9311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7395050c27754548b4a285f7f05fa1f3" candidate_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951707e4604548e0b4ae1abb91d30820"
I20260809 20:15:08.812754 9504 raft_consensus.cc:3037] T 7395050c27754548b4a285f7f05fa1f3 P 98d26b7cf7f743d7be1a2ec392f9441f [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:15:08.812781 9311 raft_consensus.cc:3037] T 7395050c27754548b4a285f7f05fa1f3 P 951707e4604548e0b4ae1abb91d30820 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:15:08.814886 9311 raft_consensus.cc:2454] T 7395050c27754548b4a285f7f05fa1f3 P 951707e4604548e0b4ae1abb91d30820 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4ed6835ecc4df2a9f21d7f9c363c12 in term 1.
I20260809 20:15:08.814990 9504 raft_consensus.cc:2454] T 7395050c27754548b4a285f7f05fa1f3 P 98d26b7cf7f743d7be1a2ec392f9441f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d4ed6835ecc4df2a9f21d7f9c363c12 in term 1.
I20260809 20:15:08.815232 9012 leader_election.cc:302] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d4ed6835ecc4df2a9f21d7f9c363c12, 951707e4604548e0b4ae1abb91d30820; no voters:
I20260809 20:15:08.815491 9614 raft_consensus.cc:2781] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:15:08.815879 9614 raft_consensus.cc:686] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [term 1 LEADER]: Becoming Leader. State: Replica: 4d4ed6835ecc4df2a9f21d7f9c363c12, State: Running, Role: LEADER
I20260809 20:15:08.816296 9614 consensus_queue.cc:237] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d26b7cf7f743d7be1a2ec392f9441f" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 45397 } } peers { permanent_uuid: "951707e4604548e0b4ae1abb91d30820" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 46735 } } peers { permanent_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 43147 } }
I20260809 20:15:08.820533 8881 catalog_manager.cc:5495] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d4ed6835ecc4df2a9f21d7f9c363c12 (127.14.181.1). New cstate: current_term: 1 leader_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98d26b7cf7f743d7be1a2ec392f9441f" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 45397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "951707e4604548e0b4ae1abb91d30820" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 46735 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 43147 } health_report { overall_health: HEALTHY } } }
W20260809 20:15:08.824952 9584 tablet.cc:2369] T 7395050c27754548b4a285f7f05fa1f3 P 98d26b7cf7f743d7be1a2ec392f9441f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:15:08.842657 9604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:08.838209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36434 (local address 127.14.181.1:43147)
0809 20:15:08.838398 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:08.838404 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:08.838421 (+ 17us) server_negotiation.cc:407] Connection header received
0809 20:15:08.838510 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:08.838513 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:08.838585 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:08.838696 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:15:08.838978 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.839604 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.840840 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.841240 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.841321 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:08.841747 (+ 426us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:15:08.842163 (+ 416us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:15:08.842258 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:08.842317 (+ 59us) server_negotiation.cc:299] Negotiation successful
0809 20:15:08.842417 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 20:15:08.849913 9504 raft_consensus.cc:1261] T 7395050c27754548b4a285f7f05fa1f3 P 98d26b7cf7f743d7be1a2ec392f9441f [term 1 FOLLOWER]: Refusing update from remote peer 4d4ed6835ecc4df2a9f21d7f9c363c12: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:15:08.849915 9311 raft_consensus.cc:1261] T 7395050c27754548b4a285f7f05fa1f3 P 951707e4604548e0b4ae1abb91d30820 [term 1 FOLLOWER]: Refusing update from remote peer 4d4ed6835ecc4df2a9f21d7f9c363c12: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:15:08.850800 9627 consensus_queue.cc:1035] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98d26b7cf7f743d7be1a2ec392f9441f" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 45397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:15:08.851118 9614 consensus_queue.cc:1035] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "951707e4604548e0b4ae1abb91d30820" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 46735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:15:08.865821 9631 mvcc.cc:205] Tried to move back new op lower bound from 7316711460240691200 to 7316711460114632704. Current Snapshot: MvccSnapshot[applied={T|T < 7316711460240691200}]
I20260809 20:15:08.880514 8879 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:15:08.880847 8879 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:15:08.884830 8879 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4: Sending DeleteTablet for 3 replicas of tablet 7395050c27754548b4a285f7f05fa1f3
I20260809 20:15:08.885807 9280 tablet_service.cc:1514] Processing DeleteTablet for tablet 7395050c27754548b4a285f7f05fa1f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:15:08 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:41008
I20260809 20:15:08.886047 9078 tablet_service.cc:1514] Processing DeleteTablet for tablet 7395050c27754548b4a285f7f05fa1f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:15:08 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:36428
I20260809 20:15:08.886605 9645 tablet_replica.cc:330] T 7395050c27754548b4a285f7f05fa1f3 P 951707e4604548e0b4ae1abb91d30820: stopping tablet replica
I20260809 20:15:08.886595 9077 tablet_service.cc:1514] Processing DeleteTablet for tablet 7395050c27754548b4a285f7f05fa1f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:15:08 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:36428
I20260809 20:15:08.886933 9645 raft_consensus.cc:2229] T 7395050c27754548b4a285f7f05fa1f3 P 951707e4604548e0b4ae1abb91d30820 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:15:08.887336 9645 raft_consensus.cc:2258] T 7395050c27754548b4a285f7f05fa1f3 P 951707e4604548e0b4ae1abb91d30820 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:15:08.887404 9480 tablet_service.cc:1514] Processing DeleteTablet for tablet 7395050c27754548b4a285f7f05fa1f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:15:08 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:57922
I20260809 20:15:08.887485 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 8950
I20260809 20:15:08.889050 9645 ts_tablet_manager.cc:1905] T 7395050c27754548b4a285f7f05fa1f3 P 951707e4604548e0b4ae1abb91d30820: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:15:08.893579 9647 tablet_replica.cc:330] T 7395050c27754548b4a285f7f05fa1f3 P 98d26b7cf7f743d7be1a2ec392f9441f: stopping tablet replica
I20260809 20:15:08.893994 9647 raft_consensus.cc:2229] T 7395050c27754548b4a285f7f05fa1f3 P 98d26b7cf7f743d7be1a2ec392f9441f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:15:08.894825 9647 raft_consensus.cc:2258] T 7395050c27754548b4a285f7f05fa1f3 P 98d26b7cf7f743d7be1a2ec392f9441f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:15:08.896687 9645 ts_tablet_manager.cc:1918] T 7395050c27754548b4a285f7f05fa1f3 P 951707e4604548e0b4ae1abb91d30820: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:15:08.896835 9645 log.cc:1196] T 7395050c27754548b4a285f7f05fa1f3 P 951707e4604548e0b4ae1abb91d30820: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/wal/wals/7395050c27754548b4a285f7f05fa1f3
I20260809 20:15:08.897351 9645 ts_tablet_manager.cc:1939] T 7395050c27754548b4a285f7f05fa1f3 P 951707e4604548e0b4ae1abb91d30820: Deleting consensus metadata
I20260809 20:15:08.898818 9646 tablet_replica.cc:330] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12: stopping tablet replica
I20260809 20:15:08.899235 9646 raft_consensus.cc:2229] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [term 1 LEADER]: Raft consensus shutting down.
I20260809 20:15:08.899995 9647 ts_tablet_manager.cc:1905] T 7395050c27754548b4a285f7f05fa1f3 P 98d26b7cf7f743d7be1a2ec392f9441f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:15:08.900461 8861 catalog_manager.cc:4841] TS 951707e4604548e0b4ae1abb91d30820 (127.14.181.2:46735): tablet 7395050c27754548b4a285f7f05fa1f3 (table test-table [id=e1e8018c71834f9f856c34864c7d6b0c]) successfully deleted
I20260809 20:15:08.900782 9646 raft_consensus.cc:2258] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:15:08.903509 9646 ts_tablet_manager.cc:1905] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:15:08.906169 9647 ts_tablet_manager.cc:1918] T 7395050c27754548b4a285f7f05fa1f3 P 98d26b7cf7f743d7be1a2ec392f9441f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:15:08.906306 9647 log.cc:1196] T 7395050c27754548b4a285f7f05fa1f3 P 98d26b7cf7f743d7be1a2ec392f9441f: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/wal/wals/7395050c27754548b4a285f7f05fa1f3
I20260809 20:15:08.906847 9647 ts_tablet_manager.cc:1939] T 7395050c27754548b4a285f7f05fa1f3 P 98d26b7cf7f743d7be1a2ec392f9441f: Deleting consensus metadata
I20260809 20:15:08.907200 9604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:08.888529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36440 (local address 127.14.181.1:43147)
0809 20:15:08.888700 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:08.888706 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:08.888725 (+ 19us) server_negotiation.cc:407] Connection header received
0809 20:15:08.888778 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:08.888783 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:08.888857 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:08.888955 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:08.890638 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.891816 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.893894 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:08.894569 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:08.894682 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:08.898634 (+ 3952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:08.898651 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:08.898666 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:15:08.898713 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:08.902829 (+ 4116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:08.903833 (+ 1004us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:08.903841 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:08.903845 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:08.904017 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:08.904493 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:08.904498 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:08.904502 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:08.904935 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:08.905298 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:08.906549 (+ 1251us) server_negotiation.cc:299] Negotiation successful
0809 20:15:08.906759 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 20:15:08.908104 9173 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:15:08.908761 8859 catalog_manager.cc:4841] TS 98d26b7cf7f743d7be1a2ec392f9441f (127.14.181.3:45397): tablet 7395050c27754548b4a285f7f05fa1f3 (table test-table [id=e1e8018c71834f9f856c34864c7d6b0c]) successfully deleted
I20260809 20:15:09.002240 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 8950
I20260809 20:15:09.023568 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 9189
W20260809 20:15:09.023532 8860 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.181.1:43147 (error 108)
I20260809 20:15:09.025367 9599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:09.024961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:43147 (local address 127.0.0.1:36448)
0809 20:15:09.025134 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:09.025231 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:43147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260809 20:15:09.025575 8860 catalog_manager.cc:4584] TS 4d4ed6835ecc4df2a9f21d7f9c363c12 (127.14.181.1:43147): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7395050c27754548b4a285f7f05fa1f3: Network error: Client connection negotiation failed: client connection to 127.14.181.1:43147: connect: Connection refused (error 111)
I20260809 20:15:09.036693 9601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:09.024280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41022 (local address 127.14.181.2:46735)
0809 20:15:09.024466 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:09.024472 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:09.024575 (+ 103us) server_negotiation.cc:407] Connection header received
0809 20:15:09.024763 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:09.024769 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:09.024848 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:09.024932 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:09.026405 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:09.027132 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:09.028514 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:09.028954 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:09.029065 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:09.031660 (+ 2595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:09.031672 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:09.031687 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:15:09.031731 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:09.034285 (+ 2554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:09.034954 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:09.034960 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:09.034962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:09.035082 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:09.035401 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:09.035404 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:09.035406 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:09.035753 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:09.035962 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:09.036233 (+ 271us) server_negotiation.cc:299] Negotiation successful
0809 20:15:09.036387 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 20:15:09.037290 9376 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:15:09.070040 9599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:09.069612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:43147 (local address 127.0.0.1:36456)
0809 20:15:09.069805 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:09.069896 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:43147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260809 20:15:09.071044 9599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:09.070678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:43147 (local address 127.0.0.1:36458)
0809 20:15:09.070835 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:09.070917 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:43147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260809 20:15:09.078987 9599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:09.078649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:43147 (local address 127.0.0.1:36466)
0809 20:15:09.078808 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:09.078871 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:43147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260809 20:15:09.079816 9599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:09.079524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:43147 (local address 127.0.0.1:36468)
0809 20:15:09.079657 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:09.079717 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:43147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 20:15:09.119969 9599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:09.119576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:43147 (local address 127.0.0.1:36472)
0809 20:15:09.119755 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:09.119833 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:43147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260809 20:15:09.120916 9599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:09.120543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:43147 (local address 127.0.0.1:36480)
0809 20:15:09.120749 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:09.120814 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:43147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260809 20:15:09.123569 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 9189
I20260809 20:15:09.146731 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 9387
I20260809 20:15:09.156489 9599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:09.156075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:43147 (local address 127.0.0.1:36484)
0809 20:15:09.156265 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:09.156338 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:43147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260809 20:15:09.157506 9599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:09.157124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:43147 (local address 127.0.0.1:36488)
0809 20:15:09.157283 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:09.157369 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:43147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 20:15:09.159282 9596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:09.147425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57936 (local address 127.14.181.3:45397)
0809 20:15:09.147580 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:09.147584 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:09.147604 (+ 20us) server_negotiation.cc:407] Connection header received
0809 20:15:09.147782 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:09.147786 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:09.147859 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:09.147939 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:09.149257 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:09.149961 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:09.151210 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:09.151600 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:09.151687 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:09.154043 (+ 2356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:09.154055 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:09.154074 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:15:09.154100 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:09.156692 (+ 2592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:09.157513 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:09.157521 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:09.157524 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:09.157692 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:09.158047 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:09.158050 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:09.158052 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:09.158438 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:09.158644 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:09.158898 (+ 254us) server_negotiation.cc:299] Negotiation successful
0809 20:15:09.159053 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 20:15:09.159859 9573 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:15:09.221875 9599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:09.221377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:43147 (local address 127.0.0.1:36494)
0809 20:15:09.221595 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:09.221693 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:43147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260809 20:15:09.222915 9599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:09.222530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:43147 (local address 127.0.0.1:36496)
0809 20:15:09.222678 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:09.222761 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:43147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 20:15:09.247931 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 9387
I20260809 20:15:09.259351 9599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:09.258866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:43147 (local address 127.0.0.1:36508)
0809 20:15:09.259060 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:09.259152 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:43147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260809 20:15:09.260327 9599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:09.259939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:43147 (local address 127.0.0.1:36522)
0809 20:15:09.260071 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:09.260174 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:43147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260809 20:15:09.270170 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 8835
I20260809 20:15:09.271258 8935 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:15:09.386677 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 8835
I20260809 20:15:29.415748 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:34277
--webserver_interface=127.14.181.62
--webserver_port=44143
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:34277
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:15:29.741581 9654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:15:29.741842 9654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:15:29.741973 9654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:15:29.748883 9654 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 20:15:29.748974 9654 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 20:15:29.749038 9654 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 20:15:29.749115 9654 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:15:29.749187 9654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:15:29.749287 9654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:15:29.749343 9654 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:15:29.749418 9654 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:15:29.758749 9654 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:34277
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:34277
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=44143
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:15:29.759821 9654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:15:29.761035 9654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:15:29.772182 9661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:29.772219 9666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:29.772259 9664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:15:29.772799 9654 server_base.cc:1034] running on GCE node
I20260809 20:15:29.773521 9654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:15:29.774773 9654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:15:29.775978 9654 hybrid_clock.cc:648] HybridClock initialized: now 1786306529775920 us; error 32 us; skew 500 ppm
I20260809 20:15:29.776296 9654 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:15:29 dist-test-slave-6zbq krb5kdc[7999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306529, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:15:29.784801 9654 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:15:29.786109 9654 webserver.cc:460] Webserver started at http://127.14.181.62:44143/ using document root <none> and password file <none>
I20260809 20:15:29.786782 9654 fs_manager.cc:359] Metadata directory not provided
I20260809 20:15:29.786885 9654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:15:29.791882 9654 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 20:15:29.794627 9678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:29.795814 9654 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 20:15:29.795971 9654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "2950368f271942b0b719dddf2f9438b4"
format_stamp: "Formatted at 2026-08-09 20:14:44 on dist-test-slave-6zbq"
server_key: "07b88106491f31fa1462a9ced654115f"
server_key_iv: "02adb96c78dab0e4c495af6574a0b7b2"
server_key_version: "encryptionkey@0"
I20260809 20:15:29.796873 9654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:15:29.830999 9654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:15:29.834580 9654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:15:29.834805 9654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:15:29.851106 9654 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:34277
I20260809 20:15:29.851147 9747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:34277 every 8 connection(s)
I20260809 20:15:29.852459 9654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:15:29.859061 9748 sys_catalog.cc:263] Verifying existing consensus state
I20260809 20:15:29.862075 9748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4: Bootstrap starting.
I20260809 20:15:29.862128 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 9654
I20260809 20:15:29.862968 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:43147
--local_ip_for_outbound_sockets=127.14.181.1
--tserver_master_addrs=127.14.181.62:34277
--webserver_port=44681
--webserver_interface=127.14.181.1
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 20:15:29.884227 9748 log.cc:824] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4: Log is configured to *not* fsync() on all Append() calls
I20260809 20:15:29.905114 9748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 20:15:29.905726 9748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4: Bootstrap complete.
I20260809 20:15:29.918447 9748 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2950368f271942b0b719dddf2f9438b4" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 34277 } }
I20260809 20:15:29.919600 9748 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2950368f271942b0b719dddf2f9438b4, State: Initialized, Role: FOLLOWER
I20260809 20:15:29.920269 9748 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2950368f271942b0b719dddf2f9438b4" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 34277 } }
I20260809 20:15:29.920540 9748 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:15:29.920655 9748 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:15:29.920830 9748 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [term 2 FOLLOWER]: Advancing to term 3
I20260809 20:15:29.926182 9748 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2950368f271942b0b719dddf2f9438b4" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 34277 } }
I20260809 20:15:29.926756 9748 leader_election.cc:302] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2950368f271942b0b719dddf2f9438b4; no voters:
I20260809 20:15:29.927470 9748 leader_election.cc:288] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 20:15:29.927597 9754 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 20:15:29.928638 9754 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [term 3 LEADER]: Becoming Leader. State: Replica: 2950368f271942b0b719dddf2f9438b4, State: Running, Role: LEADER
I20260809 20:15:29.929124 9754 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2950368f271942b0b719dddf2f9438b4" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 34277 } }
I20260809 20:15:29.929422 9748 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:15:29.931459 9755 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "2950368f271942b0b719dddf2f9438b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2950368f271942b0b719dddf2f9438b4" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 34277 } } }
I20260809 20:15:29.931814 9755 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [sys.catalog]: This master's current role is: LEADER
I20260809 20:15:29.931806 9756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2950368f271942b0b719dddf2f9438b4. Latest consensus state: current_term: 3 leader_uuid: "2950368f271942b0b719dddf2f9438b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2950368f271942b0b719dddf2f9438b4" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 34277 } } }
I20260809 20:15:29.932096 9756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4 [sys.catalog]: This master's current role is: LEADER
I20260809 20:15:29.942839 9761 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:15:29.951114 9761 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:15:29.952535 9761 catalog_manager.cc:1259] Loaded cluster ID: 9dae74d05cb94e2cbb46109817b32cf0
I20260809 20:15:29.952628 9761 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:15:29.956559 9761 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:15:29.958177 9761 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4: Loaded TSK: 0
I20260809 20:15:29.958324 9761 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2950368f271942b0b719dddf2f9438b4: Loaded TSK: 1
F20260809 20:15:29.959511 9761 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fc0474299ad google::LogMessage::Fail() at ??:0
@ 0x7fc04742c88a google::LogMessage::SendToLog() at ??:0
@ 0x7fc0474294de google::LogMessage::Flush() at ??:0
@ 0x7fc04742aa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fc04b18d7d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fc04b17c73e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fc05ce5c1c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fc05ce5b783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fc05cee72a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7fc05cee70c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7fc05cf315e9 std::function<>::operator()() at ??:0
@ 0x7fc05ce5fcdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7fc05ce5dc36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fc05cee5610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7fc05cee5439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fc04a075345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fc04a07891c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fc04a078799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fc04a053eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fc04d32d6db start_thread at ??:0
@ 0x7fc0462c361f clone at ??:0
W20260809 20:15:30.254626 9750 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:15:30.254932 9750 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:15:30.255064 9750 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:15:30.261965 9750 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:15:30.262055 9750 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:15:30.262217 9750 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:15:30.271291 9750 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:43147
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=44681
--tserver_master_addrs=127.14.181.62:34277
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:15:30.272300 9750 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:15:30.273411 9750 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:15:30.285553 9827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:30.285526 9826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:30.285586 9830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:15:30.286294 9750 server_base.cc:1034] running on GCE node
I20260809 20:15:30.286840 9750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:15:30.287643 9750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:15:30.288818 9750 hybrid_clock.cc:648] HybridClock initialized: now 1786306530288772 us; error 43 us; skew 500 ppm
I20260809 20:15:30.289084 9750 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:15:30 dist-test-slave-6zbq krb5kdc[7999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306530, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:15:30.291985 9750 init.cc:377] Logged in from keytab as kudu/127.14.181.1@KRBTEST.COM (short username kudu)
I20260809 20:15:30.293401 9750 webserver.cc:460] Webserver started at http://127.14.181.1:44681/ using document root <none> and password file <none>
I20260809 20:15:30.294086 9750 fs_manager.cc:359] Metadata directory not provided
I20260809 20:15:30.294220 9750 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:15:30.303402 9750 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.007s sys 0.001s
I20260809 20:15:30.306205 9840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:30.307436 9750 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 20:15:30.307578 9750 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "4d4ed6835ecc4df2a9f21d7f9c363c12"
format_stamp: "Formatted at 2026-08-09 20:14:45 on dist-test-slave-6zbq"
server_key: "b64d587bbe654d4e22c732153dac6618"
server_key_iv: "84a146044467ae28ebcbabf4f30ce80c"
server_key_version: "encryptionkey@0"
I20260809 20:15:30.308472 9750 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:15:30.340147 9750 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:15:30.344022 9750 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:15:30.344256 9750 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:15:30.345156 9750 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:15:30.346856 9853 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260809 20:15:30.351750 9853 ts_tablet_manager.cc:1852] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260809 20:15:30.352685 9853 ts_tablet_manager.cc:1905] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:15:30.359539 9853 ts_tablet_manager.cc:1918] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:15:30.359719 9853 log.cc:1196] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/wal/wals/7395050c27754548b4a285f7f05fa1f3
I20260809 20:15:30.360189 9853 ts_tablet_manager.cc:1939] T 7395050c27754548b4a285f7f05fa1f3 P 4d4ed6835ecc4df2a9f21d7f9c363c12: Deleting consensus metadata
I20260809 20:15:30.360515 9750 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260809 20:15:30.360625 9750 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.014s user 0.000s sys 0.000s
I20260809 20:15:30.360731 9750 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:15:30.360812 9750 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:30.391299 9750 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:43147
I20260809 20:15:30.391359 10007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:43147 every 8 connection(s)
I20260809 20:15:30.392479 9750 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:15:30.394471 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 9750
I20260809 20:15:30.395057 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:46735
--local_ip_for_outbound_sockets=127.14.181.2
--tserver_master_addrs=127.14.181.62:34277
--webserver_port=34295
--webserver_interface=127.14.181.2
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 20:15:30.397471 10011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:30.395337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.1:47747)
0809 20:15:30.396151 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:30.396420 (+ 269us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":281,"threads_started":1}
W20260809 20:15:30.398103 10009 heartbeater.cc:644] Failed to heartbeat to 127.14.181.62:34277 (0 consecutive failures): Network error: Failed to ping master at 127.14.181.62:34277: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
I20260809 20:15:30.398902 10011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:30.398571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.1:34477)
0809 20:15:30.398713 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:30.398787 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 20:15:30.399861 10011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:30.399461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.1:36397)
0809 20:15:30.399646 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:30.399726 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
W20260809 20:15:30.400067 10009 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 20:15:30.725934 10013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:15:30.726181 10013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:15:30.726276 10013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:15:30.733116 10013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:15:30.733211 10013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:15:30.733347 10013 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:15:30.742311 10013 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:46735
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=34295
--tserver_master_addrs=127.14.181.62:34277
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:15:30.743384 10013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:15:30.744529 10013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:15:30.756476 10023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:30.756533 10024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:30.756505 10028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:15:30.757205 10013 server_base.cc:1034] running on GCE node
I20260809 20:15:30.757767 10013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:15:30.758658 10013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:15:30.759855 10013 hybrid_clock.cc:648] HybridClock initialized: now 1786306530759802 us; error 46 us; skew 500 ppm
I20260809 20:15:30.760133 10013 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:15:30 dist-test-slave-6zbq krb5kdc[7999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306530, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:15:30.763011 10013 init.cc:377] Logged in from keytab as kudu/127.14.181.2@KRBTEST.COM (short username kudu)
I20260809 20:15:30.764271 10013 webserver.cc:460] Webserver started at http://127.14.181.2:34295/ using document root <none> and password file <none>
I20260809 20:15:30.764883 10013 fs_manager.cc:359] Metadata directory not provided
I20260809 20:15:30.764998 10013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:15:30.769804 10013 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.002s
I20260809 20:15:30.772332 10039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:30.773494 10013 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 20:15:30.773640 10013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "951707e4604548e0b4ae1abb91d30820"
format_stamp: "Formatted at 2026-08-09 20:14:45 on dist-test-slave-6zbq"
server_key: "7850959f85ae7ab4f7fd5dce375c7f89"
server_key_iv: "17b774ae9870db928f5abc57ffe5dc52"
server_key_version: "encryptionkey@0"
I20260809 20:15:30.774602 10013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:15:30.785862 10013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:15:30.789377 10013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:15:30.789611 10013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:15:30.790498 10013 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:15:30.791718 10013 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:15:30.791807 10013 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:30.791884 10013 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:15:30.791965 10013 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:30.821427 10013 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:46735
I20260809 20:15:30.821532 10214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:46735 every 8 connection(s)
I20260809 20:15:30.822762 10013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:15:30.826977 10218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:30.825300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.2:51875)
0809 20:15:30.825954 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:30.826198 (+ 244us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":256,"threads_started":1}
W20260809 20:15:30.827536 10215 heartbeater.cc:644] Failed to heartbeat to 127.14.181.62:34277 (0 consecutive failures): Network error: Failed to ping master at 127.14.181.62:34277: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
I20260809 20:15:30.828203 10218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:30.827917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.2:44347)
0809 20:15:30.828030 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:30.828090 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 20:15:30.828960 10218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:30.828658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.2:53453)
0809 20:15:30.828789 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:30.828859 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 20:15:30.829190 10215 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 20:15:30.832715 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 10013
I20260809 20:15:30.833258 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:45397
--local_ip_for_outbound_sockets=127.14.181.3
--tserver_master_addrs=127.14.181.62:34277
--webserver_port=39583
--webserver_interface=127.14.181.3
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:15:31.147364 10219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:15:31.147607 10219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:15:31.147722 10219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:15:31.154495 10219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:15:31.154598 10219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:15:31.154742 10219 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:15:31.163587 10219 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:45397
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=39583
--tserver_master_addrs=127.14.181.62:34277
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:15:31.164601 10219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:15:31.165720 10219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:15:31.177131 10226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:31.177276 10230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:31.177304 10227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:15:31.178606 10219 server_base.cc:1034] running on GCE node
I20260809 20:15:31.179170 10219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:15:31.179956 10219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:15:31.181157 10219 hybrid_clock.cc:648] HybridClock initialized: now 1786306531181103 us; error 45 us; skew 500 ppm
I20260809 20:15:31.181406 10219 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:15:31 dist-test-slave-6zbq krb5kdc[7999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306531, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:15:31.184338 10219 init.cc:377] Logged in from keytab as kudu/127.14.181.3@KRBTEST.COM (short username kudu)
I20260809 20:15:31.185563 10219 webserver.cc:460] Webserver started at http://127.14.181.3:39583/ using document root <none> and password file <none>
I20260809 20:15:31.186174 10219 fs_manager.cc:359] Metadata directory not provided
I20260809 20:15:31.186288 10219 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:15:31.191075 10219 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 20:15:31.193480 10240 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:31.194671 10219 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 20:15:31.194819 10219 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "98d26b7cf7f743d7be1a2ec392f9441f"
format_stamp: "Formatted at 2026-08-09 20:14:45 on dist-test-slave-6zbq"
server_key: "1bf48bcbeaf08085a5d6cd606f3a7dbd"
server_key_iv: "b28e3ebab5feea3d2f37d355f5e26482"
server_key_version: "encryptionkey@0"
I20260809 20:15:31.195695 10219 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:15:31.207048 10219 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:15:31.210391 10219 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:15:31.210614 10219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:15:31.211465 10219 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:15:31.212656 10219 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:15:31.212750 10219 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:31.212848 10219 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:15:31.212918 10219 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:31.241583 10219 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:45397
I20260809 20:15:31.241647 10429 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:45397 every 8 connection(s)
I20260809 20:15:31.242810 10219 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:15:31.246943 10434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:31.245293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.3:48669)
0809 20:15:31.245936 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:31.246164 (+ 228us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":246,"threads_started":1}
W20260809 20:15:31.247488 10431 heartbeater.cc:644] Failed to heartbeat to 127.14.181.62:34277 (0 consecutive failures): Network error: Failed to ping master at 127.14.181.62:34277: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
I20260809 20:15:31.247673 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 10219
I20260809 20:15:31.248260 10434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:31.247960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.3:38357)
0809 20:15:31.248090 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:31.248157 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 20:15:31.249102 10434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:31.248740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.3:60267)
0809 20:15:31.248877 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:31.248967 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 20:15:31.249353 10431 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 20:15:31.401422 10436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:31.400568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.1:48773)
0809 20:15:31.401052 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:31.401197 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":221,"threads_started":1}
I20260809 20:15:31.830361 10437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:31.829611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.2:34299)
0809 20:15:31.830033 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:31.830120 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":197,"threads_started":1}
I20260809 20:15:32.250525 10438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:32.249779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.3:53521)
0809 20:15:32.250189 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:32.250264 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":191,"threads_started":1}
I20260809 20:15:32.402832 10439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:32.402182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.1:38927)
0809 20:15:32.402607 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:32.402684 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":229,"threads_started":1}
I20260809 20:15:32.831933 10442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:32.831230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.2:44865)
0809 20:15:32.831691 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:32.831780 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":216,"threads_started":1}
I20260809 20:15:33.252063 10444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:33.251361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.3:36085)
0809 20:15:33.251817 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:33.251903 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":213,"threads_started":1}
I20260809 20:15:33.404347 10445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:33.403632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.1:38325)
0809 20:15:33.404075 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:33.404176 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":218,"threads_started":1}
I20260809 20:15:33.833333 10448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:33.832706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.2:33219)
0809 20:15:33.833090 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:33.833176 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":202,"threads_started":1}
I20260809 20:15:34.253476 10449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:34.252834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.3:41605)
0809 20:15:34.253238 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:34.253315 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":213,"threads_started":1}
I20260809 20:15:34.405843 10450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:34.405160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.1:60971)
0809 20:15:34.405603 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:34.405687 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":222,"threads_started":1}
I20260809 20:15:34.834854 10452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:34.834138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.2:53157)
0809 20:15:34.834576 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:34.834666 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":228,"threads_started":1}
I20260809 20:15:35.254916 10455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:35.254220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.3:35405)
0809 20:15:35.254638 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:35.254723 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":212,"threads_started":1}
I20260809 20:15:35.407305 10456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:35.406659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.1:44329)
0809 20:15:35.407054 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:35.407145 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":196,"threads_started":1}
I20260809 20:15:35.836321 10457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:35.835643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.2:52397)
0809 20:15:35.836080 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:35.836159 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":234,"threads_started":1}
I20260809 20:15:36.256345 10461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:36.255668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.3:35719)
0809 20:15:36.256098 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:36.256186 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":231,"threads_started":1}
I20260809 20:15:36.408835 10462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:36.408205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.1:50981)
0809 20:15:36.408601 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:36.408680 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":203,"threads_started":1}
I20260809 20:15:36.837745 10463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:36.837080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.2:38193)
0809 20:15:36.837494 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:36.837578 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":217,"threads_started":1}
I20260809 20:15:37.257746 10464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:37.257076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.3:33641)
0809 20:15:37.257508 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:37.257593 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":231,"threads_started":1}
I20260809 20:15:37.410312 10465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:37.409584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.1:44505)
0809 20:15:37.410026 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:37.410104 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":196,"threads_started":1}
I20260809 20:15:37.839282 10467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:37.838534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.2:49181)
0809 20:15:37.839007 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:37.839083 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":209,"threads_started":1}
I20260809 20:15:38.259341 10468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:38.258540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.3:58535)
0809 20:15:38.259037 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:38.259133 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":230,"threads_started":1}
I20260809 20:15:38.411728 10469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:38.411105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.1:45343)
0809 20:15:38.411494 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:38.411571 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":205,"threads_started":1}
I20260809 20:15:38.840646 10470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:38.840031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.2:53731)
0809 20:15:38.840424 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:38.840500 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":201,"threads_started":1}
I20260809 20:15:39.260762 10473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:39.260120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.3:53651)
0809 20:15:39.260527 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:39.260602 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":193,"threads_started":1}
I20260809 20:15:39.413190 10475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:39.412498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.1:46705)
0809 20:15:39.412935 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:39.413029 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":224,"threads_started":1}
I20260809 20:15:39.842103 10477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:39.841421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.2:38165)
0809 20:15:39.841850 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:39.841925 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":216,"threads_started":1}
I20260809 20:15:40.262207 10478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:40.261538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.3:33853)
0809 20:15:40.261969 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:40.262045 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":209,"threads_started":1}
I20260809 20:15:40.414628 10479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:40.413964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.1:37641)
0809 20:15:40.414392 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:40.414473 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":214,"threads_started":1}
I20260809 20:15:40.843479 10481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:40.842861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.2:37545)
0809 20:15:40.843256 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:40.843334 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":202,"threads_started":1}
I20260809 20:15:41.263578 10483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:41.262961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.3:40415)
0809 20:15:41.263352 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:41.263429 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":210,"threads_started":1}
I20260809 20:15:41.415982 10484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:41.415336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.1:60087)
0809 20:15:41.415728 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:41.415809 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":217,"threads_started":1}
I20260809 20:15:41.844882 10485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:41.844226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.2:58321)
0809 20:15:41.844631 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:41.844713 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":190,"threads_started":1}
I20260809 20:15:42.265095 10486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:42.264369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.3:45875)
0809 20:15:42.264826 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:42.264913 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":229,"threads_started":1}
I20260809 20:15:42.417454 10487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:42.416781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.1:53043)
0809 20:15:42.417217 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:42.417300 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":238,"threads_started":1}
I20260809 20:15:42.846416 10489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:42.845726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.2:57745)
0809 20:15:42.846140 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:42.846228 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":203,"threads_started":1}
I20260809 20:15:43.266525 10494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:43.265896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.3:59089)
0809 20:15:43.266286 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:43.266383 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":209,"threads_started":1}
I20260809 20:15:43.418974 10495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:43.418258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.1:49743)
0809 20:15:43.418700 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:43.418797 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":232,"threads_started":1}
I20260809 20:15:43.847885 10496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:43.847165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.2:33127)
0809 20:15:43.847614 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:43.847727 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":222,"threads_started":1}
I20260809 20:15:44.267975 10497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:44.267251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.3:44849)
0809 20:15:44.267699 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:44.267817 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":212,"threads_started":1}
I20260809 20:15:44.420424 10498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:44.419739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.1:47613)
0809 20:15:44.420168 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:44.420252 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":214,"threads_started":1}
I20260809 20:15:44.849287 10499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:44.848613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.2:60631)
0809 20:15:44.849036 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:44.849119 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":200,"threads_started":1}
I20260809 20:15:45.269701 10501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:45.268737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.3:52353)
0809 20:15:45.269466 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:45.269539 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":632,"thread_start_us":512,"threads_started":1}
I20260809 20:15:45.422005 10503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:45.421349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.1:51381)
0809 20:15:45.421753 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:45.421837 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":199,"threads_started":1}
I20260809 20:15:45.850941 10504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:45.850227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.2:56657)
0809 20:15:45.850678 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:45.850773 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":241,"threads_started":1}
I20260809 20:15:46.251874 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 9750
I20260809 20:15:46.271477 10507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:46.270697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:34277 (local address 127.14.181.3:37721)
0809 20:15:46.271131 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:46.271256 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.62:34277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":209,"threads_started":1}
I20260809 20:15:46.273484 10505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:46.252818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35284 (local address 127.14.181.1:43147)
0809 20:15:46.253338 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:46.253356 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:46.253405 (+ 49us) server_negotiation.cc:407] Connection header received
0809 20:15:46.255145 (+ 1740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:46.255157 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:46.255577 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:46.255858 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:46.257165 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:46.258412 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:46.259610 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:46.260278 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:46.260411 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:46.267679 (+ 7268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:46.267687 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:46.267701 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:15:46.267744 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:46.270368 (+ 2624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:46.271110 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:46.271119 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:46.271127 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:46.271361 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:46.271745 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:46.271749 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:46.271752 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:46.272277 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:46.272502 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:46.272829 (+ 327us) server_negotiation.cc:299] Negotiation successful
0809 20:15:46.273208 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":230,"threads_started":1}
I20260809 20:15:46.274773 10001 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:15:46.357661 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 9750
I20260809 20:15:46.380821 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 10013
I20260809 20:15:46.397641 10510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:46.381685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54454 (local address 127.14.181.2:46735)
0809 20:15:46.382178 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:46.382194 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:46.382232 (+ 38us) server_negotiation.cc:407] Connection header received
0809 20:15:46.383811 (+ 1579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:46.383820 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:46.384229 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:46.384542 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:46.386029 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:46.387311 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:46.388642 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:46.389276 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:46.389439 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:46.391963 (+ 2524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:46.391971 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:46.391985 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:15:46.392027 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:46.394608 (+ 2581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:46.395240 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:46.395249 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:46.395255 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:46.395423 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:46.395789 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:46.395794 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:46.395796 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:46.396254 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:46.396538 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:46.396974 (+ 436us) server_negotiation.cc:299] Negotiation successful
0809 20:15:46.397339 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":229,"threads_started":1}
I20260809 20:15:46.398993 10208 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:15:46.480607 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 10013
I20260809 20:15:46.504225 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 10219
I20260809 20:15:46.521064 10514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:46.505251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33994 (local address 127.14.181.3:45397)
0809 20:15:46.505884 (+ 633us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:46.505898 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:46.505940 (+ 42us) server_negotiation.cc:407] Connection header received
0809 20:15:46.507586 (+ 1646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:46.507596 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:46.508017 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:46.508296 (+ 279us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:46.509524 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:46.510787 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:46.512012 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:46.512630 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:46.512766 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:46.515307 (+ 2541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:46.515315 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:46.515328 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:15:46.515364 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:46.518108 (+ 2744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:46.518937 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:46.518943 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:46.518950 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:46.519117 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:46.519405 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:46.519408 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:46.519410 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:46.519897 (+ 487us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:46.520119 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:46.520390 (+ 271us) server_negotiation.cc:299] Negotiation successful
0809 20:15:46.520772 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":289,"threads_started":1}
I20260809 20:15:46.522291 10422 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:15:46.602627 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 10219
2026-08-09T20:15:46Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (63888 ms)
[----------] 30 tests from SecurityITest (289828 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:15:46 dist-test-slave-6zbq krb5kdc[10519](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:15:46 dist-test-slave-6zbq krb5kdc[10519](info): set up 2 sockets
Aug 09 20:15:46 dist-test-slave-6zbq krb5kdc[10519](info): commencing operation
krb5kdc: starting...
W20260809 20:15:47.820724 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.172s user 0.001s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:15:47 dist-test-slave-6zbq krb5kdc[10519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306547, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:15:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:15:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:15:48.069413 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:44023
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:34079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:44023
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:15:48.382879 10536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:15:48.383122 10536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:15:48.383260 10536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:15:48.390100 10536 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:15:48.390192 10536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:15:48.390272 10536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:15:48.390354 10536 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:15:48.390424 10536 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:15:48.399873 10536 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:34079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:44023
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:44023
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:15:48.401016 10536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:15:48.402220 10536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 20:15:48.413448 10536 server_base.cc:1034] running on GCE node
W20260809 20:15:48.413408 10545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:48.413499 10544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:48.413627 10550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:15:48.414570 10536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:15:48.415776 10536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:15:48.416973 10536 hybrid_clock.cc:648] HybridClock initialized: now 1786306548416932 us; error 27 us; skew 500 ppm
I20260809 20:15:48.417279 10536 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:15:48 dist-test-slave-6zbq krb5kdc[10519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306548, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:15:48.420135 10536 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:15:48.421496 10536 webserver.cc:460] Webserver started at http://127.14.181.62:33721/ using document root <none> and password file <none>
I20260809 20:15:48.422091 10536 fs_manager.cc:359] Metadata directory not provided
I20260809 20:15:48.422212 10536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:15:48.422533 10536 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:15:48.425297 10536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "15556ce857934d30aaeb741fad3ace8f"
format_stamp: "Formatted at 2026-08-09 20:15:48 on dist-test-slave-6zbq"
server_key: "42f0dd4aaa6f294be6619c9e898ee4da"
server_key_iv: "85ccdcca1310aeb8fbbecf1650db8820"
server_key_version: "encryptionkey@0"
I20260809 20:15:48.425987 10536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "15556ce857934d30aaeb741fad3ace8f"
format_stamp: "Formatted at 2026-08-09 20:15:48 on dist-test-slave-6zbq"
server_key: "42f0dd4aaa6f294be6619c9e898ee4da"
server_key_iv: "85ccdcca1310aeb8fbbecf1650db8820"
server_key_version: "encryptionkey@0"
I20260809 20:15:48.430653 10536 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.002s
I20260809 20:15:48.433701 10558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:48.434900 10536 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:15:48.435055 10536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "15556ce857934d30aaeb741fad3ace8f"
format_stamp: "Formatted at 2026-08-09 20:15:48 on dist-test-slave-6zbq"
server_key: "42f0dd4aaa6f294be6619c9e898ee4da"
server_key_iv: "85ccdcca1310aeb8fbbecf1650db8820"
server_key_version: "encryptionkey@0"
I20260809 20:15:48.435227 10536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:15:48.472914 10536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:15:48.476461 10536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:15:48.476711 10536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:15:48.493345 10536 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:44023
I20260809 20:15:48.493388 10638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:44023 every 8 connection(s)
I20260809 20:15:48.494552 10536 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:15:48.497977 10639 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:15:48.499444 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 10536
I20260809 20:15:48.499681 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:15:48.500495 15060 external_mini_cluster.cc:1428] Setting key 68daf76080450361cc4bb6b4a3a4cef0
I20260809 20:15:48.511886 10639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15556ce857934d30aaeb741fad3ace8f: Bootstrap starting.
Aug 09 20:15:48 dist-test-slave-6zbq krb5kdc[10519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306547, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:15:48.515359 10639 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 15556ce857934d30aaeb741fad3ace8f: Neither blocks nor log segments found. Creating new log.
I20260809 20:15:48.516345 10639 log.cc:824] T 00000000000000000000000000000000 P 15556ce857934d30aaeb741fad3ace8f: Log is configured to *not* fsync() on all Append() calls
I20260809 20:15:48.519065 10639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15556ce857934d30aaeb741fad3ace8f: No bootstrap required, opened a new log
I20260809 20:15:48.522698 10647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:48.502505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36968 (local address 127.14.181.62:44023)
0809 20:15:48.503286 (+ 781us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:48.503299 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:48.503344 (+ 45us) server_negotiation.cc:407] Connection header received
0809 20:15:48.504891 (+ 1547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:48.504915 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:48.505268 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:48.505557 (+ 289us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:48.507372 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:48.508632 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:48.510591 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:48.511195 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:48.511323 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:48.515803 (+ 4480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:48.515813 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:48.515826 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:15:48.515863 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:48.518836 (+ 2973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:48.519524 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:48.519530 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:48.519536 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:48.519710 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:48.520082 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:48.520085 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:48.520087 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:48.520589 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:48.520864 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:48.521359 (+ 495us) server_negotiation.cc:299] Negotiation successful
0809 20:15:48.521728 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":581,"thread_start_us":340,"threads_started":1}
I20260809 20:15:48.526681 10639 raft_consensus.cc:348] T 00000000000000000000000000000000 P 15556ce857934d30aaeb741fad3ace8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15556ce857934d30aaeb741fad3ace8f" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 44023 } }
I20260809 20:15:48.527014 10639 raft_consensus.cc:374] T 00000000000000000000000000000000 P 15556ce857934d30aaeb741fad3ace8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:15:48.527099 10639 raft_consensus.cc:729] T 00000000000000000000000000000000 P 15556ce857934d30aaeb741fad3ace8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15556ce857934d30aaeb741fad3ace8f, State: Initialized, Role: FOLLOWER
I20260809 20:15:48.527595 10639 consensus_queue.cc:260] T 00000000000000000000000000000000 P 15556ce857934d30aaeb741fad3ace8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15556ce857934d30aaeb741fad3ace8f" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 44023 } }
I20260809 20:15:48.527808 10639 raft_consensus.cc:388] T 00000000000000000000000000000000 P 15556ce857934d30aaeb741fad3ace8f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:15:48.527928 10639 raft_consensus.cc:482] T 00000000000000000000000000000000 P 15556ce857934d30aaeb741fad3ace8f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:15:48.528077 10639 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 15556ce857934d30aaeb741fad3ace8f [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:15:48.530126 10639 raft_consensus.cc:504] T 00000000000000000000000000000000 P 15556ce857934d30aaeb741fad3ace8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15556ce857934d30aaeb741fad3ace8f" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 44023 } }
I20260809 20:15:48.530668 10639 leader_election.cc:302] T 00000000000000000000000000000000 P 15556ce857934d30aaeb741fad3ace8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 15556ce857934d30aaeb741fad3ace8f; no voters:
I20260809 20:15:48.531347 10639 leader_election.cc:288] T 00000000000000000000000000000000 P 15556ce857934d30aaeb741fad3ace8f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:15:48.531459 10652 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 15556ce857934d30aaeb741fad3ace8f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:15:48.532081 10652 raft_consensus.cc:686] T 00000000000000000000000000000000 P 15556ce857934d30aaeb741fad3ace8f [term 1 LEADER]: Becoming Leader. State: Replica: 15556ce857934d30aaeb741fad3ace8f, State: Running, Role: LEADER
I20260809 20:15:48.532684 10652 consensus_queue.cc:237] T 00000000000000000000000000000000 P 15556ce857934d30aaeb741fad3ace8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15556ce857934d30aaeb741fad3ace8f" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 44023 } }
I20260809 20:15:48.533617 10639 sys_catalog.cc:564] T 00000000000000000000000000000000 P 15556ce857934d30aaeb741fad3ace8f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:15:48.535463 10656 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15556ce857934d30aaeb741fad3ace8f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15556ce857934d30aaeb741fad3ace8f. Latest consensus state: current_term: 1 leader_uuid: "15556ce857934d30aaeb741fad3ace8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15556ce857934d30aaeb741fad3ace8f" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 44023 } } }
I20260809 20:15:48.535538 10653 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15556ce857934d30aaeb741fad3ace8f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "15556ce857934d30aaeb741fad3ace8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15556ce857934d30aaeb741fad3ace8f" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 44023 } } }
I20260809 20:15:48.535847 10656 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15556ce857934d30aaeb741fad3ace8f [sys.catalog]: This master's current role is: LEADER
I20260809 20:15:48.536695 10653 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15556ce857934d30aaeb741fad3ace8f [sys.catalog]: This master's current role is: LEADER
I20260809 20:15:48.537845 10662 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:15:48.541992 10662 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:15:48.551275 10662 catalog_manager.cc:1347] Generated new cluster ID: 6d0f8437b5b849418a3dc04c185404c1
I20260809 20:15:48.551383 10662 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:15:48.569715 10662 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:15:48.571012 10662 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:15:48.581209 10662 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 15556ce857934d30aaeb741fad3ace8f: Generated new TSK 0
I20260809 20:15:48.581947 10662 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.181.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
I20260809 20:15:48.645653 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:0
--local_ip_for_outbound_sockets=127.14.181.1
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:44023
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:34079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:15:48.964319 10687 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:15:48.964564 10687 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:15:48.964709 10687 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:15:48.971580 10687 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:15:48.971683 10687 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:15:48.971835 10687 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:15:48.980860 10687 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:34079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:44023
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:15:48.981976 10687 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:15:48.983250 10687 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:15:48.995333 10695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:48.995373 10696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:48.995406 10698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:15:48.996325 10687 server_base.cc:1034] running on GCE node
I20260809 20:15:48.996870 10687 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:15:48.997731 10687 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:15:48.998929 10687 hybrid_clock.cc:648] HybridClock initialized: now 1786306548998887 us; error 29 us; skew 500 ppm
I20260809 20:15:48.999231 10687 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:15:48 dist-test-slave-6zbq krb5kdc[10519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306548, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:15:49.002125 10687 init.cc:377] Logged in from keytab as kudu/127.14.181.1@KRBTEST.COM (short username kudu)
I20260809 20:15:49.003470 10687 webserver.cc:460] Webserver started at http://127.14.181.1:40647/ using document root <none> and password file <none>
I20260809 20:15:49.004070 10687 fs_manager.cc:359] Metadata directory not provided
I20260809 20:15:49.004197 10687 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:15:49.004498 10687 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:15:49.007308 10687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-0/data/instance:
uuid: "8fb7f51a949e47c2884a47d1b72f4d19"
format_stamp: "Formatted at 2026-08-09 20:15:49 on dist-test-slave-6zbq"
server_key: "48b885a1f0907b487a2b5fd8eb893d87"
server_key_iv: "6a0396f14aace69191d30b092f026cf5"
server_key_version: "encryptionkey@0"
I20260809 20:15:49.008010 10687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance:
uuid: "8fb7f51a949e47c2884a47d1b72f4d19"
format_stamp: "Formatted at 2026-08-09 20:15:49 on dist-test-slave-6zbq"
server_key: "48b885a1f0907b487a2b5fd8eb893d87"
server_key_iv: "6a0396f14aace69191d30b092f026cf5"
server_key_version: "encryptionkey@0"
I20260809 20:15:49.012794 10687 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260809 20:15:49.015978 10705 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:49.017123 10687 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 20:15:49.017267 10687 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "8fb7f51a949e47c2884a47d1b72f4d19"
format_stamp: "Formatted at 2026-08-09 20:15:49 on dist-test-slave-6zbq"
server_key: "48b885a1f0907b487a2b5fd8eb893d87"
server_key_iv: "6a0396f14aace69191d30b092f026cf5"
server_key_version: "encryptionkey@0"
I20260809 20:15:49.017443 10687 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:15:49.033213 10687 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:15:49.037115 10687 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:15:49.037671 10687 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:15:49.038647 10687 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:15:49.039983 10687 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:15:49.040066 10687 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:49.040190 10687 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:15:49.040246 10687 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:49.069288 10687 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:46643
I20260809 20:15:49.069329 10876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:46643 every 8 connection(s)
I20260809 20:15:49.070552 10687 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:15:49.071285 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 10687
I20260809 20:15:49.071508 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance
I20260809 20:15:49.072244 15060 external_mini_cluster.cc:1428] Setting key 6292af8bdaba5162500175f2c1a317ad
Aug 09 20:15:49 dist-test-slave-6zbq krb5kdc[10519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306548, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:15:49.090226 10880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:49.073242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:33241 (local address 127.14.181.62:44023)
0809 20:15:49.073671 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:49.073675 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:49.074863 (+ 1188us) server_negotiation.cc:407] Connection header received
0809 20:15:49.076721 (+ 1858us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:49.076726 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:49.076799 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:49.076898 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:49.078299 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:49.079297 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:49.080849 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:49.081442 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:49.081558 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:49.084840 (+ 3282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:49.084846 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:49.084850 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:15:49.084886 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:49.087395 (+ 2509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:49.088182 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:49.088186 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:49.088188 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:49.088302 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:49.088737 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:49.088739 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:49.088741 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:49.088987 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:49.089092 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:49.089807 (+ 715us) server_negotiation.cc:299] Negotiation successful
0809 20:15:49.089965 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":225,"threads_started":1}
I20260809 20:15:49.091478 10881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:49.073857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:44023 (local address 127.14.181.1:33241)
0809 20:15:49.074704 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:49.074748 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:49.076473 (+ 1725us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:49.077084 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:49.077091 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:49.077599 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:15:49.078123 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:49.078150 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:49.079428 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:49.079432 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:49.080709 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:49.080722 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:49.081634 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:49.081641 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:49.081845 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:49.082465 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:15:49.082486 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:15:49.084631 (+ 2145us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:15:49.087533 (+ 2902us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:15:49.087541 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:15:49.087554 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:15:49.088069 (+ 515us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:15:49.088394 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:15:49.088399 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:15:49.088403 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:15:49.088642 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:15:49.089106 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:15:49.089113 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:15:49.089481 (+ 368us) client_negotiation.cc:769] Sending connection context
0809 20:15:49.089756 (+ 275us) client_negotiation.cc:240] Negotiation successful
0809 20:15:49.090259 (+ 503us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":318,"threads_started":1}
I20260809 20:15:49.092958 10878 heartbeater.cc:347] Connected to a master server at 127.14.181.62:44023
I20260809 20:15:49.093230 10878 heartbeater.cc:464] Registering TS with master...
I20260809 20:15:49.093888 10878 heartbeater.cc:511] Master 127.14.181.62:44023 requested a full tablet report, sending...
I20260809 20:15:49.096028 10589 ts_manager.cc:194] Registered new tserver with Master: 8fb7f51a949e47c2884a47d1b72f4d19 (127.14.181.1:46643)
I20260809 20:15:49.098114 10589 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.1@KRBTEST.COM'} at 127.14.181.1:33241
WARNING: no policy specified for kudu/127.14.181.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
I20260809 20:15:49.132710 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:0
--local_ip_for_outbound_sockets=127.14.181.2
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:44023
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:34079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:15:49.442143 10887 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:15:49.442389 10887 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:15:49.442488 10887 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:15:49.449595 10887 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:15:49.449687 10887 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:15:49.449802 10887 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:15:49.458616 10887 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:34079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:44023
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:15:49.459558 10887 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:15:49.460621 10887 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:15:49.472105 10895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:49.472061 10897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:49.472144 10900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:15:49.473043 10887 server_base.cc:1034] running on GCE node
I20260809 20:15:49.473546 10887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:15:49.474298 10887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:15:49.475509 10887 hybrid_clock.cc:648] HybridClock initialized: now 1786306549475468 us; error 33 us; skew 500 ppm
I20260809 20:15:49.475781 10887 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:15:49 dist-test-slave-6zbq krb5kdc[10519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306549, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:15:49.478564 10887 init.cc:377] Logged in from keytab as kudu/127.14.181.2@KRBTEST.COM (short username kudu)
I20260809 20:15:49.479784 10887 webserver.cc:460] Webserver started at http://127.14.181.2:33255/ using document root <none> and password file <none>
I20260809 20:15:49.480378 10887 fs_manager.cc:359] Metadata directory not provided
I20260809 20:15:49.480513 10887 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:15:49.480810 10887 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:15:49.483408 10887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-1/data/instance:
uuid: "00a6faf56fe04a28befc5ab060c156d9"
format_stamp: "Formatted at 2026-08-09 20:15:49 on dist-test-slave-6zbq"
server_key: "784cd8f1689e7a5a344873a55da63f3a"
server_key_iv: "66b0b7885179020727ff3544070001f2"
server_key_version: "encryptionkey@0"
I20260809 20:15:49.484058 10887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance:
uuid: "00a6faf56fe04a28befc5ab060c156d9"
format_stamp: "Formatted at 2026-08-09 20:15:49 on dist-test-slave-6zbq"
server_key: "784cd8f1689e7a5a344873a55da63f3a"
server_key_iv: "66b0b7885179020727ff3544070001f2"
server_key_version: "encryptionkey@0"
I20260809 20:15:49.488538 10887 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 20:15:49.491508 10911 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:49.492676 10887 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:15:49.492815 10887 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "00a6faf56fe04a28befc5ab060c156d9"
format_stamp: "Formatted at 2026-08-09 20:15:49 on dist-test-slave-6zbq"
server_key: "784cd8f1689e7a5a344873a55da63f3a"
server_key_iv: "66b0b7885179020727ff3544070001f2"
server_key_version: "encryptionkey@0"
I20260809 20:15:49.493029 10887 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:15:49.509838 10887 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:15:49.513576 10887 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:15:49.513821 10887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:15:49.514734 10887 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:15:49.515961 10887 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:15:49.516037 10887 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:49.516155 10887 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:15:49.516214 10887 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:49.545571 10887 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:45701
I20260809 20:15:49.545614 11080 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:45701 every 8 connection(s)
I20260809 20:15:49.546723 10887 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:15:49.553484 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 10887
I20260809 20:15:49.553643 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance
I20260809 20:15:49.554090 15060 external_mini_cluster.cc:1428] Setting key 5266f2db42b450701e62598f778c1510
Aug 09 20:15:49 dist-test-slave-6zbq krb5kdc[10519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306549, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:15:49.565068 10880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:49.548899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:39481 (local address 127.14.181.62:44023)
0809 20:15:49.549062 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:49.549066 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:49.550151 (+ 1085us) server_negotiation.cc:407] Connection header received
0809 20:15:49.551918 (+ 1767us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:49.551925 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:49.552014 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:49.552103 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:49.553509 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:49.554321 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:49.555995 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:49.556401 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:49.556513 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:49.559971 (+ 3458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:49.559976 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:49.559980 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:15:49.560011 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:49.562366 (+ 2355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:49.563116 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:49.563119 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:49.563121 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:49.563255 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:49.563649 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:49.563651 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:49.563653 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:49.563889 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:49.564004 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:49.564683 (+ 679us) server_negotiation.cc:299] Negotiation successful
0809 20:15:49.564843 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 20:15:49.566183 11085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:49.549331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:44023 (local address 127.14.181.2:39481)
0809 20:15:49.550003 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:49.550037 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:49.551654 (+ 1617us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:49.552334 (+ 680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:49.552342 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:49.552830 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:15:49.553344 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:49.553361 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:49.554483 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:49.554487 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:49.555865 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:49.555877 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:49.556617 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:49.556625 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:49.556842 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:49.557422 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:15:49.557449 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:15:49.559766 (+ 2317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:15:49.562494 (+ 2728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:15:49.562501 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:15:49.562514 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:15:49.563021 (+ 507us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:15:49.563345 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:15:49.563349 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:15:49.563352 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:15:49.563566 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:15:49.563998 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:15:49.564005 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:15:49.564365 (+ 360us) client_negotiation.cc:769] Sending connection context
0809 20:15:49.564623 (+ 258us) client_negotiation.cc:240] Negotiation successful
0809 20:15:49.565044 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":267,"threads_started":1}
I20260809 20:15:49.567404 11082 heartbeater.cc:347] Connected to a master server at 127.14.181.62:44023
I20260809 20:15:49.567652 11082 heartbeater.cc:464] Registering TS with master...
I20260809 20:15:49.568418 11082 heartbeater.cc:511] Master 127.14.181.62:44023 requested a full tablet report, sending...
I20260809 20:15:49.569814 10589 ts_manager.cc:194] Registered new tserver with Master: 00a6faf56fe04a28befc5ab060c156d9 (127.14.181.2:45701)
I20260809 20:15:49.570626 10589 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.2@KRBTEST.COM'} at 127.14.181.2:39481
WARNING: no policy specified for kudu/127.14.181.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
I20260809 20:15:49.609359 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:0
--local_ip_for_outbound_sockets=127.14.181.3
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:44023
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:34079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:15:49.916155 11089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:15:49.916390 11089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:15:49.916505 11089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:15:49.923395 11089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:15:49.923483 11089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:15:49.923619 11089 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:15:49.932523 11089 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:34079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:44023
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:15:49.933612 11089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:15:49.934868 11089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:15:49.946826 11106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:49.946882 11099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:49.946902 11098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:15:49.947959 11089 server_base.cc:1034] running on GCE node
I20260809 20:15:49.948463 11089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:15:49.949265 11089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:15:49.950409 11089 hybrid_clock.cc:648] HybridClock initialized: now 1786306549950362 us; error 43 us; skew 500 ppm
I20260809 20:15:49.950675 11089 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:15:49 dist-test-slave-6zbq krb5kdc[10519](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306549, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:15:49.953449 11089 init.cc:377] Logged in from keytab as kudu/127.14.181.3@KRBTEST.COM (short username kudu)
I20260809 20:15:49.954780 11089 webserver.cc:460] Webserver started at http://127.14.181.3:40861/ using document root <none> and password file <none>
I20260809 20:15:49.955389 11089 fs_manager.cc:359] Metadata directory not provided
I20260809 20:15:49.955493 11089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:15:49.955770 11089 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:15:49.958475 11089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-2/data/instance:
uuid: "4e405f21a7154c2a88576266a3b646a3"
format_stamp: "Formatted at 2026-08-09 20:15:49 on dist-test-slave-6zbq"
server_key: "ca1aa9c2671a24a7e0a2771280e3cfdc"
server_key_iv: "485b0a7d1292bd6553ec507235b5f76d"
server_key_version: "encryptionkey@0"
I20260809 20:15:49.959177 11089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance:
uuid: "4e405f21a7154c2a88576266a3b646a3"
format_stamp: "Formatted at 2026-08-09 20:15:49 on dist-test-slave-6zbq"
server_key: "ca1aa9c2671a24a7e0a2771280e3cfdc"
server_key_iv: "485b0a7d1292bd6553ec507235b5f76d"
server_key_version: "encryptionkey@0"
I20260809 20:15:49.963888 11089 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 20:15:49.967031 11115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:49.968222 11089 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:15:49.968374 11089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "4e405f21a7154c2a88576266a3b646a3"
format_stamp: "Formatted at 2026-08-09 20:15:49 on dist-test-slave-6zbq"
server_key: "ca1aa9c2671a24a7e0a2771280e3cfdc"
server_key_iv: "485b0a7d1292bd6553ec507235b5f76d"
server_key_version: "encryptionkey@0"
I20260809 20:15:49.968554 11089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:15:49.985819 11089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:15:49.989545 11089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:15:49.989796 11089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:15:49.990806 11089 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:15:49.992234 11089 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:15:49.992313 11089 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:49.992436 11089 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:15:49.992496 11089 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:50.022706 11089 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:41675
I20260809 20:15:50.022740 11293 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:41675 every 8 connection(s)
I20260809 20:15:50.023954 11089 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:15:50.028537 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 11089
I20260809 20:15:50.028731 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance
I20260809 20:15:50.029246 15060 external_mini_cluster.cc:1428] Setting key e03083e84d300e8dca885d38aac9e5f6
Aug 09 20:15:50 dist-test-slave-6zbq krb5kdc[10519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306549, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:15:50.043253 10880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:50.026270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:46699 (local address 127.14.181.62:44023)
0809 20:15:50.026453 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:50.026458 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:50.027557 (+ 1099us) server_negotiation.cc:407] Connection header received
0809 20:15:50.029792 (+ 2235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:50.029799 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:50.029893 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:50.030001 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:50.031881 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.032748 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.034329 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.034808 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.034940 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:50.038103 (+ 3163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:50.038108 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:50.038111 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:15:50.038143 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:50.040595 (+ 2452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:50.041219 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:50.041222 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:50.041224 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:50.041339 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:50.041669 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:50.041672 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:50.041674 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:50.041910 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:50.042016 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:50.042666 (+ 650us) server_negotiation.cc:299] Negotiation successful
0809 20:15:50.042909 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 20:15:50.044304 11304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:50.026709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:44023 (local address 127.14.181.3:46699)
0809 20:15:50.027395 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:50.027430 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:50.029487 (+ 2057us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:50.030282 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:50.030292 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:50.031057 (+ 765us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:15:50.031716 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:50.031733 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.032916 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.032920 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:50.034196 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:50.034209 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.035033 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.035040 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:50.035273 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:50.035809 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:15:50.035835 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:15:50.037911 (+ 2076us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:15:50.040712 (+ 2801us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:15:50.040718 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:15:50.040729 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:15:50.041130 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:15:50.041413 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:15:50.041416 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:15:50.041418 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:15:50.041583 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:15:50.041995 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:15:50.042000 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:15:50.042272 (+ 272us) client_negotiation.cc:769] Sending connection context
0809 20:15:50.042554 (+ 282us) client_negotiation.cc:240] Negotiation successful
0809 20:15:50.043076 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":255,"threads_started":1}
I20260809 20:15:50.045449 11294 heartbeater.cc:347] Connected to a master server at 127.14.181.62:44023
I20260809 20:15:50.045719 11294 heartbeater.cc:464] Registering TS with master...
I20260809 20:15:50.046377 11294 heartbeater.cc:511] Master 127.14.181.62:44023 requested a full tablet report, sending...
I20260809 20:15:50.047655 10589 ts_manager.cc:194] Registered new tserver with Master: 4e405f21a7154c2a88576266a3b646a3 (127.14.181.3:41675)
I20260809 20:15:50.048473 10589 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.3@KRBTEST.COM'} at 127.14.181.3:46699
I20260809 20:15:50.056130 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 20:15:50.072523 10880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:50.060428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36976 (local address 127.14.181.62:44023)
0809 20:15:50.060595 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:50.060601 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:50.061004 (+ 403us) server_negotiation.cc:407] Connection header received
0809 20:15:50.061151 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:50.061154 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:50.061223 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:50.061297 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:50.062690 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.063410 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.064719 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.065104 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.065205 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:50.067448 (+ 2243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:50.067453 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:50.067456 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:15:50.067485 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:50.069863 (+ 2378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:50.070676 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:50.070679 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:50.070682 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:50.070814 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:50.071195 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:50.071198 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:50.071200 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:50.071524 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:50.071715 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:50.072077 (+ 362us) server_negotiation.cc:299] Negotiation successful
0809 20:15:50.072271 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 20:15:50.076393 10589 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36976:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 20:15:50.082983 10589 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 20:15:50.100855 10878 heartbeater.cc:503] Master 127.14.181.62:44023 was elected leader, sending a full tablet report...
I20260809 20:15:50.105126 11324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:50.093910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58906 (local address 127.14.181.1:46643)
0809 20:15:50.094848 (+ 938us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:50.094858 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:50.097012 (+ 2154us) server_negotiation.cc:407] Connection header received
0809 20:15:50.097111 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:50.097118 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:50.097319 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:50.097624 (+ 305us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:15:50.098441 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.100029 (+ 1588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.102794 (+ 2765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.104063 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.104197 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:50.104425 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:50.104676 (+ 251us) server_negotiation.cc:299] Negotiation successful
0809 20:15:50.104832 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":768,"thread_start_us":612,"threads_started":1}
I20260809 20:15:50.105175 11320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:50.093794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:46643 (local address 127.0.0.1:58906)
0809 20:15:50.096583 (+ 2789us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:50.096622 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:50.096827 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:50.097667 (+ 840us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:50.097674 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:50.097706 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:15:50.098256 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:50.098270 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.100152 (+ 1882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.100157 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:50.102648 (+ 2491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:50.102664 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.104243 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.104250 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:50.104443 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:50.104493 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 20:15:50.104595 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 20:15:50.104764 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2470,"mutex_wait_us":94,"spinlock_wait_cycles":7808,"thread_start_us":1089,"threads_started":1}
I20260809 20:15:50.106302 11329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:50.094916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:41675 (local address 127.0.0.1:36140)
0809 20:15:50.096856 (+ 1940us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:50.096872 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:50.096995 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:50.097711 (+ 716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:50.097715 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:50.097753 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:15:50.098438 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:50.098452 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.101805 (+ 3353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.101811 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:50.103867 (+ 2056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:50.103880 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.105519 (+ 1639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.105525 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:50.105700 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:50.105735 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 20:15:50.105793 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 20:15:50.105910 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1808,"mutex_wait_us":1,"spinlock_wait_cycles":384,"thread_start_us":1214,"threads_started":1}
I20260809 20:15:50.106477 11332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:50.093995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:45701 (local address 127.0.0.1:44670)
0809 20:15:50.096650 (+ 2655us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:50.096666 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:50.096887 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:50.097748 (+ 861us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:50.097752 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:50.097778 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:15:50.098450 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:50.098460 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.100360 (+ 1900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.100365 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:50.103694 (+ 3329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:50.103713 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.105739 (+ 2026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.105745 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:50.105884 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:50.105911 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 20:15:50.105981 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 20:15:50.106097 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2516,"mutex_wait_us":61,"thread_start_us":2562,"threads_started":1}
I20260809 20:15:50.106556 11330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:50.094590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44670 (local address 127.14.181.2:45701)
0809 20:15:50.095391 (+ 801us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:50.095399 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:50.096756 (+ 1357us) server_negotiation.cc:407] Connection header received
0809 20:15:50.097069 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:50.097077 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:50.097319 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:50.097478 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:15:50.098634 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.100104 (+ 1470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.103895 (+ 3791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.105292 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.105392 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:50.105563 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:50.106077 (+ 514us) server_negotiation.cc:299] Negotiation successful
0809 20:15:50.106252 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":649,"thread_start_us":545,"threads_started":1}
I20260809 20:15:50.107244 11331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:50.094715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36140 (local address 127.14.181.3:41675)
0809 20:15:50.095427 (+ 712us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:50.095434 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:50.097117 (+ 1683us) server_negotiation.cc:407] Connection header received
0809 20:15:50.097226 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:50.097284 (+ 58us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:50.097505 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:50.097898 (+ 393us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:15:50.100267 (+ 2369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.101686 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.104033 (+ 2347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.105292 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.106654 (+ 1362us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:50.106861 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:50.106910 (+ 49us) server_negotiation.cc:299] Negotiation successful
0809 20:15:50.107011 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":571,"thread_start_us":822,"threads_started":1}
I20260809 20:15:50.108923 10775 tablet_service.cc:1467] Processing CreateTablet for tablet 9320231216af439da6be048758e9d4aa (DEFAULT_TABLE table=test-table [id=63d94be0ef2d414e8e61d306d1514a82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:15:50.110055 10775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9320231216af439da6be048758e9d4aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:15:50.112231 11195 tablet_service.cc:1467] Processing CreateTablet for tablet 9320231216af439da6be048758e9d4aa (DEFAULT_TABLE table=test-table [id=63d94be0ef2d414e8e61d306d1514a82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:15:50.113571 11195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9320231216af439da6be048758e9d4aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:15:50.115525 10984 tablet_service.cc:1467] Processing CreateTablet for tablet 9320231216af439da6be048758e9d4aa (DEFAULT_TABLE table=test-table [id=63d94be0ef2d414e8e61d306d1514a82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:15:50.116765 10984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9320231216af439da6be048758e9d4aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:15:50.120749 11333 tablet_bootstrap.cc:492] T 9320231216af439da6be048758e9d4aa P 8fb7f51a949e47c2884a47d1b72f4d19: Bootstrap starting.
I20260809 20:15:50.123754 11333 tablet_bootstrap.cc:654] T 9320231216af439da6be048758e9d4aa P 8fb7f51a949e47c2884a47d1b72f4d19: Neither blocks nor log segments found. Creating new log.
I20260809 20:15:50.124686 11333 log.cc:824] T 9320231216af439da6be048758e9d4aa P 8fb7f51a949e47c2884a47d1b72f4d19: Log is configured to *not* fsync() on all Append() calls
I20260809 20:15:50.127269 11337 tablet_bootstrap.cc:492] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3: Bootstrap starting.
I20260809 20:15:50.127563 11333 tablet_bootstrap.cc:492] T 9320231216af439da6be048758e9d4aa P 8fb7f51a949e47c2884a47d1b72f4d19: No bootstrap required, opened a new log
I20260809 20:15:50.127897 11333 ts_tablet_manager.cc:1397] T 9320231216af439da6be048758e9d4aa P 8fb7f51a949e47c2884a47d1b72f4d19: Time spent bootstrapping tablet: real 0.007s user 0.007s sys 0.000s
I20260809 20:15:50.130050 11338 tablet_bootstrap.cc:492] T 9320231216af439da6be048758e9d4aa P 00a6faf56fe04a28befc5ab060c156d9: Bootstrap starting.
I20260809 20:15:50.130590 11337 tablet_bootstrap.cc:654] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3: Neither blocks nor log segments found. Creating new log.
I20260809 20:15:50.131805 11337 log.cc:824] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3: Log is configured to *not* fsync() on all Append() calls
I20260809 20:15:50.132771 11338 tablet_bootstrap.cc:654] T 9320231216af439da6be048758e9d4aa P 00a6faf56fe04a28befc5ab060c156d9: Neither blocks nor log segments found. Creating new log.
I20260809 20:15:50.133773 11338 log.cc:824] T 9320231216af439da6be048758e9d4aa P 00a6faf56fe04a28befc5ab060c156d9: Log is configured to *not* fsync() on all Append() calls
I20260809 20:15:50.135067 11337 tablet_bootstrap.cc:492] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3: No bootstrap required, opened a new log
I20260809 20:15:50.135319 11337 ts_tablet_manager.cc:1397] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260809 20:15:50.136490 11338 tablet_bootstrap.cc:492] T 9320231216af439da6be048758e9d4aa P 00a6faf56fe04a28befc5ab060c156d9: No bootstrap required, opened a new log
I20260809 20:15:50.136704 11338 ts_tablet_manager.cc:1397] T 9320231216af439da6be048758e9d4aa P 00a6faf56fe04a28befc5ab060c156d9: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260809 20:15:50.137521 11333 raft_consensus.cc:348] T 9320231216af439da6be048758e9d4aa P 8fb7f51a949e47c2884a47d1b72f4d19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fb7f51a949e47c2884a47d1b72f4d19" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 46643 } } peers { permanent_uuid: "00a6faf56fe04a28befc5ab060c156d9" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 45701 } } peers { permanent_uuid: "4e405f21a7154c2a88576266a3b646a3" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 41675 } }
I20260809 20:15:50.137924 11333 raft_consensus.cc:374] T 9320231216af439da6be048758e9d4aa P 8fb7f51a949e47c2884a47d1b72f4d19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:15:50.138018 11333 raft_consensus.cc:729] T 9320231216af439da6be048758e9d4aa P 8fb7f51a949e47c2884a47d1b72f4d19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fb7f51a949e47c2884a47d1b72f4d19, State: Initialized, Role: FOLLOWER
I20260809 20:15:50.138620 11333 consensus_queue.cc:260] T 9320231216af439da6be048758e9d4aa P 8fb7f51a949e47c2884a47d1b72f4d19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fb7f51a949e47c2884a47d1b72f4d19" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 46643 } } peers { permanent_uuid: "00a6faf56fe04a28befc5ab060c156d9" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 45701 } } peers { permanent_uuid: "4e405f21a7154c2a88576266a3b646a3" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 41675 } }
I20260809 20:15:50.140290 11333 ts_tablet_manager.cc:1428] T 9320231216af439da6be048758e9d4aa P 8fb7f51a949e47c2884a47d1b72f4d19: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260809 20:15:50.145320 11337 raft_consensus.cc:348] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fb7f51a949e47c2884a47d1b72f4d19" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 46643 } } peers { permanent_uuid: "00a6faf56fe04a28befc5ab060c156d9" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 45701 } } peers { permanent_uuid: "4e405f21a7154c2a88576266a3b646a3" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 41675 } }
I20260809 20:15:50.145399 11338 raft_consensus.cc:348] T 9320231216af439da6be048758e9d4aa P 00a6faf56fe04a28befc5ab060c156d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fb7f51a949e47c2884a47d1b72f4d19" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 46643 } } peers { permanent_uuid: "00a6faf56fe04a28befc5ab060c156d9" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 45701 } } peers { permanent_uuid: "4e405f21a7154c2a88576266a3b646a3" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 41675 } }
I20260809 20:15:50.145763 11337 raft_consensus.cc:374] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:15:50.145829 11338 raft_consensus.cc:374] T 9320231216af439da6be048758e9d4aa P 00a6faf56fe04a28befc5ab060c156d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:15:50.145864 11337 raft_consensus.cc:729] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e405f21a7154c2a88576266a3b646a3, State: Initialized, Role: FOLLOWER
I20260809 20:15:50.145964 11338 raft_consensus.cc:729] T 9320231216af439da6be048758e9d4aa P 00a6faf56fe04a28befc5ab060c156d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00a6faf56fe04a28befc5ab060c156d9, State: Initialized, Role: FOLLOWER
I20260809 20:15:50.146441 11337 consensus_queue.cc:260] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fb7f51a949e47c2884a47d1b72f4d19" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 46643 } } peers { permanent_uuid: "00a6faf56fe04a28befc5ab060c156d9" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 45701 } } peers { permanent_uuid: "4e405f21a7154c2a88576266a3b646a3" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 41675 } }
I20260809 20:15:50.146513 11338 consensus_queue.cc:260] T 9320231216af439da6be048758e9d4aa P 00a6faf56fe04a28befc5ab060c156d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fb7f51a949e47c2884a47d1b72f4d19" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 46643 } } peers { permanent_uuid: "00a6faf56fe04a28befc5ab060c156d9" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 45701 } } peers { permanent_uuid: "4e405f21a7154c2a88576266a3b646a3" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 41675 } }
I20260809 20:15:50.147379 11294 heartbeater.cc:503] Master 127.14.181.62:44023 was elected leader, sending a full tablet report...
I20260809 20:15:50.147470 11082 heartbeater.cc:503] Master 127.14.181.62:44023 was elected leader, sending a full tablet report...
I20260809 20:15:50.148018 11337 ts_tablet_manager.cc:1428] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3: Time spent starting tablet: real 0.013s user 0.011s sys 0.000s
I20260809 20:15:50.148089 11338 ts_tablet_manager.cc:1428] T 9320231216af439da6be048758e9d4aa P 00a6faf56fe04a28befc5ab060c156d9: Time spent starting tablet: real 0.011s user 0.006s sys 0.005s
W20260809 20:15:50.275482 11296 tablet.cc:2369] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 20:15:50.298528 11083 tablet.cc:2369] T 9320231216af439da6be048758e9d4aa P 00a6faf56fe04a28befc5ab060c156d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 20:15:50.322827 10879 tablet.cc:2369] T 9320231216af439da6be048758e9d4aa P 8fb7f51a949e47c2884a47d1b72f4d19: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:15:50.429474 11345 raft_consensus.cc:482] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:15:50.429777 11345 raft_consensus.cc:504] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fb7f51a949e47c2884a47d1b72f4d19" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 46643 } } peers { permanent_uuid: "00a6faf56fe04a28befc5ab060c156d9" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 45701 } } peers { permanent_uuid: "4e405f21a7154c2a88576266a3b646a3" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 41675 } }
I20260809 20:15:50.431568 11345 leader_election.cc:288] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fb7f51a949e47c2884a47d1b72f4d19 (127.14.181.1:46643), 00a6faf56fe04a28befc5ab060c156d9 (127.14.181.2:45701)
I20260809 20:15:50.437724 11324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:50.432001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:53915 (local address 127.14.181.1:46643)
0809 20:15:50.432204 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:50.432210 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:50.432233 (+ 23us) server_negotiation.cc:407] Connection header received
0809 20:15:50.432490 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:50.432496 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:50.432576 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:50.432676 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:15:50.433116 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.434065 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.435880 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.436922 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.437038 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:50.437089 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:50.437442 (+ 353us) server_negotiation.cc:299] Negotiation successful
0809 20:15:50.437527 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 20:15:50.437840 11304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:50.431839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:46643 (local address 127.14.181.3:53915)
0809 20:15:50.432132 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:50.432151 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:50.432280 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:50.432733 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:50.432737 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:50.432764 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:15:50.432969 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:50.432981 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.434193 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.434199 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:50.435723 (+ 1524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:50.435735 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.437067 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.437073 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:50.437290 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:50.437326 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 20:15:50.437426 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 20:15:50.437556 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142}
I20260809 20:15:50.438668 11330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:50.432206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:51385 (local address 127.14.181.2:45701)
0809 20:15:50.432442 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:50.432449 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:50.432838 (+ 389us) server_negotiation.cc:407] Connection header received
0809 20:15:50.432993 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:50.432998 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:50.433077 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:50.433165 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:15:50.433763 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.434727 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.436655 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.437678 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.437828 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:50.437895 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:50.438315 (+ 420us) server_negotiation.cc:299] Negotiation successful
0809 20:15:50.438443 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 20:15:50.438767 11348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:50.431983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:45701 (local address 127.14.181.3:51385)
0809 20:15:50.432735 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:50.432751 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:50.432870 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:50.433219 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:50.433223 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:50.433249 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:15:50.433600 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:50.433612 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.434864 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.434868 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:50.436501 (+ 1633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:50.436516 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.437894 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.437900 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:50.438131 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:50.438174 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 20:15:50.438271 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 20:15:50.438413 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":629,"mutex_wait_us":4,"thread_start_us":439,"threads_started":1}
I20260809 20:15:50.439252 10812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9320231216af439da6be048758e9d4aa" candidate_uuid: "4e405f21a7154c2a88576266a3b646a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fb7f51a949e47c2884a47d1b72f4d19" is_pre_election: true
I20260809 20:15:50.439875 10812 raft_consensus.cc:2454] T 9320231216af439da6be048758e9d4aa P 8fb7f51a949e47c2884a47d1b72f4d19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e405f21a7154c2a88576266a3b646a3 in term 0.
I20260809 20:15:50.439777 11012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9320231216af439da6be048758e9d4aa" candidate_uuid: "4e405f21a7154c2a88576266a3b646a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00a6faf56fe04a28befc5ab060c156d9" is_pre_election: true
I20260809 20:15:50.440339 11012 raft_consensus.cc:2454] T 9320231216af439da6be048758e9d4aa P 00a6faf56fe04a28befc5ab060c156d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e405f21a7154c2a88576266a3b646a3 in term 0.
I20260809 20:15:50.440554 11119 leader_election.cc:302] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e405f21a7154c2a88576266a3b646a3, 8fb7f51a949e47c2884a47d1b72f4d19; no voters:
I20260809 20:15:50.440953 11345 raft_consensus.cc:2781] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:15:50.441097 11345 raft_consensus.cc:482] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:15:50.441196 11345 raft_consensus.cc:3037] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:15:50.443403 11345 raft_consensus.cc:504] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fb7f51a949e47c2884a47d1b72f4d19" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 46643 } } peers { permanent_uuid: "00a6faf56fe04a28befc5ab060c156d9" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 45701 } } peers { permanent_uuid: "4e405f21a7154c2a88576266a3b646a3" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 41675 } }
I20260809 20:15:50.443977 11345 leader_election.cc:288] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3 [CANDIDATE]: Term 1 election: Requested vote from peers 8fb7f51a949e47c2884a47d1b72f4d19 (127.14.181.1:46643), 00a6faf56fe04a28befc5ab060c156d9 (127.14.181.2:45701)
I20260809 20:15:50.444367 11012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9320231216af439da6be048758e9d4aa" candidate_uuid: "4e405f21a7154c2a88576266a3b646a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00a6faf56fe04a28befc5ab060c156d9"
I20260809 20:15:50.444389 10812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9320231216af439da6be048758e9d4aa" candidate_uuid: "4e405f21a7154c2a88576266a3b646a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fb7f51a949e47c2884a47d1b72f4d19"
I20260809 20:15:50.444525 11012 raft_consensus.cc:3037] T 9320231216af439da6be048758e9d4aa P 00a6faf56fe04a28befc5ab060c156d9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:15:50.444561 10812 raft_consensus.cc:3037] T 9320231216af439da6be048758e9d4aa P 8fb7f51a949e47c2884a47d1b72f4d19 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:15:50.446686 11012 raft_consensus.cc:2454] T 9320231216af439da6be048758e9d4aa P 00a6faf56fe04a28befc5ab060c156d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e405f21a7154c2a88576266a3b646a3 in term 1.
I20260809 20:15:50.446731 10812 raft_consensus.cc:2454] T 9320231216af439da6be048758e9d4aa P 8fb7f51a949e47c2884a47d1b72f4d19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e405f21a7154c2a88576266a3b646a3 in term 1.
I20260809 20:15:50.447049 11121 leader_election.cc:302] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00a6faf56fe04a28befc5ab060c156d9, 4e405f21a7154c2a88576266a3b646a3; no voters:
I20260809 20:15:50.447351 11345 raft_consensus.cc:2781] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:15:50.447772 11345 raft_consensus.cc:686] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3 [term 1 LEADER]: Becoming Leader. State: Replica: 4e405f21a7154c2a88576266a3b646a3, State: Running, Role: LEADER
I20260809 20:15:50.448274 11345 consensus_queue.cc:237] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fb7f51a949e47c2884a47d1b72f4d19" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 46643 } } peers { permanent_uuid: "00a6faf56fe04a28befc5ab060c156d9" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 45701 } } peers { permanent_uuid: "4e405f21a7154c2a88576266a3b646a3" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 41675 } }
I20260809 20:15:50.452508 10584 catalog_manager.cc:5495] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e405f21a7154c2a88576266a3b646a3 (127.14.181.3). New cstate: current_term: 1 leader_uuid: "4e405f21a7154c2a88576266a3b646a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fb7f51a949e47c2884a47d1b72f4d19" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 46643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00a6faf56fe04a28befc5ab060c156d9" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 45701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e405f21a7154c2a88576266a3b646a3" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 41675 } health_report { overall_health: HEALTHY } } }
I20260809 20:15:50.467411 11331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:50.462627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36154 (local address 127.14.181.3:41675)
0809 20:15:50.462806 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:50.462812 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:50.462938 (+ 126us) server_negotiation.cc:407] Connection header received
0809 20:15:50.463087 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:50.463090 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:50.463159 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:50.463268 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:15:50.463551 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.464235 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.465562 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.465932 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.466015 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:50.466480 (+ 465us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:15:50.466951 (+ 471us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:15:50.467057 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:50.467141 (+ 84us) server_negotiation.cc:299] Negotiation successful
0809 20:15:50.467202 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 20:15:50.474517 11012 raft_consensus.cc:1261] T 9320231216af439da6be048758e9d4aa P 00a6faf56fe04a28befc5ab060c156d9 [term 1 FOLLOWER]: Refusing update from remote peer 4e405f21a7154c2a88576266a3b646a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:15:50.474517 10812 raft_consensus.cc:1261] T 9320231216af439da6be048758e9d4aa P 8fb7f51a949e47c2884a47d1b72f4d19 [term 1 FOLLOWER]: Refusing update from remote peer 4e405f21a7154c2a88576266a3b646a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:15:50.475514 11349 consensus_queue.cc:1035] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fb7f51a949e47c2884a47d1b72f4d19" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 46643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:15:50.475811 11345 consensus_queue.cc:1035] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00a6faf56fe04a28befc5ab060c156d9" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 45701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:15:50.499390 10584 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36976:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:15:50.499684 10584 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36976:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:15:50.503618 10584 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 15556ce857934d30aaeb741fad3ace8f: Sending DeleteTablet for 3 replicas of tablet 9320231216af439da6be048758e9d4aa
I20260809 20:15:50.504649 10775 tablet_service.cc:1514] Processing DeleteTablet for tablet 9320231216af439da6be048758e9d4aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:15:50 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:58906
I20260809 20:15:50.504878 10984 tablet_service.cc:1514] Processing DeleteTablet for tablet 9320231216af439da6be048758e9d4aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:15:50 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:44670
I20260809 20:15:50.505687 11195 tablet_service.cc:1514] Processing DeleteTablet for tablet 9320231216af439da6be048758e9d4aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:15:50 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:36140
I20260809 20:15:50.512952 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 10687
Aug 09 20:15:50 dist-test-slave-6zbq krb5kdc[10519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306547, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.1@KRBTEST.COM
I20260809 20:15:50.530684 11370 tablet_replica.cc:330] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3: stopping tablet replica
I20260809 20:15:50.531090 11370 raft_consensus.cc:2229] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3 [term 1 LEADER]: Raft consensus shutting down.
I20260809 20:15:50.531702 11370 raft_consensus.cc:2258] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:15:50.532462 11369 tablet_replica.cc:330] T 9320231216af439da6be048758e9d4aa P 00a6faf56fe04a28befc5ab060c156d9: stopping tablet replica
I20260809 20:15:50.532850 11369 raft_consensus.cc:2229] T 9320231216af439da6be048758e9d4aa P 00a6faf56fe04a28befc5ab060c156d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:15:50.533342 11369 raft_consensus.cc:2258] T 9320231216af439da6be048758e9d4aa P 00a6faf56fe04a28befc5ab060c156d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:15:50.535526 11370 ts_tablet_manager.cc:1905] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:15:50.544463 11324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:50.514488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58908 (local address 127.14.181.1:46643)
0809 20:15:50.514665 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:50.514671 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:50.518811 (+ 4140us) server_negotiation.cc:407] Connection header received
0809 20:15:50.518962 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:50.518968 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:50.519087 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:50.519198 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:50.521095 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.522392 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.524470 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.525185 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.525301 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:50.531422 (+ 6121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:50.531440 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:50.531458 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:15:50.531501 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:50.540505 (+ 9004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:50.541504 (+ 999us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:50.541515 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:50.541520 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:50.541719 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:50.542204 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:50.542210 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:50.542214 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:50.542775 (+ 561us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:50.543085 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:50.543760 (+ 675us) server_negotiation.cc:299] Negotiation successful
0809 20:15:50.544006 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 20:15:50.547142 11369 ts_tablet_manager.cc:1905] T 9320231216af439da6be048758e9d4aa P 00a6faf56fe04a28befc5ab060c156d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:15:50.552392 11367 tablet_replica.cc:330] T 9320231216af439da6be048758e9d4aa P 8fb7f51a949e47c2884a47d1b72f4d19: stopping tablet replica
I20260809 20:15:50.552780 11367 raft_consensus.cc:2229] T 9320231216af439da6be048758e9d4aa P 8fb7f51a949e47c2884a47d1b72f4d19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:15:50.553274 11367 raft_consensus.cc:2258] T 9320231216af439da6be048758e9d4aa P 8fb7f51a949e47c2884a47d1b72f4d19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:15:50.559396 10871 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:15:50.561064 11370 ts_tablet_manager.cc:1918] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:15:50.561708 11370 log.cc:1196] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-2/wal/wals/9320231216af439da6be048758e9d4aa
I20260809 20:15:50.562304 11370 ts_tablet_manager.cc:1939] T 9320231216af439da6be048758e9d4aa P 4e405f21a7154c2a88576266a3b646a3: Deleting consensus metadata
I20260809 20:15:50.564626 11369 ts_tablet_manager.cc:1918] T 9320231216af439da6be048758e9d4aa P 00a6faf56fe04a28befc5ab060c156d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:15:50.564798 11369 log.cc:1196] T 9320231216af439da6be048758e9d4aa P 00a6faf56fe04a28befc5ab060c156d9: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786306256699363-15060-0/minicluster-data/ts-1/wal/wals/9320231216af439da6be048758e9d4aa
I20260809 20:15:50.565116 10564 catalog_manager.cc:4841] TS 4e405f21a7154c2a88576266a3b646a3 (127.14.181.3:41675): tablet 9320231216af439da6be048758e9d4aa (table test-table [id=63d94be0ef2d414e8e61d306d1514a82]) successfully deleted
I20260809 20:15:50.565332 11369 ts_tablet_manager.cc:1939] T 9320231216af439da6be048758e9d4aa P 00a6faf56fe04a28befc5ab060c156d9: Deleting consensus metadata
I20260809 20:15:50.566994 10567 catalog_manager.cc:4841] TS 00a6faf56fe04a28befc5ab060c156d9 (127.14.181.2:45701): tablet 9320231216af439da6be048758e9d4aa (table test-table [id=63d94be0ef2d414e8e61d306d1514a82]) successfully deleted
I20260809 20:15:50.673327 11367 ts_tablet_manager.cc:1905] T 9320231216af439da6be048758e9d4aa P 8fb7f51a949e47c2884a47d1b72f4d19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:15:50.674537 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 10687
I20260809 20:15:50.705698 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 10887
W20260809 20:15:50.705693 10566 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.181.1:46643 (error 108)
I20260809 20:15:50.710666 11378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:50.708929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:46643 (local address 127.0.0.1:58910)
0809 20:15:50.710404 (+ 1475us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:50.710510 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:46643: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1320,"thread_start_us":1228,"threads_started":1}
W20260809 20:15:50.710969 10566 catalog_manager.cc:4584] TS 8fb7f51a949e47c2884a47d1b72f4d19 (127.14.181.1:46643): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9320231216af439da6be048758e9d4aa: Network error: Client connection negotiation failed: client connection to 127.14.181.1:46643: connect: Connection refused (error 111)
Aug 09 20:15:50 dist-test-slave-6zbq krb5kdc[10519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306547, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.2@KRBTEST.COM
I20260809 20:15:50.722630 11330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:50.706652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44680 (local address 127.14.181.2:45701)
0809 20:15:50.706844 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:50.706850 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:50.707188 (+ 338us) server_negotiation.cc:407] Connection header received
0809 20:15:50.707273 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:50.707279 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:50.707357 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:50.707447 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:50.708744 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.709912 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.711838 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.712235 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.712340 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:50.717204 (+ 4864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:50.717218 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:50.717232 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:15:50.717267 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:50.719896 (+ 2629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:50.720535 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:50.720542 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:50.720545 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:50.720679 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:50.721050 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:50.721054 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:50.721056 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:50.721450 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:50.721718 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:50.722044 (+ 326us) server_negotiation.cc:299] Negotiation successful
0809 20:15:50.722254 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 20:15:50.723248 11071 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:15:50.764714 11378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:50.764173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:46643 (local address 127.0.0.1:58914)
0809 20:15:50.764419 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:50.764528 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:46643: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260809 20:15:50.765916 11378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:50.765507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:46643 (local address 127.0.0.1:58930)
0809 20:15:50.765662 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:50.765753 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:46643: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 20:15:50.810568 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 10887
I20260809 20:15:50.826570 11378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:50.825948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:46643 (local address 127.0.0.1:58938)
0809 20:15:50.826193 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:50.826324 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:46643: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260809 20:15:50.827795 11378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:50.827381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:46643 (local address 127.0.0.1:58954)
0809 20:15:50.827540 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:50.827628 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:46643: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 20:15:50.836107 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 11089
Aug 09 20:15:50 dist-test-slave-6zbq krb5kdc[10519](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306547, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.3@KRBTEST.COM
I20260809 20:15:50.853591 11331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:50.836818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36168 (local address 127.14.181.3:41675)
0809 20:15:50.837009 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:50.837015 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:50.837036 (+ 21us) server_negotiation.cc:407] Connection header received
0809 20:15:50.837136 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:50.837145 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:50.837229 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:50.837361 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:50.838845 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.840154 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.841542 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:50.842233 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:50.842496 (+ 263us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:50.846864 (+ 4368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:50.846881 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:50.846907 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:15:50.846966 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:50.850831 (+ 3865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:50.851448 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:50.851458 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:50.851462 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:50.851661 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:50.851990 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:50.851996 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:50.851999 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:50.852462 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:50.852814 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:50.852964 (+ 150us) server_negotiation.cc:299] Negotiation successful
0809 20:15:50.853179 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 20:15:50.854365 11289 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:15:50.908388 11378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:50.907942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:46643 (local address 127.0.0.1:58970)
0809 20:15:50.908155 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:50.908245 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:46643: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260809 20:15:50.909402 11378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:50.909029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:46643 (local address 127.0.0.1:58984)
0809 20:15:50.909213 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:50.909280 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:46643: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260809 20:15:50.973429 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 11089
I20260809 20:15:50.998461 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 10536
I20260809 20:15:50.999528 10632 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:15:51.106983 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 10536
2026-08-09T20:15:51Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4505 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-09T20:15:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:15:51Z Disabled control of system clock
I20260809 20:15:51.189805 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:33335
--webserver_interface=127.14.181.62
--webserver_port=0
--builtin_ntp_servers=127.14.181.20:43837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:33335
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 20:15:51.503783 11392 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:15:51.504037 11392 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:15:51.504151 11392 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:15:51.511158 11392 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:15:51.511261 11392 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:15:51.511323 11392 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:15:51.511404 11392 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:15:51.511459 11392 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:15:51.520188 11392 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:43837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:33335
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:33335
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:15:51.521342 11392 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:15:51.523013 11392 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:15:51.533948 11403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:51.534081 11401 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:51.534060 11410 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:15:51.534968 11392 server_base.cc:1034] running on GCE node
I20260809 20:15:51.535632 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:15:51.536867 11392 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:15:51.538067 11392 hybrid_clock.cc:648] HybridClock initialized: now 1786306551538022 us; error 32 us; skew 500 ppm
I20260809 20:15:51.538432 11392 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 20:15:51.544801 11392 webserver.cc:460] Webserver started at http://127.14.181.62:37759/ using document root <none> and password file <none>
I20260809 20:15:51.545460 11392 fs_manager.cc:359] Metadata directory not provided
I20260809 20:15:51.545560 11392 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:15:51.545858 11392 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:15:51.548745 11392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "f8fe192171a5432b8e8d331d6ce2432c"
format_stamp: "Formatted at 2026-08-09 20:15:51 on dist-test-slave-6zbq"
server_key: "66cb94675bc885bde02c650aa3c0efb6"
server_key_iv: "295626adc7042cb0390aa6b8294a9a3d"
server_key_version: "encryptionkey@0"
I20260809 20:15:51.549526 11392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "f8fe192171a5432b8e8d331d6ce2432c"
format_stamp: "Formatted at 2026-08-09 20:15:51 on dist-test-slave-6zbq"
server_key: "66cb94675bc885bde02c650aa3c0efb6"
server_key_iv: "295626adc7042cb0390aa6b8294a9a3d"
server_key_version: "encryptionkey@0"
I20260809 20:15:51.554440 11392 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260809 20:15:51.557590 11418 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:51.559051 11392 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 20:15:51.559254 11392 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "f8fe192171a5432b8e8d331d6ce2432c"
format_stamp: "Formatted at 2026-08-09 20:15:51 on dist-test-slave-6zbq"
server_key: "66cb94675bc885bde02c650aa3c0efb6"
server_key_iv: "295626adc7042cb0390aa6b8294a9a3d"
server_key_version: "encryptionkey@0"
I20260809 20:15:51.559448 11392 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:15:51.576767 11392 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:15:51.577507 11392 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:15:51.577759 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:15:51.594075 11392 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:33335
I20260809 20:15:51.594125 11496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:33335 every 8 connection(s)
I20260809 20:15:51.595348 11392 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:15:51.598770 11497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:15:51.600054 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 11392
I20260809 20:15:51.600246 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:15:51.600822 15060 external_mini_cluster.cc:1428] Setting key 4ce1be4d71e2af97ca064f2089eac59c
I20260809 20:15:51.612239 11497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8fe192171a5432b8e8d331d6ce2432c: Bootstrap starting.
I20260809 20:15:51.613675 11501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:51.602694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35816 (local address 127.14.181.62:33335)
0809 20:15:51.603671 (+ 977us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:51.603681 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:51.603724 (+ 43us) server_negotiation.cc:407] Connection header received
0809 20:15:51.605263 (+ 1539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:51.605285 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:51.605696 (+ 411us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:51.605996 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:51.606567 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:51.607771 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:51.609619 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:51.610282 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:51.610456 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:51.611600 (+ 1144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:51.611607 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:51.611619 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:15:51.612093 (+ 474us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:51.612180 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:15:51.612201 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:51.612285 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:51.612511 (+ 226us) server_negotiation.cc:299] Negotiation successful
0809 20:15:51.612789 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":343,"threads_started":1}
I20260809 20:15:51.615379 11497 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8fe192171a5432b8e8d331d6ce2432c: Neither blocks nor log segments found. Creating new log.
I20260809 20:15:51.616345 11497 log.cc:824] T 00000000000000000000000000000000 P f8fe192171a5432b8e8d331d6ce2432c: Log is configured to *not* fsync() on all Append() calls
I20260809 20:15:51.619225 11497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8fe192171a5432b8e8d331d6ce2432c: No bootstrap required, opened a new log
I20260809 20:15:51.625984 11497 raft_consensus.cc:348] T 00000000000000000000000000000000 P f8fe192171a5432b8e8d331d6ce2432c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8fe192171a5432b8e8d331d6ce2432c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33335 } }
I20260809 20:15:51.626307 11497 raft_consensus.cc:374] T 00000000000000000000000000000000 P f8fe192171a5432b8e8d331d6ce2432c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:15:51.626417 11497 raft_consensus.cc:729] T 00000000000000000000000000000000 P f8fe192171a5432b8e8d331d6ce2432c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8fe192171a5432b8e8d331d6ce2432c, State: Initialized, Role: FOLLOWER
I20260809 20:15:51.626876 11497 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8fe192171a5432b8e8d331d6ce2432c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8fe192171a5432b8e8d331d6ce2432c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33335 } }
I20260809 20:15:51.627071 11497 raft_consensus.cc:388] T 00000000000000000000000000000000 P f8fe192171a5432b8e8d331d6ce2432c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:15:51.627180 11497 raft_consensus.cc:482] T 00000000000000000000000000000000 P f8fe192171a5432b8e8d331d6ce2432c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:15:51.627293 11497 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f8fe192171a5432b8e8d331d6ce2432c [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:15:51.629225 11497 raft_consensus.cc:504] T 00000000000000000000000000000000 P f8fe192171a5432b8e8d331d6ce2432c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8fe192171a5432b8e8d331d6ce2432c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33335 } }
I20260809 20:15:51.629630 11497 leader_election.cc:302] T 00000000000000000000000000000000 P f8fe192171a5432b8e8d331d6ce2432c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f8fe192171a5432b8e8d331d6ce2432c; no voters:
I20260809 20:15:51.630110 11497 leader_election.cc:288] T 00000000000000000000000000000000 P f8fe192171a5432b8e8d331d6ce2432c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:15:51.630234 11504 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f8fe192171a5432b8e8d331d6ce2432c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:15:51.631161 11504 raft_consensus.cc:686] T 00000000000000000000000000000000 P f8fe192171a5432b8e8d331d6ce2432c [term 1 LEADER]: Becoming Leader. State: Replica: f8fe192171a5432b8e8d331d6ce2432c, State: Running, Role: LEADER
I20260809 20:15:51.631657 11504 consensus_queue.cc:237] T 00000000000000000000000000000000 P f8fe192171a5432b8e8d331d6ce2432c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8fe192171a5432b8e8d331d6ce2432c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33335 } }
I20260809 20:15:51.632093 11497 sys_catalog.cc:564] T 00000000000000000000000000000000 P f8fe192171a5432b8e8d331d6ce2432c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:15:51.634065 11507 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8fe192171a5432b8e8d331d6ce2432c [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8fe192171a5432b8e8d331d6ce2432c. Latest consensus state: current_term: 1 leader_uuid: "f8fe192171a5432b8e8d331d6ce2432c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8fe192171a5432b8e8d331d6ce2432c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33335 } } }
I20260809 20:15:51.634502 11507 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8fe192171a5432b8e8d331d6ce2432c [sys.catalog]: This master's current role is: LEADER
I20260809 20:15:51.635911 11522 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:15:51.636029 11505 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8fe192171a5432b8e8d331d6ce2432c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f8fe192171a5432b8e8d331d6ce2432c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8fe192171a5432b8e8d331d6ce2432c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33335 } } }
I20260809 20:15:51.636418 11505 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8fe192171a5432b8e8d331d6ce2432c [sys.catalog]: This master's current role is: LEADER
I20260809 20:15:51.640749 11522 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:15:51.650107 11522 catalog_manager.cc:1347] Generated new cluster ID: 764c44030ac64d7a8e4b0708b69488f8
I20260809 20:15:51.650207 11522 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:15:51.665647 11522 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:15:51.666958 11522 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:15:51.672134 11522 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f8fe192171a5432b8e8d331d6ce2432c: Generated new TSK 0
I20260809 20:15:51.672821 11522 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:15:51.683144 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:0
--local_ip_for_outbound_sockets=127.14.181.1
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:33335
--builtin_ntp_servers=127.14.181.20:43837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 20:15:52.001360 11539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:15:52.001603 11539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:15:52.001734 11539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:15:52.008756 11539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:15:52.008844 11539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:15:52.008981 11539 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:15:52.017602 11539 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:43837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:33335
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:15:52.018772 11539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:15:52.020414 11539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:15:52.032397 11545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:52.032315 11549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:52.032369 11546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:15:52.033025 11539 server_base.cc:1034] running on GCE node
I20260809 20:15:52.033614 11539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:15:52.034495 11539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:15:52.035691 11539 hybrid_clock.cc:648] HybridClock initialized: now 1786306552035639 us; error 46 us; skew 500 ppm
I20260809 20:15:52.035971 11539 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 20:15:52.037945 11539 webserver.cc:460] Webserver started at http://127.14.181.1:38771/ using document root <none> and password file <none>
I20260809 20:15:52.038637 11539 fs_manager.cc:359] Metadata directory not provided
I20260809 20:15:52.038741 11539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:15:52.039026 11539 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:15:52.041754 11539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-0/data/instance:
uuid: "829c84c75e0442d4aa7ddb13c1c4aa85"
format_stamp: "Formatted at 2026-08-09 20:15:52 on dist-test-slave-6zbq"
server_key: "4ea9c3bf44f816e1c2db0c890c0e03ae"
server_key_iv: "85bbda43e89247ae2d5d69a23ce29814"
server_key_version: "encryptionkey@0"
I20260809 20:15:52.042541 11539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance:
uuid: "829c84c75e0442d4aa7ddb13c1c4aa85"
format_stamp: "Formatted at 2026-08-09 20:15:52 on dist-test-slave-6zbq"
server_key: "4ea9c3bf44f816e1c2db0c890c0e03ae"
server_key_iv: "85bbda43e89247ae2d5d69a23ce29814"
server_key_version: "encryptionkey@0"
I20260809 20:15:52.047127 11539 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 20:15:52.050201 11557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:52.051403 11539 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 20:15:52.051544 11539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "829c84c75e0442d4aa7ddb13c1c4aa85"
format_stamp: "Formatted at 2026-08-09 20:15:52 on dist-test-slave-6zbq"
server_key: "4ea9c3bf44f816e1c2db0c890c0e03ae"
server_key_iv: "85bbda43e89247ae2d5d69a23ce29814"
server_key_version: "encryptionkey@0"
I20260809 20:15:52.051731 11539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:15:52.072124 11539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:15:52.072840 11539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:15:52.073107 11539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:15:52.073969 11539 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:15:52.075378 11539 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:15:52.075472 11539 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:52.075577 11539 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:15:52.075644 11539 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:52.104280 11539 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:34221
I20260809 20:15:52.104355 11758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:34221 every 8 connection(s)
I20260809 20:15:52.105454 11539 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:15:52.108873 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 11539
I20260809 20:15:52.109059 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance
I20260809 20:15:52.109604 15060 external_mini_cluster.cc:1428] Setting key 6483e9956ed23ccbe8f126a326242984
I20260809 20:15:52.112543 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:0
--local_ip_for_outbound_sockets=127.14.181.2
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:33335
--builtin_ntp_servers=127.14.181.20:43837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 20:15:52.118436 11501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:52.107785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:38979 (local address 127.14.181.62:33335)
0809 20:15:52.107985 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:52.107992 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:52.109415 (+ 1423us) server_negotiation.cc:407] Connection header received
0809 20:15:52.111298 (+ 1883us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:52.111303 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:52.111382 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:52.111494 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:52.112824 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:52.113696 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:52.115735 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:52.116236 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:52.116334 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:52.117741 (+ 1407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:52.117754 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:52.117758 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:15:52.117778 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:52.117810 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:15:52.117822 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:52.117897 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:52.118114 (+ 217us) server_negotiation.cc:299] Negotiation successful
0809 20:15:52.118191 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 20:15:52.119597 11764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:52.108312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:33335 (local address 127.14.181.1:38979)
0809 20:15:52.109260 (+ 948us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:52.109303 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:52.111027 (+ 1724us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:52.111748 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:52.111759 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:52.111867 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:15:52.112629 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:52.112667 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:52.113854 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:52.113860 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:52.115598 (+ 1738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:52.115614 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:52.116436 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:52.116443 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:52.116712 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:52.117406 (+ 694us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 20:15:52.117409 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:15:52.117470 (+ 61us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 20:15:52.117561 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:15:52.117920 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:15:52.117930 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:15:52.117938 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 20:15:52.118100 (+ 162us) client_negotiation.cc:240] Negotiation successful
0809 20:15:52.118475 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":302,"threads_started":1}
I20260809 20:15:52.120934 11759 heartbeater.cc:347] Connected to a master server at 127.14.181.62:33335
I20260809 20:15:52.121212 11759 heartbeater.cc:464] Registering TS with master...
I20260809 20:15:52.121889 11759 heartbeater.cc:511] Master 127.14.181.62:33335 requested a full tablet report, sending...
I20260809 20:15:52.123777 11442 ts_manager.cc:194] Registered new tserver with Master: 829c84c75e0442d4aa7ddb13c1c4aa85 (127.14.181.1:34221)
I20260809 20:15:52.125741 11442 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.181.1:38979
W20260809 20:15:52.429108 11765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:15:52.429354 11765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:15:52.429472 11765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:15:52.436499 11765 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:15:52.436590 11765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:15:52.436740 11765 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:15:52.445446 11765 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:43837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:33335
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:15:52.446810 11765 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:15:52.448760 11765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:15:52.460760 11773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:52.460731 11771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:52.460794 11770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:15:52.461763 11765 server_base.cc:1034] running on GCE node
I20260809 20:15:52.462407 11765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:15:52.463290 11765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:15:52.464485 11765 hybrid_clock.cc:648] HybridClock initialized: now 1786306552464432 us; error 45 us; skew 500 ppm
I20260809 20:15:52.464783 11765 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 20:15:52.466804 11765 webserver.cc:460] Webserver started at http://127.14.181.2:45947/ using document root <none> and password file <none>
I20260809 20:15:52.467408 11765 fs_manager.cc:359] Metadata directory not provided
I20260809 20:15:52.467506 11765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:15:52.467806 11765 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:15:52.470445 11765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-1/data/instance:
uuid: "503390c178e743f3bea8227aa80e0370"
format_stamp: "Formatted at 2026-08-09 20:15:52 on dist-test-slave-6zbq"
server_key: "1d74877a28b5d2523fef087003d0117f"
server_key_iv: "1682b6fb731f7b252757cc6b5a01c356"
server_key_version: "encryptionkey@0"
I20260809 20:15:52.471203 11765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance:
uuid: "503390c178e743f3bea8227aa80e0370"
format_stamp: "Formatted at 2026-08-09 20:15:52 on dist-test-slave-6zbq"
server_key: "1d74877a28b5d2523fef087003d0117f"
server_key_iv: "1682b6fb731f7b252757cc6b5a01c356"
server_key_version: "encryptionkey@0"
I20260809 20:15:52.475761 11765 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 20:15:52.478919 11786 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:52.480172 11765 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 20:15:52.480333 11765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "503390c178e743f3bea8227aa80e0370"
format_stamp: "Formatted at 2026-08-09 20:15:52 on dist-test-slave-6zbq"
server_key: "1d74877a28b5d2523fef087003d0117f"
server_key_iv: "1682b6fb731f7b252757cc6b5a01c356"
server_key_version: "encryptionkey@0"
I20260809 20:15:52.480532 11765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:15:52.503206 11765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:15:52.503885 11765 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:15:52.504146 11765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:15:52.505002 11765 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:15:52.506331 11765 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:15:52.506446 11765 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:52.506553 11765 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:15:52.506623 11765 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:52.535704 11765 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:39759
I20260809 20:15:52.535768 11964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:39759 every 8 connection(s)
I20260809 20:15:52.536948 11765 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:15:52.541893 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 11765
I20260809 20:15:52.542052 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance
I20260809 20:15:52.542479 15060 external_mini_cluster.cc:1428] Setting key 375ead50029ff87815c5225a29fa3b55
I20260809 20:15:52.544975 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:0
--local_ip_for_outbound_sockets=127.14.181.3
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:33335
--builtin_ntp_servers=127.14.181.20:43837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 20:15:52.548803 11501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:52.539292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:47265 (local address 127.14.181.62:33335)
0809 20:15:52.539452 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:52.539456 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:52.540722 (+ 1266us) server_negotiation.cc:407] Connection header received
0809 20:15:52.542606 (+ 1884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:52.542612 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:52.542697 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:52.542794 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:52.543907 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:52.544684 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:52.546220 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:52.546684 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:52.546809 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:52.548039 (+ 1230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:52.548046 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:52.548049 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:15:52.548065 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:52.548097 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:15:52.548109 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:52.548182 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:52.548393 (+ 211us) server_negotiation.cc:299] Negotiation successful
0809 20:15:52.548486 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 20:15:52.549770 11969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:52.539741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:33335 (local address 127.14.181.2:47265)
0809 20:15:52.540591 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:52.540624 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:52.542318 (+ 1694us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:52.543019 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:52.543027 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:52.543112 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:15:52.543738 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:52.543756 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:52.544854 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:52.544858 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:52.546080 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:52.546092 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:52.546895 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:52.546902 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:52.547123 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:52.547749 (+ 626us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 20:15:52.547752 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:15:52.547788 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 20:15:52.547862 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:15:52.548193 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:15:52.548204 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:15:52.548212 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 20:15:52.548368 (+ 156us) client_negotiation.cc:240] Negotiation successful
0809 20:15:52.548718 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":248,"threads_started":1}
I20260809 20:15:52.551110 11965 heartbeater.cc:347] Connected to a master server at 127.14.181.62:33335
I20260809 20:15:52.551425 11965 heartbeater.cc:464] Registering TS with master...
I20260809 20:15:52.552227 11965 heartbeater.cc:511] Master 127.14.181.62:33335 requested a full tablet report, sending...
I20260809 20:15:52.553639 11442 ts_manager.cc:194] Registered new tserver with Master: 503390c178e743f3bea8227aa80e0370 (127.14.181.2:39759)
I20260809 20:15:52.554548 11442 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.181.2:47265
W20260809 20:15:52.864514 11971 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:15:52.864775 11971 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:15:52.864897 11971 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:15:52.872004 11971 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:15:52.872097 11971 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:15:52.872236 11971 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:15:52.880808 11971 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:43837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:33335
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:15:52.881982 11971 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:15:52.883716 11971 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:15:52.895812 11989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:52.895866 11984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:52.895890 11983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:15:52.896898 11971 server_base.cc:1034] running on GCE node
I20260809 20:15:52.897428 11971 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:15:52.898262 11971 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:15:52.899456 11971 hybrid_clock.cc:648] HybridClock initialized: now 1786306552899403 us; error 44 us; skew 500 ppm
I20260809 20:15:52.899739 11971 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 20:15:52.901732 11971 webserver.cc:460] Webserver started at http://127.14.181.3:44803/ using document root <none> and password file <none>
I20260809 20:15:52.902356 11971 fs_manager.cc:359] Metadata directory not provided
I20260809 20:15:52.902468 11971 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:15:52.902748 11971 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:15:52.905448 11971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-2/data/instance:
uuid: "919b3fa51b654e18998e55656ae95ab7"
format_stamp: "Formatted at 2026-08-09 20:15:52 on dist-test-slave-6zbq"
server_key: "21190c11880f6098e5f71066cd5127c7"
server_key_iv: "c1885745e38a6689f5a47e5b0bb81db3"
server_key_version: "encryptionkey@0"
I20260809 20:15:52.906235 11971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance:
uuid: "919b3fa51b654e18998e55656ae95ab7"
format_stamp: "Formatted at 2026-08-09 20:15:52 on dist-test-slave-6zbq"
server_key: "21190c11880f6098e5f71066cd5127c7"
server_key_iv: "c1885745e38a6689f5a47e5b0bb81db3"
server_key_version: "encryptionkey@0"
I20260809 20:15:52.911123 11971 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 20:15:52.914208 11997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:52.915410 11971 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 20:15:52.915557 11971 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "919b3fa51b654e18998e55656ae95ab7"
format_stamp: "Formatted at 2026-08-09 20:15:52 on dist-test-slave-6zbq"
server_key: "21190c11880f6098e5f71066cd5127c7"
server_key_iv: "c1885745e38a6689f5a47e5b0bb81db3"
server_key_version: "encryptionkey@0"
I20260809 20:15:52.915752 11971 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:15:52.932777 11971 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:15:52.933468 11971 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:15:52.933737 11971 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:15:52.934607 11971 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:15:52.935931 11971 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:15:52.936033 11971 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:52.936127 11971 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:15:52.936195 11971 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:52.965062 11971 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:36321
I20260809 20:15:52.965122 12157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:36321 every 8 connection(s)
I20260809 20:15:52.966248 11971 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:15:52.972587 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 11971
I20260809 20:15:52.972740 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance
I20260809 20:15:52.973281 15060 external_mini_cluster.cc:1428] Setting key 0b33263ba2254ab2cfdd3a4ce77b0ded
I20260809 20:15:52.977938 11501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:52.968637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:41607 (local address 127.14.181.62:33335)
0809 20:15:52.968843 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:52.968849 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:52.970166 (+ 1317us) server_negotiation.cc:407] Connection header received
0809 20:15:52.971807 (+ 1641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:52.971811 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:52.971877 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:52.971962 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:52.972958 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:52.973892 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:52.975624 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:52.976172 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:52.976268 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:52.977368 (+ 1100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:52.977373 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:52.977377 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:15:52.977393 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:52.977424 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:15:52.977436 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:52.977501 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:52.977649 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 20:15:52.977724 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 20:15:52.978859 12164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:52.969171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:33335 (local address 127.14.181.3:41607)
0809 20:15:52.970006 (+ 835us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:52.970047 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:52.971585 (+ 1538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:52.972131 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:52.972138 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:52.972216 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:15:52.972769 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:52.972793 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:52.974055 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:52.974060 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:52.975466 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:52.975479 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:52.976354 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:52.976359 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:52.976551 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:52.977101 (+ 550us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 20:15:52.977103 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:15:52.977138 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 20:15:52.977207 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:15:52.977505 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:15:52.977510 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:15:52.977515 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 20:15:52.977632 (+ 117us) client_negotiation.cc:240] Negotiation successful
0809 20:15:52.977892 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":255,"threads_started":1}
I20260809 20:15:52.980068 12158 heartbeater.cc:347] Connected to a master server at 127.14.181.62:33335
I20260809 20:15:52.980321 12158 heartbeater.cc:464] Registering TS with master...
I20260809 20:15:52.980974 12158 heartbeater.cc:511] Master 127.14.181.62:33335 requested a full tablet report, sending...
I20260809 20:15:52.982201 11442 ts_manager.cc:194] Registered new tserver with Master: 919b3fa51b654e18998e55656ae95ab7 (127.14.181.3:36321)
I20260809 20:15:52.982951 11442 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.181.3:41607
I20260809 20:15:52.987833 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 20:15:52.996748 11501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:52.991532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35826 (local address 127.14.181.62:33335)
0809 20:15:52.991685 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:52.991689 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:52.992113 (+ 424us) server_negotiation.cc:407] Connection header received
0809 20:15:52.992274 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:52.992277 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:52.992369 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:52.992445 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:52.992867 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:52.993566 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:52.994888 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:52.995264 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:52.995349 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:52.996256 (+ 907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:52.996260 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:52.996262 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:15:52.996278 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:52.996302 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:15:52.996311 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:52.996367 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:52.996451 (+ 84us) server_negotiation.cc:299] Negotiation successful
0809 20:15:52.996513 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 20:15:53.000058 11442 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35826:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 20:15:53.006712 11442 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 20:15:53.038360 12189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:53.018752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54546 (local address 127.14.181.2:39759)
0809 20:15:53.029645 (+ 10893us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:53.029667 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:53.030417 (+ 750us) server_negotiation.cc:407] Connection header received
0809 20:15:53.030525 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:53.030533 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:53.030768 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:53.030945 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:15:53.031568 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:53.033098 (+ 1530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:53.036212 (+ 3114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:53.037372 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:53.037468 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:53.037643 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:53.037954 (+ 311us) server_negotiation.cc:299] Negotiation successful
0809 20:15:53.038066 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10723,"thread_start_us":10614,"threads_started":1}
I20260809 20:15:53.038481 12188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:53.017793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:39759 (local address 127.0.0.1:54546)
0809 20:15:53.030106 (+ 12313us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:53.030123 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:53.030246 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:53.030979 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:53.030987 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:53.031017 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:15:53.031388 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:53.031404 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:53.033273 (+ 1869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:53.033279 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:53.035940 (+ 2661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:53.035955 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:53.037549 (+ 1594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:53.037556 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:53.037753 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:53.037803 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 20:15:53.037929 (+ 126us) client_negotiation.cc:240] Negotiation successful
0809 20:15:53.038100 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12188,"mutex_wait_us":269,"thread_start_us":10353,"threads_started":1}
I20260809 20:15:53.039541 12187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:53.017577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:36321 (local address 127.0.0.1:47160)
0809 20:15:53.028546 (+ 10969us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:53.028595 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:53.028765 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:53.031060 (+ 2295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:53.031065 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:53.031093 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:15:53.031591 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:53.031616 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:53.033457 (+ 1841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:53.033462 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:53.036880 (+ 3418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:53.036895 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:53.038627 (+ 1732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:53.038633 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:53.039019 (+ 386us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:53.039046 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 20:15:53.039122 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 20:15:53.039205 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10706,"mutex_wait_us":174,"thread_start_us":12900,"threads_started":1}
I20260809 20:15:53.039732 12184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:53.018081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:34221 (local address 127.0.0.1:45186)
0809 20:15:53.030721 (+ 12640us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:53.030747 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:53.030862 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:53.031762 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:53.031766 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:53.031790 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:15:53.032026 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:53.032033 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:53.033508 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:53.033536 (+ 28us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:53.035808 (+ 2272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:53.035821 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:53.038935 (+ 3114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:53.038942 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:53.039164 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:53.039196 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 20:15:53.039284 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 20:15:53.039402 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12536,"mutex_wait_us":137,"thread_start_us":11733,"threads_started":1}
I20260809 20:15:53.040014 12190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:53.019145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45186 (local address 127.14.181.1:34221)
0809 20:15:53.029239 (+ 10094us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:53.029248 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:53.030852 (+ 1604us) server_negotiation.cc:407] Connection header received
0809 20:15:53.031051 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:53.031059 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:53.031276 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:53.031574 (+ 298us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:15:53.032230 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:53.033345 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:53.035989 (+ 2644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:53.036922 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:53.037039 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:53.037290 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:53.039346 (+ 2056us) server_negotiation.cc:299] Negotiation successful
0809 20:15:53.039518 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9932,"thread_start_us":9819,"threads_started":1}
I20260809 20:15:53.040254 12185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:53.017657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47160 (local address 127.14.181.3:36321)
0809 20:15:53.030491 (+ 12834us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:53.030499 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:53.030533 (+ 34us) server_negotiation.cc:407] Connection header received
0809 20:15:53.030639 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:53.030646 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:53.030864 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:53.031641 (+ 777us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:15:53.031896 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:53.033344 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:53.037071 (+ 3727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:53.038426 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:53.038555 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:53.038810 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:53.039782 (+ 972us) server_negotiation.cc:299] Negotiation successful
0809 20:15:53.039932 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12645,"thread_start_us":12508,"threads_started":1}
I20260809 20:15:53.042249 11866 tablet_service.cc:1467] Processing CreateTablet for tablet cbf58664e52147369abe482d506dc6c0 (DEFAULT_TABLE table=test-table [id=8124ff11016f47feb7299b586ad018b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:15:53.043417 12065 tablet_service.cc:1467] Processing CreateTablet for tablet cbf58664e52147369abe482d506dc6c0 (DEFAULT_TABLE table=test-table [id=8124ff11016f47feb7299b586ad018b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:15:53.043924 11866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbf58664e52147369abe482d506dc6c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:15:53.044624 12065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbf58664e52147369abe482d506dc6c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:15:53.045555 11645 tablet_service.cc:1467] Processing CreateTablet for tablet cbf58664e52147369abe482d506dc6c0 (DEFAULT_TABLE table=test-table [id=8124ff11016f47feb7299b586ad018b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:15:53.046849 11645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbf58664e52147369abe482d506dc6c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:15:53.054649 12191 tablet_bootstrap.cc:492] T cbf58664e52147369abe482d506dc6c0 P 919b3fa51b654e18998e55656ae95ab7: Bootstrap starting.
I20260809 20:15:53.057739 12191 tablet_bootstrap.cc:654] T cbf58664e52147369abe482d506dc6c0 P 919b3fa51b654e18998e55656ae95ab7: Neither blocks nor log segments found. Creating new log.
I20260809 20:15:53.058284 12193 tablet_bootstrap.cc:492] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370: Bootstrap starting.
I20260809 20:15:53.059768 12191 log.cc:824] T cbf58664e52147369abe482d506dc6c0 P 919b3fa51b654e18998e55656ae95ab7: Log is configured to *not* fsync() on all Append() calls
I20260809 20:15:53.061074 12194 tablet_bootstrap.cc:492] T cbf58664e52147369abe482d506dc6c0 P 829c84c75e0442d4aa7ddb13c1c4aa85: Bootstrap starting.
I20260809 20:15:53.061503 12193 tablet_bootstrap.cc:654] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370: Neither blocks nor log segments found. Creating new log.
I20260809 20:15:53.062590 12191 tablet_bootstrap.cc:492] T cbf58664e52147369abe482d506dc6c0 P 919b3fa51b654e18998e55656ae95ab7: No bootstrap required, opened a new log
I20260809 20:15:53.062774 12193 log.cc:824] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370: Log is configured to *not* fsync() on all Append() calls
I20260809 20:15:53.062847 12191 ts_tablet_manager.cc:1397] T cbf58664e52147369abe482d506dc6c0 P 919b3fa51b654e18998e55656ae95ab7: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.002s
I20260809 20:15:53.064270 12194 tablet_bootstrap.cc:654] T cbf58664e52147369abe482d506dc6c0 P 829c84c75e0442d4aa7ddb13c1c4aa85: Neither blocks nor log segments found. Creating new log.
I20260809 20:15:53.065063 12194 log.cc:824] T cbf58664e52147369abe482d506dc6c0 P 829c84c75e0442d4aa7ddb13c1c4aa85: Log is configured to *not* fsync() on all Append() calls
I20260809 20:15:53.065622 12193 tablet_bootstrap.cc:492] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370: No bootstrap required, opened a new log
I20260809 20:15:53.065888 12193 ts_tablet_manager.cc:1397] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260809 20:15:53.067317 12194 tablet_bootstrap.cc:492] T cbf58664e52147369abe482d506dc6c0 P 829c84c75e0442d4aa7ddb13c1c4aa85: No bootstrap required, opened a new log
I20260809 20:15:53.067569 12194 ts_tablet_manager.cc:1397] T cbf58664e52147369abe482d506dc6c0 P 829c84c75e0442d4aa7ddb13c1c4aa85: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.005s
I20260809 20:15:53.072576 12191 raft_consensus.cc:348] T cbf58664e52147369abe482d506dc6c0 P 919b3fa51b654e18998e55656ae95ab7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "919b3fa51b654e18998e55656ae95ab7" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36321 } } peers { permanent_uuid: "503390c178e743f3bea8227aa80e0370" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 39759 } } peers { permanent_uuid: "829c84c75e0442d4aa7ddb13c1c4aa85" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34221 } }
I20260809 20:15:53.072995 12191 raft_consensus.cc:374] T cbf58664e52147369abe482d506dc6c0 P 919b3fa51b654e18998e55656ae95ab7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:15:53.073082 12191 raft_consensus.cc:729] T cbf58664e52147369abe482d506dc6c0 P 919b3fa51b654e18998e55656ae95ab7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 919b3fa51b654e18998e55656ae95ab7, State: Initialized, Role: FOLLOWER
I20260809 20:15:53.073652 12191 consensus_queue.cc:260] T cbf58664e52147369abe482d506dc6c0 P 919b3fa51b654e18998e55656ae95ab7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "919b3fa51b654e18998e55656ae95ab7" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36321 } } peers { permanent_uuid: "503390c178e743f3bea8227aa80e0370" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 39759 } } peers { permanent_uuid: "829c84c75e0442d4aa7ddb13c1c4aa85" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34221 } }
I20260809 20:15:53.074720 12158 heartbeater.cc:503] Master 127.14.181.62:33335 was elected leader, sending a full tablet report...
I20260809 20:15:53.074738 12194 raft_consensus.cc:348] T cbf58664e52147369abe482d506dc6c0 P 829c84c75e0442d4aa7ddb13c1c4aa85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "919b3fa51b654e18998e55656ae95ab7" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36321 } } peers { permanent_uuid: "503390c178e743f3bea8227aa80e0370" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 39759 } } peers { permanent_uuid: "829c84c75e0442d4aa7ddb13c1c4aa85" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34221 } }
I20260809 20:15:53.075119 12194 raft_consensus.cc:374] T cbf58664e52147369abe482d506dc6c0 P 829c84c75e0442d4aa7ddb13c1c4aa85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:15:53.075203 12194 raft_consensus.cc:729] T cbf58664e52147369abe482d506dc6c0 P 829c84c75e0442d4aa7ddb13c1c4aa85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 829c84c75e0442d4aa7ddb13c1c4aa85, State: Initialized, Role: FOLLOWER
I20260809 20:15:53.075332 12191 ts_tablet_manager.cc:1428] T cbf58664e52147369abe482d506dc6c0 P 919b3fa51b654e18998e55656ae95ab7: Time spent starting tablet: real 0.012s user 0.011s sys 0.001s
I20260809 20:15:53.075531 12193 raft_consensus.cc:348] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "919b3fa51b654e18998e55656ae95ab7" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36321 } } peers { permanent_uuid: "503390c178e743f3bea8227aa80e0370" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 39759 } } peers { permanent_uuid: "829c84c75e0442d4aa7ddb13c1c4aa85" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34221 } }
I20260809 20:15:53.075821 12193 raft_consensus.cc:374] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:15:53.075911 12193 raft_consensus.cc:729] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503390c178e743f3bea8227aa80e0370, State: Initialized, Role: FOLLOWER
I20260809 20:15:53.075788 12194 consensus_queue.cc:260] T cbf58664e52147369abe482d506dc6c0 P 829c84c75e0442d4aa7ddb13c1c4aa85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "919b3fa51b654e18998e55656ae95ab7" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36321 } } peers { permanent_uuid: "503390c178e743f3bea8227aa80e0370" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 39759 } } peers { permanent_uuid: "829c84c75e0442d4aa7ddb13c1c4aa85" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34221 } }
I20260809 20:15:53.076459 12193 consensus_queue.cc:260] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "919b3fa51b654e18998e55656ae95ab7" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36321 } } peers { permanent_uuid: "503390c178e743f3bea8227aa80e0370" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 39759 } } peers { permanent_uuid: "829c84c75e0442d4aa7ddb13c1c4aa85" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34221 } }
I20260809 20:15:53.077744 12193 ts_tablet_manager.cc:1428] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20260809 20:15:53.078554 11965 heartbeater.cc:503] Master 127.14.181.62:33335 was elected leader, sending a full tablet report...
I20260809 20:15:53.079795 11759 heartbeater.cc:503] Master 127.14.181.62:33335 was elected leader, sending a full tablet report...
I20260809 20:15:53.079609 12194 ts_tablet_manager.cc:1428] T cbf58664e52147369abe482d506dc6c0 P 829c84c75e0442d4aa7ddb13c1c4aa85: Time spent starting tablet: real 0.012s user 0.009s sys 0.002s
W20260809 20:15:53.107482 11762 tablet.cc:2369] T cbf58664e52147369abe482d506dc6c0 P 829c84c75e0442d4aa7ddb13c1c4aa85: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 20:15:53.217875 12163 tablet.cc:2369] T cbf58664e52147369abe482d506dc6c0 P 919b3fa51b654e18998e55656ae95ab7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:15:53.265506 12200 raft_consensus.cc:482] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:15:53.265836 12200 raft_consensus.cc:504] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "919b3fa51b654e18998e55656ae95ab7" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36321 } } peers { permanent_uuid: "503390c178e743f3bea8227aa80e0370" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 39759 } } peers { permanent_uuid: "829c84c75e0442d4aa7ddb13c1c4aa85" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34221 } }
I20260809 20:15:53.267545 12200 leader_election.cc:288] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 919b3fa51b654e18998e55656ae95ab7 (127.14.181.3:36321), 829c84c75e0442d4aa7ddb13c1c4aa85 (127.14.181.1:34221)
I20260809 20:15:53.273985 12190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:53.268166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:39431 (local address 127.14.181.1:34221)
0809 20:15:53.268375 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:53.268381 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:53.269001 (+ 620us) server_negotiation.cc:407] Connection header received
0809 20:15:53.269189 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:53.269193 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:53.269252 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:53.269326 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:15:53.269928 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:53.270656 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:53.272399 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:53.273137 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:53.273268 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:53.273336 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:53.273631 (+ 295us) server_negotiation.cc:299] Negotiation successful
0809 20:15:53.273748 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 20:15:53.273988 12185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:53.267958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:43105 (local address 127.14.181.3:36321)
0809 20:15:53.268179 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:53.268186 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:53.268901 (+ 715us) server_negotiation.cc:407] Connection header received
0809 20:15:53.269082 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:53.269086 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:53.269156 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:53.269230 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:15:53.269817 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:53.270559 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:53.272359 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:53.273101 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:53.273262 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:53.273331 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:53.273646 (+ 315us) server_negotiation.cc:299] Negotiation successful
0809 20:15:53.273767 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260809 20:15:53.274076 12203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:53.267992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:34221 (local address 127.14.181.2:39431)
0809 20:15:53.268906 (+ 914us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:53.268923 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:53.269050 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:53.269366 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:53.269371 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:53.269411 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:15:53.269784 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:53.269794 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:53.270791 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:53.270795 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:53.272175 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:53.272188 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:53.273320 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:53.273327 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:53.273470 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:53.273512 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 20:15:53.273586 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 20:15:53.273713 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":795,"mutex_wait_us":1,"thread_start_us":568,"threads_started":1}
I20260809 20:15:53.274132 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:53.267956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:36321 (local address 127.14.181.2:43105)
0809 20:15:53.268791 (+ 835us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:53.268806 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:53.268927 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:53.269260 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:53.269264 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:53.269289 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:15:53.269669 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:53.269682 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:53.270687 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:53.270691 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:53.272171 (+ 1480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:53.272183 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:53.273302 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:53.273309 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:53.273458 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:53.273522 (+ 64us) client_negotiation.cc:769] Sending connection context
0809 20:15:53.273601 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 20:15:53.273733 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":666,"mutex_wait_us":39,"thread_start_us":476,"threads_started":1}
I20260809 20:15:53.275215 11678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbf58664e52147369abe482d506dc6c0" candidate_uuid: "503390c178e743f3bea8227aa80e0370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829c84c75e0442d4aa7ddb13c1c4aa85" is_pre_election: true
I20260809 20:15:53.275215 12093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbf58664e52147369abe482d506dc6c0" candidate_uuid: "503390c178e743f3bea8227aa80e0370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "919b3fa51b654e18998e55656ae95ab7" is_pre_election: true
I20260809 20:15:53.275771 12093 raft_consensus.cc:2454] T cbf58664e52147369abe482d506dc6c0 P 919b3fa51b654e18998e55656ae95ab7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503390c178e743f3bea8227aa80e0370 in term 0.
I20260809 20:15:53.275771 11678 raft_consensus.cc:2454] T cbf58664e52147369abe482d506dc6c0 P 829c84c75e0442d4aa7ddb13c1c4aa85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503390c178e743f3bea8227aa80e0370 in term 0.
I20260809 20:15:53.276388 11790 leader_election.cc:302] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503390c178e743f3bea8227aa80e0370, 919b3fa51b654e18998e55656ae95ab7; no voters:
I20260809 20:15:53.276721 12200 raft_consensus.cc:2781] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:15:53.276852 12200 raft_consensus.cc:482] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:15:53.276938 12200 raft_consensus.cc:3037] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:15:53.279083 12200 raft_consensus.cc:504] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "919b3fa51b654e18998e55656ae95ab7" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36321 } } peers { permanent_uuid: "503390c178e743f3bea8227aa80e0370" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 39759 } } peers { permanent_uuid: "829c84c75e0442d4aa7ddb13c1c4aa85" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34221 } }
I20260809 20:15:53.279606 12200 leader_election.cc:288] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370 [CANDIDATE]: Term 1 election: Requested vote from peers 919b3fa51b654e18998e55656ae95ab7 (127.14.181.3:36321), 829c84c75e0442d4aa7ddb13c1c4aa85 (127.14.181.1:34221)
I20260809 20:15:53.280097 12093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbf58664e52147369abe482d506dc6c0" candidate_uuid: "503390c178e743f3bea8227aa80e0370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "919b3fa51b654e18998e55656ae95ab7"
I20260809 20:15:53.280097 11678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbf58664e52147369abe482d506dc6c0" candidate_uuid: "503390c178e743f3bea8227aa80e0370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "829c84c75e0442d4aa7ddb13c1c4aa85"
I20260809 20:15:53.280299 12093 raft_consensus.cc:3037] T cbf58664e52147369abe482d506dc6c0 P 919b3fa51b654e18998e55656ae95ab7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:15:53.280299 11678 raft_consensus.cc:3037] T cbf58664e52147369abe482d506dc6c0 P 829c84c75e0442d4aa7ddb13c1c4aa85 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:15:53.283417 12093 raft_consensus.cc:2454] T cbf58664e52147369abe482d506dc6c0 P 919b3fa51b654e18998e55656ae95ab7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503390c178e743f3bea8227aa80e0370 in term 1.
I20260809 20:15:53.283417 11678 raft_consensus.cc:2454] T cbf58664e52147369abe482d506dc6c0 P 829c84c75e0442d4aa7ddb13c1c4aa85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503390c178e743f3bea8227aa80e0370 in term 1.
I20260809 20:15:53.283820 11788 leader_election.cc:302] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 503390c178e743f3bea8227aa80e0370, 829c84c75e0442d4aa7ddb13c1c4aa85, 919b3fa51b654e18998e55656ae95ab7; no voters:
I20260809 20:15:53.284122 12200 raft_consensus.cc:2781] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:15:53.284538 12200 raft_consensus.cc:686] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370 [term 1 LEADER]: Becoming Leader. State: Replica: 503390c178e743f3bea8227aa80e0370, State: Running, Role: LEADER
I20260809 20:15:53.284967 12200 consensus_queue.cc:237] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "919b3fa51b654e18998e55656ae95ab7" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36321 } } peers { permanent_uuid: "503390c178e743f3bea8227aa80e0370" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 39759 } } peers { permanent_uuid: "829c84c75e0442d4aa7ddb13c1c4aa85" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34221 } }
W20260809 20:15:53.288681 11966 tablet.cc:2369] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:15:53.289600 11442 catalog_manager.cc:5495] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370 reported cstate change: term changed from 0 to 1, leader changed from <none> to 503390c178e743f3bea8227aa80e0370 (127.14.181.2). New cstate: current_term: 1 leader_uuid: "503390c178e743f3bea8227aa80e0370" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "919b3fa51b654e18998e55656ae95ab7" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "503390c178e743f3bea8227aa80e0370" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 39759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "829c84c75e0442d4aa7ddb13c1c4aa85" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34221 } health_report { overall_health: UNKNOWN } } }
I20260809 20:15:53.319584 12189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:53.314835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54548 (local address 127.14.181.2:39759)
0809 20:15:53.314985 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:53.314990 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:53.315102 (+ 112us) server_negotiation.cc:407] Connection header received
0809 20:15:53.315269 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:53.315272 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:53.315356 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:53.315473 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:15:53.315760 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:53.316452 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:53.317743 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:53.318130 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:53.318222 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:53.318670 (+ 448us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:15:53.319158 (+ 488us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:15:53.319260 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:53.319348 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 20:15:53.319408 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 20:15:53.327031 12093 raft_consensus.cc:1261] T cbf58664e52147369abe482d506dc6c0 P 919b3fa51b654e18998e55656ae95ab7 [term 1 FOLLOWER]: Refusing update from remote peer 503390c178e743f3bea8227aa80e0370: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:15:53.327032 11678 raft_consensus.cc:1261] T cbf58664e52147369abe482d506dc6c0 P 829c84c75e0442d4aa7ddb13c1c4aa85 [term 1 FOLLOWER]: Refusing update from remote peer 503390c178e743f3bea8227aa80e0370: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:15:53.327896 12205 consensus_queue.cc:1035] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "829c84c75e0442d4aa7ddb13c1c4aa85" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 34221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:15:53.328219 12200 consensus_queue.cc:1035] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "919b3fa51b654e18998e55656ae95ab7" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 36321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:15:53.351488 11440 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35826:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:15:53.351815 11440 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35826:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:15:53.355592 11440 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f8fe192171a5432b8e8d331d6ce2432c: Sending DeleteTablet for 3 replicas of tablet cbf58664e52147369abe482d506dc6c0
I20260809 20:15:53.356562 12065 tablet_service.cc:1514] Processing DeleteTablet for tablet cbf58664e52147369abe482d506dc6c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:15:53 UTC) from {username='slave'} at 127.0.0.1:47160
I20260809 20:15:53.356671 11866 tablet_service.cc:1514] Processing DeleteTablet for tablet cbf58664e52147369abe482d506dc6c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:15:53 UTC) from {username='slave'} at 127.0.0.1:54546
I20260809 20:15:53.356673 11645 tablet_service.cc:1514] Processing DeleteTablet for tablet cbf58664e52147369abe482d506dc6c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:15:53 UTC) from {username='slave'} at 127.0.0.1:45186
I20260809 20:15:53.357347 12232 tablet_replica.cc:330] T cbf58664e52147369abe482d506dc6c0 P 919b3fa51b654e18998e55656ae95ab7: stopping tablet replica
I20260809 20:15:53.357770 12232 raft_consensus.cc:2229] T cbf58664e52147369abe482d506dc6c0 P 919b3fa51b654e18998e55656ae95ab7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:15:53.357939 12233 tablet_replica.cc:330] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370: stopping tablet replica
I20260809 20:15:53.358361 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 11539
I20260809 20:15:53.359241 12232 raft_consensus.cc:2258] T cbf58664e52147369abe482d506dc6c0 P 919b3fa51b654e18998e55656ae95ab7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:15:53.359679 12234 tablet_replica.cc:330] T cbf58664e52147369abe482d506dc6c0 P 829c84c75e0442d4aa7ddb13c1c4aa85: stopping tablet replica
I20260809 20:15:53.360206 12233 raft_consensus.cc:2229] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370 [term 1 LEADER]: Raft consensus shutting down.
I20260809 20:15:53.360678 12234 raft_consensus.cc:2229] T cbf58664e52147369abe482d506dc6c0 P 829c84c75e0442d4aa7ddb13c1c4aa85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:15:53.361253 12232 ts_tablet_manager.cc:1905] T cbf58664e52147369abe482d506dc6c0 P 919b3fa51b654e18998e55656ae95ab7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:15:53.361699 12234 raft_consensus.cc:2258] T cbf58664e52147369abe482d506dc6c0 P 829c84c75e0442d4aa7ddb13c1c4aa85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:15:53.362005 12233 raft_consensus.cc:2258] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:15:53.364929 12233 ts_tablet_manager.cc:1905] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:15:53.365769 12234 ts_tablet_manager.cc:1905] T cbf58664e52147369abe482d506dc6c0 P 829c84c75e0442d4aa7ddb13c1c4aa85: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:15:53.367797 12232 ts_tablet_manager.cc:1918] T cbf58664e52147369abe482d506dc6c0 P 919b3fa51b654e18998e55656ae95ab7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:15:53.367995 12232 log.cc:1196] T cbf58664e52147369abe482d506dc6c0 P 919b3fa51b654e18998e55656ae95ab7: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-2/wal/wals/cbf58664e52147369abe482d506dc6c0
I20260809 20:15:53.368541 12232 ts_tablet_manager.cc:1939] T cbf58664e52147369abe482d506dc6c0 P 919b3fa51b654e18998e55656ae95ab7: Deleting consensus metadata
I20260809 20:15:53.370179 11422 catalog_manager.cc:4841] TS 919b3fa51b654e18998e55656ae95ab7 (127.14.181.3:36321): tablet cbf58664e52147369abe482d506dc6c0 (table test-table [id=8124ff11016f47feb7299b586ad018b9]) successfully deleted
I20260809 20:15:53.371968 12233 ts_tablet_manager.cc:1918] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:15:53.372102 12233 log.cc:1196] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-1/wal/wals/cbf58664e52147369abe482d506dc6c0
I20260809 20:15:53.372532 12233 ts_tablet_manager.cc:1939] T cbf58664e52147369abe482d506dc6c0 P 503390c178e743f3bea8227aa80e0370: Deleting consensus metadata
I20260809 20:15:53.374001 11424 catalog_manager.cc:4841] TS 503390c178e743f3bea8227aa80e0370 (127.14.181.2:39759): tablet cbf58664e52147369abe482d506dc6c0 (table test-table [id=8124ff11016f47feb7299b586ad018b9]) successfully deleted
I20260809 20:15:53.379935 12234 ts_tablet_manager.cc:1918] T cbf58664e52147369abe482d506dc6c0 P 829c84c75e0442d4aa7ddb13c1c4aa85: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:15:53.380079 12234 log.cc:1196] T cbf58664e52147369abe482d506dc6c0 P 829c84c75e0442d4aa7ddb13c1c4aa85: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786306256699363-15060-0/minicluster-data/ts-0/wal/wals/cbf58664e52147369abe482d506dc6c0
I20260809 20:15:53.380600 12234 ts_tablet_manager.cc:1939] T cbf58664e52147369abe482d506dc6c0 P 829c84c75e0442d4aa7ddb13c1c4aa85: Deleting consensus metadata
I20260809 20:15:53.382144 11419 catalog_manager.cc:4841] TS 829c84c75e0442d4aa7ddb13c1c4aa85 (127.14.181.1:34221): tablet cbf58664e52147369abe482d506dc6c0 (table test-table [id=8124ff11016f47feb7299b586ad018b9]) successfully deleted
I20260809 20:15:53.382601 12190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:53.359391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45190 (local address 127.14.181.1:34221)
0809 20:15:53.359535 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:53.359541 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:53.374767 (+ 15226us) server_negotiation.cc:407] Connection header received
0809 20:15:53.375035 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:53.375041 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:53.375154 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:53.375254 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:53.375886 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:53.377012 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:53.378914 (+ 1902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:53.379581 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:53.379705 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:53.380943 (+ 1238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:53.380954 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:53.380969 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:15:53.381668 (+ 699us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:53.381723 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:15:53.381746 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:53.381869 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:53.382159 (+ 290us) server_negotiation.cc:299] Negotiation successful
0809 20:15:53.382271 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 20:15:53.383253 11750 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:15:53.469065 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 11539
I20260809 20:15:53.492305 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 11765
I20260809 20:15:53.500039 12189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:53.493005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54564 (local address 127.14.181.2:39759)
0809 20:15:53.493194 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:53.493200 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:53.493222 (+ 22us) server_negotiation.cc:407] Connection header received
0809 20:15:53.493347 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:53.493353 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:53.493481 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:53.493579 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:53.493950 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:53.495153 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:53.496429 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:53.497075 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:53.497204 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:53.498208 (+ 1004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:53.498220 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:53.498239 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:15:53.499260 (+ 1021us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:53.499324 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:15:53.499358 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:53.499465 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:53.499549 (+ 84us) server_negotiation.cc:299] Negotiation successful
0809 20:15:53.499655 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 20:15:53.500710 11958 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:15:53.607690 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 11765
I20260809 20:15:53.632853 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 11971
I20260809 20:15:53.639565 12185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:53.633577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47174 (local address 127.14.181.3:36321)
0809 20:15:53.633749 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:53.633754 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:53.633834 (+ 80us) server_negotiation.cc:407] Connection header received
0809 20:15:53.634019 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:53.634023 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:53.634101 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:53.634195 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:53.634643 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:53.635369 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:53.636716 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:53.637098 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:53.637219 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:53.638234 (+ 1015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:53.638244 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:53.638258 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:15:53.638858 (+ 600us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:53.638906 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:15:53.638927 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:53.639023 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:53.639160 (+ 137us) server_negotiation.cc:299] Negotiation successful
0809 20:15:53.639266 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 20:15:53.640148 12152 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:15:53.724560 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 11971
I20260809 20:15:53.741824 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 11392
I20260809 20:15:53.742859 11490 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:15:53.847057 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 11392
2026-08-09T20:15:53Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (2738 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:15:53 dist-test-slave-6zbq krb5kdc[12248](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:15:53 dist-test-slave-6zbq krb5kdc[12248](info): set up 2 sockets
Aug 09 20:15:53 dist-test-slave-6zbq krb5kdc[12248](info): commencing operation
krb5kdc: starting...
W20260809 20:15:55.053133 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.161s user 0.000s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:15:55 dist-test-slave-6zbq krb5kdc[12248](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306555, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:15:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:15:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:15:55.294756 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:40923
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:38877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:40923
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:15:55.611049 12266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:15:55.611315 12266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:15:55.611449 12266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:15:55.618332 12266 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:15:55.618448 12266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:15:55.618523 12266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:15:55.618608 12266 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:15:55.618667 12266 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:15:55.627861 12266 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:38877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:40923
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:40923
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:15:55.628930 12266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:15:55.630074 12266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:15:55.640945 12278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:55.640913 12281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:55.640920 12279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:15:55.641731 12266 server_base.cc:1034] running on GCE node
I20260809 20:15:55.642479 12266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:15:55.643705 12266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:15:55.644902 12266 hybrid_clock.cc:648] HybridClock initialized: now 1786306555644853 us; error 38 us; skew 500 ppm
I20260809 20:15:55.645217 12266 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:15:55 dist-test-slave-6zbq krb5kdc[12248](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306555, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:15:55.648247 12266 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:15:55.649612 12266 webserver.cc:460] Webserver started at http://127.14.181.62:43573/ using document root <none> and password file <none>
I20260809 20:15:55.650249 12266 fs_manager.cc:359] Metadata directory not provided
I20260809 20:15:55.650385 12266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:15:55.650663 12266 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:15:55.653434 12266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "6c092411d4424e37aab38ae7e76bd11c"
format_stamp: "Formatted at 2026-08-09 20:15:55 on dist-test-slave-6zbq"
server_key: "6201af695ee625991400b8ce86c11062"
server_key_iv: "7a076deaf1ad3146534d90071ec40b97"
server_key_version: "encryptionkey@0"
I20260809 20:15:55.654124 12266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "6c092411d4424e37aab38ae7e76bd11c"
format_stamp: "Formatted at 2026-08-09 20:15:55 on dist-test-slave-6zbq"
server_key: "6201af695ee625991400b8ce86c11062"
server_key_iv: "7a076deaf1ad3146534d90071ec40b97"
server_key_version: "encryptionkey@0"
I20260809 20:15:55.658854 12266 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 20:15:55.661975 12293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:55.663205 12266 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:15:55.663367 12266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "6c092411d4424e37aab38ae7e76bd11c"
format_stamp: "Formatted at 2026-08-09 20:15:55 on dist-test-slave-6zbq"
server_key: "6201af695ee625991400b8ce86c11062"
server_key_iv: "7a076deaf1ad3146534d90071ec40b97"
server_key_version: "encryptionkey@0"
I20260809 20:15:55.663540 12266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:15:55.708726 12266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:15:55.712682 12266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:15:55.712975 12266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:15:55.730177 12266 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:40923
I20260809 20:15:55.730199 12385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:40923 every 8 connection(s)
I20260809 20:15:55.731406 12266 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:15:55.734817 12386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:15:55.739307 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 12266
I20260809 20:15:55.739475 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:15:55.739912 15060 external_mini_cluster.cc:1428] Setting key 482b854374cc0fb33e2a92e4aceb3a48
I20260809 20:15:55.744892 12386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c092411d4424e37aab38ae7e76bd11c: Bootstrap starting.
I20260809 20:15:55.748328 12386 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c092411d4424e37aab38ae7e76bd11c: Neither blocks nor log segments found. Creating new log.
I20260809 20:15:55.749485 12386 log.cc:824] T 00000000000000000000000000000000 P 6c092411d4424e37aab38ae7e76bd11c: Log is configured to *not* fsync() on all Append() calls
I20260809 20:15:55.752640 12386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c092411d4424e37aab38ae7e76bd11c: No bootstrap required, opened a new log
Aug 09 20:15:55 dist-test-slave-6zbq krb5kdc[12248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306555, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:15:55.760839 12386 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c092411d4424e37aab38ae7e76bd11c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c092411d4424e37aab38ae7e76bd11c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 40923 } }
I20260809 20:15:55.761291 12386 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6c092411d4424e37aab38ae7e76bd11c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:15:55.761402 12386 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c092411d4424e37aab38ae7e76bd11c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c092411d4424e37aab38ae7e76bd11c, State: Initialized, Role: FOLLOWER
I20260809 20:15:55.761945 12386 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c092411d4424e37aab38ae7e76bd11c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c092411d4424e37aab38ae7e76bd11c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 40923 } }
I20260809 20:15:55.762198 12386 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6c092411d4424e37aab38ae7e76bd11c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:15:55.762372 12386 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c092411d4424e37aab38ae7e76bd11c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:15:55.762544 12386 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c092411d4424e37aab38ae7e76bd11c [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:15:55.762728 12391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:55.741535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56578 (local address 127.14.181.62:40923)
0809 20:15:55.742362 (+ 827us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:55.742377 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:55.742426 (+ 49us) server_negotiation.cc:407] Connection header received
0809 20:15:55.744073 (+ 1647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:55.744094 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:55.744439 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:55.744733 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:55.746515 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:55.747854 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:55.749618 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:55.750589 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:55.750774 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:55.755534 (+ 4760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:55.755542 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:55.755554 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:15:55.755594 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:55.758563 (+ 2969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:55.759377 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:55.759387 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:55.759393 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:55.759570 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:55.759977 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:55.759981 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:55.759983 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:55.760468 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:55.760670 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:55.761173 (+ 503us) server_negotiation.cc:299] Negotiation successful
0809 20:15:55.761569 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":351,"threads_started":1}
I20260809 20:15:55.764776 12386 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c092411d4424e37aab38ae7e76bd11c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c092411d4424e37aab38ae7e76bd11c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 40923 } }
I20260809 20:15:55.765322 12386 leader_election.cc:302] T 00000000000000000000000000000000 P 6c092411d4424e37aab38ae7e76bd11c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c092411d4424e37aab38ae7e76bd11c; no voters:
I20260809 20:15:55.765841 12386 leader_election.cc:288] T 00000000000000000000000000000000 P 6c092411d4424e37aab38ae7e76bd11c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:15:55.765944 12394 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6c092411d4424e37aab38ae7e76bd11c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:15:55.767158 12394 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6c092411d4424e37aab38ae7e76bd11c [term 1 LEADER]: Becoming Leader. State: Replica: 6c092411d4424e37aab38ae7e76bd11c, State: Running, Role: LEADER
I20260809 20:15:55.767711 12394 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c092411d4424e37aab38ae7e76bd11c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c092411d4424e37aab38ae7e76bd11c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 40923 } }
I20260809 20:15:55.767833 12386 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c092411d4424e37aab38ae7e76bd11c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:15:55.770460 12395 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c092411d4424e37aab38ae7e76bd11c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6c092411d4424e37aab38ae7e76bd11c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c092411d4424e37aab38ae7e76bd11c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 40923 } } }
I20260809 20:15:55.770892 12395 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c092411d4424e37aab38ae7e76bd11c [sys.catalog]: This master's current role is: LEADER
I20260809 20:15:55.770659 12396 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c092411d4424e37aab38ae7e76bd11c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c092411d4424e37aab38ae7e76bd11c. Latest consensus state: current_term: 1 leader_uuid: "6c092411d4424e37aab38ae7e76bd11c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c092411d4424e37aab38ae7e76bd11c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 40923 } } }
I20260809 20:15:55.771260 12396 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c092411d4424e37aab38ae7e76bd11c [sys.catalog]: This master's current role is: LEADER
I20260809 20:15:55.774966 12408 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:15:55.779652 12408 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:15:55.787755 12408 catalog_manager.cc:1347] Generated new cluster ID: 8db42703cebb46fbb3d3465b1cbece2e
I20260809 20:15:55.787855 12408 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:15:55.859490 12408 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:15:55.861331 12408 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:15:55.870533 12408 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6c092411d4424e37aab38ae7e76bd11c: Generated new TSK 0
I20260809 20:15:55.871436 12408 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.181.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
I20260809 20:15:55.943202 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:0
--local_ip_for_outbound_sockets=127.14.181.1
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:40923
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:38877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:15:56.257295 12431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:15:56.257534 12431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:15:56.257649 12431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:15:56.264602 12431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:15:56.264694 12431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:15:56.264839 12431 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:15:56.274145 12431 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:38877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:40923
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:15:56.275362 12431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:15:56.276557 12431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:15:56.288126 12440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:56.288218 12436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:56.288209 12437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:15:56.289155 12431 server_base.cc:1034] running on GCE node
I20260809 20:15:56.289652 12431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:15:56.290491 12431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:15:56.291687 12431 hybrid_clock.cc:648] HybridClock initialized: now 1786306556291651 us; error 32 us; skew 500 ppm
I20260809 20:15:56.291937 12431 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:15:56 dist-test-slave-6zbq krb5kdc[12248](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306556, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:15:56.294831 12431 init.cc:377] Logged in from keytab as kudu/127.14.181.1@KRBTEST.COM (short username kudu)
I20260809 20:15:56.296154 12431 webserver.cc:460] Webserver started at http://127.14.181.1:33265/ using document root <none> and password file <none>
I20260809 20:15:56.296737 12431 fs_manager.cc:359] Metadata directory not provided
I20260809 20:15:56.296849 12431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:15:56.297125 12431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:15:56.299803 12431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-0/data/instance:
uuid: "3a529deff93743b79e76ae537a6c82e4"
format_stamp: "Formatted at 2026-08-09 20:15:56 on dist-test-slave-6zbq"
server_key: "2f8a672f4d72f2be73522c1a6ff072b5"
server_key_iv: "2d5695a68e856ede053d5425a254dfd4"
server_key_version: "encryptionkey@0"
I20260809 20:15:56.300515 12431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance:
uuid: "3a529deff93743b79e76ae537a6c82e4"
format_stamp: "Formatted at 2026-08-09 20:15:56 on dist-test-slave-6zbq"
server_key: "2f8a672f4d72f2be73522c1a6ff072b5"
server_key_iv: "2d5695a68e856ede053d5425a254dfd4"
server_key_version: "encryptionkey@0"
I20260809 20:15:56.305161 12431 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 20:15:56.308661 12451 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:56.309803 12431 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 20:15:56.309943 12431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "3a529deff93743b79e76ae537a6c82e4"
format_stamp: "Formatted at 2026-08-09 20:15:56 on dist-test-slave-6zbq"
server_key: "2f8a672f4d72f2be73522c1a6ff072b5"
server_key_iv: "2d5695a68e856ede053d5425a254dfd4"
server_key_version: "encryptionkey@0"
I20260809 20:15:56.310108 12431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:15:56.327163 12431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:15:56.330955 12431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:15:56.331207 12431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:15:56.332062 12431 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:15:56.333276 12431 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:15:56.333345 12431 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:56.333457 12431 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:15:56.333508 12431 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:56.362671 12431 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:36515
I20260809 20:15:56.362712 12624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:36515 every 8 connection(s)
I20260809 20:15:56.363770 12431 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:15:56.366590 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 12431
I20260809 20:15:56.366756 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance
I20260809 20:15:56.367208 15060 external_mini_cluster.cc:1428] Setting key 05a04d056758d8945978063045da589f
Aug 09 20:15:56 dist-test-slave-6zbq krb5kdc[12248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306556, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:15:56.384912 12629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:56.366745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40923 (local address 127.14.181.1:59043)
0809 20:15:56.367543 (+ 798us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:56.367586 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:56.369509 (+ 1923us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:56.370177 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:56.370188 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:56.370853 (+ 665us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:15:56.371384 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:56.371401 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:56.372626 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:56.372630 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:56.373826 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:56.373838 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:56.374682 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:56.374687 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:56.374881 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:56.375559 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:15:56.375585 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:15:56.377730 (+ 2145us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:15:56.380950 (+ 3220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:15:56.380957 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:15:56.380967 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:15:56.381375 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:15:56.381741 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:15:56.381744 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:15:56.381747 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:15:56.381907 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:15:56.382516 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:15:56.382550 (+ 34us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:15:56.382952 (+ 402us) client_negotiation.cc:769] Sending connection context
0809 20:15:56.383253 (+ 301us) client_negotiation.cc:240] Negotiation successful
0809 20:15:56.383701 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":304,"threads_started":1}
I20260809 20:15:56.386075 12628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:56.366179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:59043 (local address 127.14.181.62:40923)
0809 20:15:56.366711 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:56.366717 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:56.367711 (+ 994us) server_negotiation.cc:407] Connection header received
0809 20:15:56.369804 (+ 2093us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:56.369810 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:56.369885 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:56.369986 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:56.371547 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:56.372487 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:56.373962 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:56.374494 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:56.374610 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:56.377935 (+ 3325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:56.377941 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:56.377945 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:15:56.377983 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:56.380809 (+ 2826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:56.381488 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:56.381495 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:56.381498 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:56.381649 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:56.382004 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:56.382008 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:56.382011 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:56.382387 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:56.382532 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:56.385537 (+ 3005us) server_negotiation.cc:299] Negotiation successful
0809 20:15:56.385757 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":282,"threads_started":1}
I20260809 20:15:56.387248 12625 heartbeater.cc:347] Connected to a master server at 127.14.181.62:40923
I20260809 20:15:56.387516 12625 heartbeater.cc:464] Registering TS with master...
I20260809 20:15:56.388165 12625 heartbeater.cc:511] Master 127.14.181.62:40923 requested a full tablet report, sending...
I20260809 20:15:56.390281 12318 ts_manager.cc:194] Registered new tserver with Master: 3a529deff93743b79e76ae537a6c82e4 (127.14.181.1:36515)
I20260809 20:15:56.392113 12318 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.1@KRBTEST.COM'} at 127.14.181.1:59043
WARNING: no policy specified for kudu/127.14.181.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
I20260809 20:15:56.427379 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:0
--local_ip_for_outbound_sockets=127.14.181.2
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:40923
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:38877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:15:56.738766 12635 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:15:56.739013 12635 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:15:56.739161 12635 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:15:56.746055 12635 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:15:56.746165 12635 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:15:56.746311 12635 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:15:56.755367 12635 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:38877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:40923
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:15:56.756392 12635 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:15:56.757567 12635 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:15:56.769362 12641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:56.769501 12644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:56.769553 12642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:15:56.770828 12635 server_base.cc:1034] running on GCE node
I20260809 20:15:56.771364 12635 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:15:56.772140 12635 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:15:56.773330 12635 hybrid_clock.cc:648] HybridClock initialized: now 1786306556773295 us; error 30 us; skew 500 ppm
I20260809 20:15:56.773578 12635 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:15:56 dist-test-slave-6zbq krb5kdc[12248](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306556, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:15:56.783406 12635 init.cc:377] Logged in from keytab as kudu/127.14.181.2@KRBTEST.COM (short username kudu)
I20260809 20:15:56.784883 12635 webserver.cc:460] Webserver started at http://127.14.181.2:37575/ using document root <none> and password file <none>
I20260809 20:15:56.785507 12635 fs_manager.cc:359] Metadata directory not provided
I20260809 20:15:56.785602 12635 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:15:56.785852 12635 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:15:56.788548 12635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-1/data/instance:
uuid: "e42370b97a8e43009b3864eade3ffe84"
format_stamp: "Formatted at 2026-08-09 20:15:56 on dist-test-slave-6zbq"
server_key: "363b933beb2e48d5bf8ca6ca111e256d"
server_key_iv: "a10e2fd7703383df1f10aa9a9ed9cec5"
server_key_version: "encryptionkey@0"
I20260809 20:15:56.789228 12635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance:
uuid: "e42370b97a8e43009b3864eade3ffe84"
format_stamp: "Formatted at 2026-08-09 20:15:56 on dist-test-slave-6zbq"
server_key: "363b933beb2e48d5bf8ca6ca111e256d"
server_key_iv: "a10e2fd7703383df1f10aa9a9ed9cec5"
server_key_version: "encryptionkey@0"
I20260809 20:15:56.793751 12635 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260809 20:15:56.796898 12654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:56.798152 12635 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 20:15:56.798280 12635 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "e42370b97a8e43009b3864eade3ffe84"
format_stamp: "Formatted at 2026-08-09 20:15:56 on dist-test-slave-6zbq"
server_key: "363b933beb2e48d5bf8ca6ca111e256d"
server_key_iv: "a10e2fd7703383df1f10aa9a9ed9cec5"
server_key_version: "encryptionkey@0"
I20260809 20:15:56.798484 12635 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:15:56.829420 12635 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:15:56.833205 12635 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:15:56.833420 12635 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:15:56.834259 12635 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:15:56.835459 12635 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:15:56.835530 12635 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:56.835620 12635 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:15:56.835662 12635 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:56.865372 12635 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:38923
I20260809 20:15:56.865382 12831 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:38923 every 8 connection(s)
I20260809 20:15:56.866760 12635 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:15:56.867115 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 12635
I20260809 20:15:56.867319 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance
I20260809 20:15:56.867871 15060 external_mini_cluster.cc:1428] Setting key 1c11b911c10462ff95a68ce03b340f47
Aug 09 20:15:56 dist-test-slave-6zbq krb5kdc[12248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306556, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:15:56.886755 12628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:56.869634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:40725 (local address 127.14.181.62:40923)
0809 20:15:56.869812 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:56.869819 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:56.871171 (+ 1352us) server_negotiation.cc:407] Connection header received
0809 20:15:56.872944 (+ 1773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:56.872950 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:56.873032 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:56.873130 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:56.874684 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:56.875494 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:56.877055 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:56.877492 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:56.877604 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:56.881180 (+ 3576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:56.881185 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:56.881189 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:15:56.881224 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:56.883755 (+ 2531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:56.884466 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:56.884470 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:56.884472 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:56.884605 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:56.885038 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:56.885041 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:56.885043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:56.885317 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:56.885450 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:56.886140 (+ 690us) server_negotiation.cc:299] Negotiation successful
0809 20:15:56.886408 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 20:15:56.887712 12836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:56.870154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40923 (local address 127.14.181.2:40725)
0809 20:15:56.870980 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:56.871027 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:56.872688 (+ 1661us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:56.873369 (+ 681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:56.873378 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:56.873899 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:15:56.874514 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:56.874535 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:56.875665 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:56.875670 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:56.876916 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:56.876929 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:56.877733 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:56.877742 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:56.877954 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:56.878608 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:15:56.878645 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:15:56.880926 (+ 2281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:15:56.883885 (+ 2959us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:15:56.883895 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:15:56.883914 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:15:56.884338 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:15:56.884718 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:15:56.884724 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:15:56.884728 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:15:56.884918 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:15:56.885442 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:15:56.885450 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:15:56.885790 (+ 340us) client_negotiation.cc:769] Sending connection context
0809 20:15:56.886024 (+ 234us) client_negotiation.cc:240] Negotiation successful
0809 20:15:56.886575 (+ 551us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":385,"threads_started":1}
I20260809 20:15:56.889058 12832 heartbeater.cc:347] Connected to a master server at 127.14.181.62:40923
I20260809 20:15:56.889341 12832 heartbeater.cc:464] Registering TS with master...
I20260809 20:15:56.890022 12832 heartbeater.cc:511] Master 127.14.181.62:40923 requested a full tablet report, sending...
I20260809 20:15:56.891466 12318 ts_manager.cc:194] Registered new tserver with Master: e42370b97a8e43009b3864eade3ffe84 (127.14.181.2:38923)
I20260809 20:15:56.892246 12318 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.2@KRBTEST.COM'} at 127.14.181.2:40725
WARNING: no policy specified for kudu/127.14.181.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
I20260809 20:15:56.927094 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:0
--local_ip_for_outbound_sockets=127.14.181.3
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:40923
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:38877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:15:57.236796 12839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:15:57.237030 12839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:15:57.237119 12839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:15:57.244436 12839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:15:57.244525 12839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:15:57.244637 12839 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:15:57.254611 12839 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:38877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:40923
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:15:57.255945 12839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:15:57.257465 12839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:15:57.270601 12848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:57.270543 12852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:57.270519 12850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:15:57.275388 12839 server_base.cc:1034] running on GCE node
I20260809 20:15:57.275964 12839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:15:57.276849 12839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:15:57.278054 12839 hybrid_clock.cc:648] HybridClock initialized: now 1786306557277996 us; error 50 us; skew 500 ppm
I20260809 20:15:57.278380 12839 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:15:57 dist-test-slave-6zbq krb5kdc[12248](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306557, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:15:57.281299 12839 init.cc:377] Logged in from keytab as kudu/127.14.181.3@KRBTEST.COM (short username kudu)
I20260809 20:15:57.282729 12839 webserver.cc:460] Webserver started at http://127.14.181.3:46383/ using document root <none> and password file <none>
I20260809 20:15:57.283373 12839 fs_manager.cc:359] Metadata directory not provided
I20260809 20:15:57.283485 12839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:15:57.283780 12839 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:15:57.286692 12839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-2/data/instance:
uuid: "badfa2f82ae3459782eb8f6b6f359ad1"
format_stamp: "Formatted at 2026-08-09 20:15:57 on dist-test-slave-6zbq"
server_key: "1e1469350cbbcb70d9223b7e9da17966"
server_key_iv: "8ce797328dd0f15b3df9fc1a0dd0ea37"
server_key_version: "encryptionkey@0"
I20260809 20:15:57.287421 12839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance:
uuid: "badfa2f82ae3459782eb8f6b6f359ad1"
format_stamp: "Formatted at 2026-08-09 20:15:57 on dist-test-slave-6zbq"
server_key: "1e1469350cbbcb70d9223b7e9da17966"
server_key_iv: "8ce797328dd0f15b3df9fc1a0dd0ea37"
server_key_version: "encryptionkey@0"
I20260809 20:15:57.292207 12839 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260809 20:15:57.295356 12867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:57.296540 12839 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 20:15:57.296675 12839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "badfa2f82ae3459782eb8f6b6f359ad1"
format_stamp: "Formatted at 2026-08-09 20:15:57 on dist-test-slave-6zbq"
server_key: "1e1469350cbbcb70d9223b7e9da17966"
server_key_iv: "8ce797328dd0f15b3df9fc1a0dd0ea37"
server_key_version: "encryptionkey@0"
I20260809 20:15:57.296838 12839 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:15:57.312265 12839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:15:57.316197 12839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:15:57.316449 12839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:15:57.317312 12839 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:15:57.318589 12839 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:15:57.318670 12839 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:57.318797 12839 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:15:57.318853 12839 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:57.347947 12839 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:44469
I20260809 20:15:57.347992 13032 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:44469 every 8 connection(s)
I20260809 20:15:57.349134 12839 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:15:57.350375 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 12839
I20260809 20:15:57.350548 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance
I20260809 20:15:57.351022 15060 external_mini_cluster.cc:1428] Setting key 343e431f2691e15af3081154b78b534c
Aug 09 20:15:57 dist-test-slave-6zbq krb5kdc[12248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306557, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:15:57.368996 12628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:57.351586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:58449 (local address 127.14.181.62:40923)
0809 20:15:57.351782 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:57.351788 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:57.353099 (+ 1311us) server_negotiation.cc:407] Connection header received
0809 20:15:57.355051 (+ 1952us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:57.355057 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:57.355133 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:57.355216 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:57.356606 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.357405 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.359129 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.359540 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.359647 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:57.362855 (+ 3208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:57.362862 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:57.362866 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:15:57.362905 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:57.366077 (+ 3172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:57.366767 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:57.366773 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:57.366777 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:57.366905 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:57.367307 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:57.367312 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:57.367316 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:57.367640 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:57.367770 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:57.368417 (+ 647us) server_negotiation.cc:299] Negotiation successful
0809 20:15:57.368638 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 20:15:57.369714 13039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:57.352176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:40923 (local address 127.14.181.3:58449)
0809 20:15:57.352956 (+ 780us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:57.353006 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:57.354778 (+ 1772us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:57.355453 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:57.355460 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:57.355922 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:15:57.356452 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:57.356469 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.357565 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.357569 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:57.358996 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:57.359008 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.359744 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.359751 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:57.359987 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:57.360526 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:15:57.360548 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:15:57.362663 (+ 2115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:15:57.366200 (+ 3537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:15:57.366209 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:15:57.366220 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:15:57.366650 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:15:57.367005 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:15:57.367010 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:15:57.367014 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:15:57.367195 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:15:57.367755 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:15:57.367762 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:15:57.368077 (+ 315us) client_negotiation.cc:769] Sending connection context
0809 20:15:57.368297 (+ 220us) client_negotiation.cc:240] Negotiation successful
0809 20:15:57.368730 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":296,"threads_started":1}
I20260809 20:15:57.370887 13033 heartbeater.cc:347] Connected to a master server at 127.14.181.62:40923
I20260809 20:15:57.371140 13033 heartbeater.cc:464] Registering TS with master...
I20260809 20:15:57.371784 13033 heartbeater.cc:511] Master 127.14.181.62:40923 requested a full tablet report, sending...
I20260809 20:15:57.373068 12318 ts_manager.cc:194] Registered new tserver with Master: badfa2f82ae3459782eb8f6b6f359ad1 (127.14.181.3:44469)
I20260809 20:15:57.373878 12318 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.3@KRBTEST.COM'} at 127.14.181.3:58449
I20260809 20:15:57.377799 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 20:15:57.394750 12628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:57.381717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56580 (local address 127.14.181.62:40923)
0809 20:15:57.381862 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:57.381866 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:57.382271 (+ 405us) server_negotiation.cc:407] Connection header received
0809 20:15:57.382425 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:57.382429 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:57.382485 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:57.382562 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:57.383972 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.384659 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.386234 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.386902 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.387036 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:57.389723 (+ 2687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:57.389729 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:57.389733 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:15:57.389762 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:57.392027 (+ 2265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:57.392765 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:57.392768 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:57.392771 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:57.392891 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:57.393358 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:57.393362 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:57.393364 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:57.393667 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:57.393906 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:57.394292 (+ 386us) server_negotiation.cc:299] Negotiation successful
0809 20:15:57.394486 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 20:15:57.394908 12625 heartbeater.cc:503] Master 127.14.181.62:40923 was elected leader, sending a full tablet report...
I20260809 20:15:57.398247 12317 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56580:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 20:15:57.404969 12317 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 20:15:57.443203 13056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:57.415927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:36515 (local address 127.0.0.1:39266)
0809 20:15:57.435434 (+ 19507us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:57.435474 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:57.435674 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:57.436434 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:57.436443 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:57.436471 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:15:57.436966 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:57.436979 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.438977 (+ 1998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.438983 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:57.440952 (+ 1969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:57.440965 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.442278 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.442286 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:57.442489 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:57.442526 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 20:15:57.442631 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 20:15:57.442819 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19263,"mutex_wait_us":24,"thread_start_us":19878,"threads_started":1}
I20260809 20:15:57.444119 13053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:57.416126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39266 (local address 127.14.181.1:36515)
0809 20:15:57.431252 (+ 15126us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:57.431261 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:57.435579 (+ 4318us) server_negotiation.cc:407] Connection header received
0809 20:15:57.435949 (+ 370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:57.435958 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:57.436202 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:57.436381 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:15:57.437370 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.438853 (+ 1483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.441117 (+ 2264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.442027 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.442146 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:57.442435 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:57.442690 (+ 255us) server_negotiation.cc:299] Negotiation successful
0809 20:15:57.442850 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14945,"thread_start_us":14772,"threads_started":1}
I20260809 20:15:57.444964 13058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:57.417233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54024 (local address 127.14.181.3:44469)
0809 20:15:57.434889 (+ 17656us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:57.434897 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:57.436855 (+ 1958us) server_negotiation.cc:407] Connection header received
0809 20:15:57.436959 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:57.436966 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:57.437184 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:57.437363 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:15:57.438299 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.439828 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.442422 (+ 2594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.443732 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.443857 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:57.444071 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:57.444602 (+ 531us) server_negotiation.cc:299] Negotiation successful
0809 20:15:57.444727 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17486,"thread_start_us":17317,"threads_started":1}
I20260809 20:15:57.445027 13055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:57.416562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:44469 (local address 127.0.0.1:54024)
0809 20:15:57.436579 (+ 20017us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:57.436596 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:57.436727 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:57.437629 (+ 902us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:57.437637 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:57.437696 (+ 59us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:15:57.438119 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:57.438132 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.439997 (+ 1865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.440003 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:57.442238 (+ 2235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:57.442253 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.444249 (+ 1996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.444258 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:57.444422 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:57.444454 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 20:15:57.444553 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 20:15:57.444671 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19873,"mutex_wait_us":24,"spinlock_wait_cycles":6016,"thread_start_us":18485,"threads_started":1}
I20260809 20:15:57.447211 13052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:57.416211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:38923 (local address 127.0.0.1:36232)
0809 20:15:57.436049 (+ 19838us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:57.436064 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:57.436152 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:57.437509 (+ 1357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:57.437514 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:57.437539 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:15:57.437952 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:57.437963 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.439810 (+ 1847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.439815 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:57.442110 (+ 2295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:57.442127 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.446414 (+ 4287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.446427 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:57.446600 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:57.446633 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 20:15:57.446746 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 20:15:57.446869 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19728,"mutex_wait_us":2,"thread_start_us":20101,"threads_started":1}
I20260809 20:15:57.447265 13057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:57.416745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36232 (local address 127.14.181.2:38923)
0809 20:15:57.436991 (+ 20246us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:57.436999 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:57.437025 (+ 26us) server_negotiation.cc:407] Connection header received
0809 20:15:57.437117 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:57.437124 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:57.437335 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:57.437499 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:15:57.438123 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.439644 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.442320 (+ 2676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.443740 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.443857 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:57.444031 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:57.446805 (+ 2774us) server_negotiation.cc:299] Negotiation successful
0809 20:15:57.446978 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20079,"thread_start_us":20379,"threads_started":1}
I20260809 20:15:57.447863 12523 tablet_service.cc:1467] Processing CreateTablet for tablet 49b7f0aceaa34aadb4ef4c294922ba38 (DEFAULT_TABLE table=test-table [id=fccc19ba7d0f4ed69b983e23669a6753]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:15:57.448462 12943 tablet_service.cc:1467] Processing CreateTablet for tablet 49b7f0aceaa34aadb4ef4c294922ba38 (DEFAULT_TABLE table=test-table [id=fccc19ba7d0f4ed69b983e23669a6753]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:15:57.449307 12523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49b7f0aceaa34aadb4ef4c294922ba38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:15:57.449832 12943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49b7f0aceaa34aadb4ef4c294922ba38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:15:57.451030 12733 tablet_service.cc:1467] Processing CreateTablet for tablet 49b7f0aceaa34aadb4ef4c294922ba38 (DEFAULT_TABLE table=test-table [id=fccc19ba7d0f4ed69b983e23669a6753]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:15:57.452343 12733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49b7f0aceaa34aadb4ef4c294922ba38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:15:57.460796 13059 tablet_bootstrap.cc:492] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1: Bootstrap starting.
I20260809 20:15:57.463335 13061 tablet_bootstrap.cc:492] T 49b7f0aceaa34aadb4ef4c294922ba38 P 3a529deff93743b79e76ae537a6c82e4: Bootstrap starting.
I20260809 20:15:57.464118 13059 tablet_bootstrap.cc:654] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1: Neither blocks nor log segments found. Creating new log.
I20260809 20:15:57.465410 13059 log.cc:824] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1: Log is configured to *not* fsync() on all Append() calls
I20260809 20:15:57.465656 13063 tablet_bootstrap.cc:492] T 49b7f0aceaa34aadb4ef4c294922ba38 P e42370b97a8e43009b3864eade3ffe84: Bootstrap starting.
I20260809 20:15:57.467666 13061 tablet_bootstrap.cc:654] T 49b7f0aceaa34aadb4ef4c294922ba38 P 3a529deff93743b79e76ae537a6c82e4: Neither blocks nor log segments found. Creating new log.
I20260809 20:15:57.468724 13061 log.cc:824] T 49b7f0aceaa34aadb4ef4c294922ba38 P 3a529deff93743b79e76ae537a6c82e4: Log is configured to *not* fsync() on all Append() calls
I20260809 20:15:57.469131 13063 tablet_bootstrap.cc:654] T 49b7f0aceaa34aadb4ef4c294922ba38 P e42370b97a8e43009b3864eade3ffe84: Neither blocks nor log segments found. Creating new log.
I20260809 20:15:57.469861 13059 tablet_bootstrap.cc:492] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1: No bootstrap required, opened a new log
I20260809 20:15:57.470145 13059 ts_tablet_manager.cc:1397] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260809 20:15:57.470314 13063 log.cc:824] T 49b7f0aceaa34aadb4ef4c294922ba38 P e42370b97a8e43009b3864eade3ffe84: Log is configured to *not* fsync() on all Append() calls
I20260809 20:15:57.471316 13061 tablet_bootstrap.cc:492] T 49b7f0aceaa34aadb4ef4c294922ba38 P 3a529deff93743b79e76ae537a6c82e4: No bootstrap required, opened a new log
I20260809 20:15:57.471565 13061 ts_tablet_manager.cc:1397] T 49b7f0aceaa34aadb4ef4c294922ba38 P 3a529deff93743b79e76ae537a6c82e4: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.001s
I20260809 20:15:57.473156 13063 tablet_bootstrap.cc:492] T 49b7f0aceaa34aadb4ef4c294922ba38 P e42370b97a8e43009b3864eade3ffe84: No bootstrap required, opened a new log
I20260809 20:15:57.473390 13063 ts_tablet_manager.cc:1397] T 49b7f0aceaa34aadb4ef4c294922ba38 P e42370b97a8e43009b3864eade3ffe84: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260809 20:15:57.478649 13061 raft_consensus.cc:348] T 49b7f0aceaa34aadb4ef4c294922ba38 P 3a529deff93743b79e76ae537a6c82e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a529deff93743b79e76ae537a6c82e4" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 36515 } } peers { permanent_uuid: "e42370b97a8e43009b3864eade3ffe84" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 38923 } } peers { permanent_uuid: "badfa2f82ae3459782eb8f6b6f359ad1" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44469 } }
I20260809 20:15:57.478982 13061 raft_consensus.cc:374] T 49b7f0aceaa34aadb4ef4c294922ba38 P 3a529deff93743b79e76ae537a6c82e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:15:57.479120 13061 raft_consensus.cc:729] T 49b7f0aceaa34aadb4ef4c294922ba38 P 3a529deff93743b79e76ae537a6c82e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a529deff93743b79e76ae537a6c82e4, State: Initialized, Role: FOLLOWER
I20260809 20:15:57.479662 13061 consensus_queue.cc:260] T 49b7f0aceaa34aadb4ef4c294922ba38 P 3a529deff93743b79e76ae537a6c82e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a529deff93743b79e76ae537a6c82e4" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 36515 } } peers { permanent_uuid: "e42370b97a8e43009b3864eade3ffe84" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 38923 } } peers { permanent_uuid: "badfa2f82ae3459782eb8f6b6f359ad1" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44469 } }
I20260809 20:15:57.480132 13059 raft_consensus.cc:348] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a529deff93743b79e76ae537a6c82e4" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 36515 } } peers { permanent_uuid: "e42370b97a8e43009b3864eade3ffe84" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 38923 } } peers { permanent_uuid: "badfa2f82ae3459782eb8f6b6f359ad1" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44469 } }
I20260809 20:15:57.480573 13059 raft_consensus.cc:374] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:15:57.480686 13059 raft_consensus.cc:729] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: badfa2f82ae3459782eb8f6b6f359ad1, State: Initialized, Role: FOLLOWER
I20260809 20:15:57.481256 13059 consensus_queue.cc:260] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a529deff93743b79e76ae537a6c82e4" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 36515 } } peers { permanent_uuid: "e42370b97a8e43009b3864eade3ffe84" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 38923 } } peers { permanent_uuid: "badfa2f82ae3459782eb8f6b6f359ad1" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44469 } }
I20260809 20:15:57.481468 13061 ts_tablet_manager.cc:1428] T 49b7f0aceaa34aadb4ef4c294922ba38 P 3a529deff93743b79e76ae537a6c82e4: Time spent starting tablet: real 0.010s user 0.007s sys 0.002s
I20260809 20:15:57.482321 13033 heartbeater.cc:503] Master 127.14.181.62:40923 was elected leader, sending a full tablet report...
I20260809 20:15:57.482848 13059 ts_tablet_manager.cc:1428] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260809 20:15:57.483294 13063 raft_consensus.cc:348] T 49b7f0aceaa34aadb4ef4c294922ba38 P e42370b97a8e43009b3864eade3ffe84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a529deff93743b79e76ae537a6c82e4" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 36515 } } peers { permanent_uuid: "e42370b97a8e43009b3864eade3ffe84" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 38923 } } peers { permanent_uuid: "badfa2f82ae3459782eb8f6b6f359ad1" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44469 } }
I20260809 20:15:57.483683 13063 raft_consensus.cc:374] T 49b7f0aceaa34aadb4ef4c294922ba38 P e42370b97a8e43009b3864eade3ffe84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:15:57.483795 13063 raft_consensus.cc:729] T 49b7f0aceaa34aadb4ef4c294922ba38 P e42370b97a8e43009b3864eade3ffe84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42370b97a8e43009b3864eade3ffe84, State: Initialized, Role: FOLLOWER
I20260809 20:15:57.485155 13063 consensus_queue.cc:260] T 49b7f0aceaa34aadb4ef4c294922ba38 P e42370b97a8e43009b3864eade3ffe84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a529deff93743b79e76ae537a6c82e4" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 36515 } } peers { permanent_uuid: "e42370b97a8e43009b3864eade3ffe84" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 38923 } } peers { permanent_uuid: "badfa2f82ae3459782eb8f6b6f359ad1" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44469 } }
I20260809 20:15:57.486382 12832 heartbeater.cc:503] Master 127.14.181.62:40923 was elected leader, sending a full tablet report...
I20260809 20:15:57.486789 13063 ts_tablet_manager.cc:1428] T 49b7f0aceaa34aadb4ef4c294922ba38 P e42370b97a8e43009b3864eade3ffe84: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
W20260809 20:15:57.600692 13034 tablet.cc:2369] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:15:57.605921 13068 raft_consensus.cc:482] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:15:57.606168 13068 raft_consensus.cc:504] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a529deff93743b79e76ae537a6c82e4" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 36515 } } peers { permanent_uuid: "e42370b97a8e43009b3864eade3ffe84" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 38923 } } peers { permanent_uuid: "badfa2f82ae3459782eb8f6b6f359ad1" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44469 } }
I20260809 20:15:57.607758 13068 leader_election.cc:288] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a529deff93743b79e76ae537a6c82e4 (127.14.181.1:36515), e42370b97a8e43009b3864eade3ffe84 (127.14.181.2:38923)
I20260809 20:15:57.613963 13039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:57.608035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:38923 (local address 127.14.181.3:52531)
0809 20:15:57.608366 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:57.608385 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:57.608527 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:57.608887 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:57.608891 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:57.608919 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:15:57.609131 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:57.609142 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.610289 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.610293 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:57.612139 (+ 1846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:57.612156 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.613432 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.613437 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:57.613565 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:57.613589 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 20:15:57.613668 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 20:15:57.613752 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"mutex_wait_us":38}
I20260809 20:15:57.614089 13057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:57.608312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:52531 (local address 127.14.181.2:38923)
0809 20:15:57.608540 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:57.608548 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:57.608574 (+ 26us) server_negotiation.cc:407] Connection header received
0809 20:15:57.608656 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:57.608661 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:57.608748 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:57.608845 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:15:57.609265 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.610169 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.612286 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.613304 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.613443 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:57.613513 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:57.613712 (+ 199us) server_negotiation.cc:299] Negotiation successful
0809 20:15:57.613840 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 20:15:57.614918 13053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:57.608117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:34235 (local address 127.14.181.1:36515)
0809 20:15:57.608545 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:57.608550 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:57.609103 (+ 553us) server_negotiation.cc:407] Connection header received
0809 20:15:57.609283 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:57.609289 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:57.609362 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:57.609447 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:15:57.609893 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.610743 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.612805 (+ 2062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.613913 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.614054 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:57.614119 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:57.614571 (+ 452us) server_negotiation.cc:299] Negotiation successful
0809 20:15:57.614693 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282}
I20260809 20:15:57.615015 13071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:57.608120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:36515 (local address 127.14.181.3:34235)
0809 20:15:57.608998 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:57.609015 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:57.609143 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:57.609457 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:57.609460 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:57.609478 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:15:57.609748 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:57.609755 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.610881 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.610886 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:57.612654 (+ 1768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:57.612664 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.614211 (+ 1547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.614217 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:57.614425 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:57.614450 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 20:15:57.614530 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 20:15:57.614653 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":764,"mutex_wait_us":1,"thread_start_us":557,"threads_started":1}
I20260809 20:15:57.615060 12766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49b7f0aceaa34aadb4ef4c294922ba38" candidate_uuid: "badfa2f82ae3459782eb8f6b6f359ad1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42370b97a8e43009b3864eade3ffe84" is_pre_election: true
I20260809 20:15:57.615567 12766 raft_consensus.cc:2454] T 49b7f0aceaa34aadb4ef4c294922ba38 P e42370b97a8e43009b3864eade3ffe84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate badfa2f82ae3459782eb8f6b6f359ad1 in term 0.
W20260809 20:15:57.616065 12626 tablet.cc:2369] T 49b7f0aceaa34aadb4ef4c294922ba38 P 3a529deff93743b79e76ae537a6c82e4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:15:57.615887 12556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49b7f0aceaa34aadb4ef4c294922ba38" candidate_uuid: "badfa2f82ae3459782eb8f6b6f359ad1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a529deff93743b79e76ae537a6c82e4" is_pre_election: true
I20260809 20:15:57.616123 12874 leader_election.cc:302] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: badfa2f82ae3459782eb8f6b6f359ad1, e42370b97a8e43009b3864eade3ffe84; no voters:
I20260809 20:15:57.616461 13068 raft_consensus.cc:2781] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:15:57.616562 13068 raft_consensus.cc:482] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:15:57.616477 12556 raft_consensus.cc:2454] T 49b7f0aceaa34aadb4ef4c294922ba38 P 3a529deff93743b79e76ae537a6c82e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate badfa2f82ae3459782eb8f6b6f359ad1 in term 0.
I20260809 20:15:57.616626 13068 raft_consensus.cc:3037] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1 [term 0 FOLLOWER]: Advancing to term 1
W20260809 20:15:57.618754 12835 tablet.cc:2369] T 49b7f0aceaa34aadb4ef4c294922ba38 P e42370b97a8e43009b3864eade3ffe84: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:15:57.618860 13068 raft_consensus.cc:504] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a529deff93743b79e76ae537a6c82e4" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 36515 } } peers { permanent_uuid: "e42370b97a8e43009b3864eade3ffe84" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 38923 } } peers { permanent_uuid: "badfa2f82ae3459782eb8f6b6f359ad1" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44469 } }
I20260809 20:15:57.619562 13068 leader_election.cc:288] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1 [CANDIDATE]: Term 1 election: Requested vote from peers 3a529deff93743b79e76ae537a6c82e4 (127.14.181.1:36515), e42370b97a8e43009b3864eade3ffe84 (127.14.181.2:38923)
I20260809 20:15:57.619894 12556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49b7f0aceaa34aadb4ef4c294922ba38" candidate_uuid: "badfa2f82ae3459782eb8f6b6f359ad1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a529deff93743b79e76ae537a6c82e4"
I20260809 20:15:57.620010 12766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49b7f0aceaa34aadb4ef4c294922ba38" candidate_uuid: "badfa2f82ae3459782eb8f6b6f359ad1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42370b97a8e43009b3864eade3ffe84"
I20260809 20:15:57.620107 12556 raft_consensus.cc:3037] T 49b7f0aceaa34aadb4ef4c294922ba38 P 3a529deff93743b79e76ae537a6c82e4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:15:57.620213 12766 raft_consensus.cc:3037] T 49b7f0aceaa34aadb4ef4c294922ba38 P e42370b97a8e43009b3864eade3ffe84 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:15:57.623332 12766 raft_consensus.cc:2454] T 49b7f0aceaa34aadb4ef4c294922ba38 P e42370b97a8e43009b3864eade3ffe84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate badfa2f82ae3459782eb8f6b6f359ad1 in term 1.
I20260809 20:15:57.623332 12556 raft_consensus.cc:2454] T 49b7f0aceaa34aadb4ef4c294922ba38 P 3a529deff93743b79e76ae537a6c82e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate badfa2f82ae3459782eb8f6b6f359ad1 in term 1.
I20260809 20:15:57.623746 12874 leader_election.cc:302] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: badfa2f82ae3459782eb8f6b6f359ad1, e42370b97a8e43009b3864eade3ffe84; no voters:
I20260809 20:15:57.624018 13068 raft_consensus.cc:2781] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:15:57.624429 13068 raft_consensus.cc:686] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1 [term 1 LEADER]: Becoming Leader. State: Replica: badfa2f82ae3459782eb8f6b6f359ad1, State: Running, Role: LEADER
I20260809 20:15:57.624877 13068 consensus_queue.cc:237] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a529deff93743b79e76ae537a6c82e4" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 36515 } } peers { permanent_uuid: "e42370b97a8e43009b3864eade3ffe84" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 38923 } } peers { permanent_uuid: "badfa2f82ae3459782eb8f6b6f359ad1" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44469 } }
I20260809 20:15:57.629585 12316 catalog_manager.cc:5495] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1 reported cstate change: term changed from 0 to 1, leader changed from <none> to badfa2f82ae3459782eb8f6b6f359ad1 (127.14.181.3). New cstate: current_term: 1 leader_uuid: "badfa2f82ae3459782eb8f6b6f359ad1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a529deff93743b79e76ae537a6c82e4" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 36515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42370b97a8e43009b3864eade3ffe84" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 38923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "badfa2f82ae3459782eb8f6b6f359ad1" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 44469 } health_report { overall_health: HEALTHY } } }
I20260809 20:15:57.683670 13058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:57.678408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54038 (local address 127.14.181.3:44469)
0809 20:15:57.678593 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:57.678599 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:57.678616 (+ 17us) server_negotiation.cc:407] Connection header received
0809 20:15:57.678815 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:57.678820 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:57.678905 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:57.679030 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:15:57.679449 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.680203 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.681580 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.681971 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.682077 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:57.682675 (+ 598us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:15:57.683126 (+ 451us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:15:57.683288 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:57.683426 (+ 138us) server_negotiation.cc:299] Negotiation successful
0809 20:15:57.683468 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 20:15:57.691013 12766 raft_consensus.cc:1261] T 49b7f0aceaa34aadb4ef4c294922ba38 P e42370b97a8e43009b3864eade3ffe84 [term 1 FOLLOWER]: Refusing update from remote peer badfa2f82ae3459782eb8f6b6f359ad1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:15:57.691013 12556 raft_consensus.cc:1261] T 49b7f0aceaa34aadb4ef4c294922ba38 P 3a529deff93743b79e76ae537a6c82e4 [term 1 FOLLOWER]: Refusing update from remote peer badfa2f82ae3459782eb8f6b6f359ad1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:15:57.691979 13072 consensus_queue.cc:1035] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42370b97a8e43009b3864eade3ffe84" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 38923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:15:57.692305 13068 consensus_queue.cc:1035] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a529deff93743b79e76ae537a6c82e4" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 36515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:15:57.702553 13078 mvcc.cc:205] Tried to move back new op lower bound from 7316711660293025792 to 7316711660035403776. Current Snapshot: MvccSnapshot[applied={T|T < 7316711660293025792}]
I20260809 20:15:57.704383 13081 mvcc.cc:205] Tried to move back new op lower bound from 7316711660293025792 to 7316711660035403776. Current Snapshot: MvccSnapshot[applied={T|T < 7316711660293025792}]
I20260809 20:15:57.714772 12316 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56580:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:15:57.715049 12316 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56580:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:15:57.718544 12316 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6c092411d4424e37aab38ae7e76bd11c: Sending DeleteTablet for 3 replicas of tablet 49b7f0aceaa34aadb4ef4c294922ba38
I20260809 20:15:57.719539 12733 tablet_service.cc:1514] Processing DeleteTablet for tablet 49b7f0aceaa34aadb4ef4c294922ba38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:15:57 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:36232
I20260809 20:15:57.719578 12523 tablet_service.cc:1514] Processing DeleteTablet for tablet 49b7f0aceaa34aadb4ef4c294922ba38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:15:57 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:39266
I20260809 20:15:57.721798 12943 tablet_service.cc:1514] Processing DeleteTablet for tablet 49b7f0aceaa34aadb4ef4c294922ba38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:15:57 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:54024
I20260809 20:15:57.723745 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 12431
I20260809 20:15:57.726821 13100 tablet_replica.cc:330] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1: stopping tablet replica
I20260809 20:15:57.727231 13100 raft_consensus.cc:2229] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1 [term 1 LEADER]: Raft consensus shutting down.
I20260809 20:15:57.727815 13100 raft_consensus.cc:2258] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:15:57.728540 13097 tablet_replica.cc:330] T 49b7f0aceaa34aadb4ef4c294922ba38 P e42370b97a8e43009b3864eade3ffe84: stopping tablet replica
I20260809 20:15:57.728919 13097 raft_consensus.cc:2229] T 49b7f0aceaa34aadb4ef4c294922ba38 P e42370b97a8e43009b3864eade3ffe84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:15:57.729380 13097 raft_consensus.cc:2258] T 49b7f0aceaa34aadb4ef4c294922ba38 P e42370b97a8e43009b3864eade3ffe84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:15:57.730073 13099 tablet_replica.cc:330] T 49b7f0aceaa34aadb4ef4c294922ba38 P 3a529deff93743b79e76ae537a6c82e4: stopping tablet replica
I20260809 20:15:57.730413 13099 raft_consensus.cc:2229] T 49b7f0aceaa34aadb4ef4c294922ba38 P 3a529deff93743b79e76ae537a6c82e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:15:57.730911 13099 raft_consensus.cc:2258] T 49b7f0aceaa34aadb4ef4c294922ba38 P 3a529deff93743b79e76ae537a6c82e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:15:57.734014 13100 ts_tablet_manager.cc:1905] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:15:57.735127 13099 ts_tablet_manager.cc:1905] T 49b7f0aceaa34aadb4ef4c294922ba38 P 3a529deff93743b79e76ae537a6c82e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:15:57.736753 13097 ts_tablet_manager.cc:1905] T 49b7f0aceaa34aadb4ef4c294922ba38 P e42370b97a8e43009b3864eade3ffe84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:15:57.743657 13099 ts_tablet_manager.cc:1918] T 49b7f0aceaa34aadb4ef4c294922ba38 P 3a529deff93743b79e76ae537a6c82e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:15:57.743865 13099 log.cc:1196] T 49b7f0aceaa34aadb4ef4c294922ba38 P 3a529deff93743b79e76ae537a6c82e4: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-0/wal/wals/49b7f0aceaa34aadb4ef4c294922ba38
I20260809 20:15:57.744448 13099 ts_tablet_manager.cc:1939] T 49b7f0aceaa34aadb4ef4c294922ba38 P 3a529deff93743b79e76ae537a6c82e4: Deleting consensus metadata
I20260809 20:15:57.744841 13097 ts_tablet_manager.cc:1918] T 49b7f0aceaa34aadb4ef4c294922ba38 P e42370b97a8e43009b3864eade3ffe84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:15:57.744978 13097 log.cc:1196] T 49b7f0aceaa34aadb4ef4c294922ba38 P e42370b97a8e43009b3864eade3ffe84: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-1/wal/wals/49b7f0aceaa34aadb4ef4c294922ba38
I20260809 20:15:57.745452 13097 ts_tablet_manager.cc:1939] T 49b7f0aceaa34aadb4ef4c294922ba38 P e42370b97a8e43009b3864eade3ffe84: Deleting consensus metadata
I20260809 20:15:57.746487 12297 catalog_manager.cc:4841] TS 3a529deff93743b79e76ae537a6c82e4 (127.14.181.1:36515): tablet 49b7f0aceaa34aadb4ef4c294922ba38 (table test-table [id=fccc19ba7d0f4ed69b983e23669a6753]) successfully deleted
Aug 09 20:15:57 dist-test-slave-6zbq krb5kdc[12248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306555, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.1@KRBTEST.COM
I20260809 20:15:57.753862 13100 ts_tablet_manager.cc:1918] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:15:57.754114 13100 log.cc:1196] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786306256699363-15060-0/minicluster-data/ts-2/wal/wals/49b7f0aceaa34aadb4ef4c294922ba38
I20260809 20:15:57.754732 13100 ts_tablet_manager.cc:1939] T 49b7f0aceaa34aadb4ef4c294922ba38 P badfa2f82ae3459782eb8f6b6f359ad1: Deleting consensus metadata
I20260809 20:15:57.756318 12295 catalog_manager.cc:4841] TS badfa2f82ae3459782eb8f6b6f359ad1 (127.14.181.3:44469): tablet 49b7f0aceaa34aadb4ef4c294922ba38 (table test-table [id=fccc19ba7d0f4ed69b983e23669a6753]) successfully deleted
I20260809 20:15:57.756713 12298 catalog_manager.cc:4841] TS e42370b97a8e43009b3864eade3ffe84 (127.14.181.2:38923): tablet 49b7f0aceaa34aadb4ef4c294922ba38 (table test-table [id=fccc19ba7d0f4ed69b983e23669a6753]) successfully deleted
I20260809 20:15:57.757405 13053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:57.725202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39278 (local address 127.14.181.1:36515)
0809 20:15:57.725377 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:57.725384 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:57.731891 (+ 6507us) server_negotiation.cc:407] Connection header received
0809 20:15:57.732064 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:57.732069 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:57.732143 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:57.732238 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:57.733821 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.734908 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.736783 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.737419 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.737500 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:57.750769 (+ 13269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:57.750782 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:57.750798 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:15:57.750851 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:57.754392 (+ 3541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:57.755195 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:57.755203 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:57.755207 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:57.755339 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:57.755698 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:57.755703 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:57.755707 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:57.756034 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:57.756347 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:57.756886 (+ 539us) server_negotiation.cc:299] Negotiation successful
0809 20:15:57.757086 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 20:15:57.758018 12618 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:15:57.843146 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 12431
I20260809 20:15:57.870133 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 12635
Aug 09 20:15:57 dist-test-slave-6zbq krb5kdc[12248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306555, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.2@KRBTEST.COM
I20260809 20:15:57.888998 13057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:57.871004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36234 (local address 127.14.181.2:38923)
0809 20:15:57.871189 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:57.871195 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:57.871217 (+ 22us) server_negotiation.cc:407] Connection header received
0809 20:15:57.871350 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:57.871356 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:57.871439 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:57.871549 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:57.873096 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.874261 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.876241 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:57.876919 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:57.877037 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:57.882471 (+ 5434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:57.882487 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:57.882504 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:15:57.882545 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:57.886325 (+ 3780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:57.886972 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:57.886981 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:57.886985 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:57.887133 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:57.887439 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:57.887445 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:57.887448 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:57.887952 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:57.888236 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:57.888411 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 20:15:57.888625 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 20:15:57.889729 12826 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:15:57.975425 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 12635
I20260809 20:15:58.000996 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 12839
Aug 09 20:15:58 dist-test-slave-6zbq krb5kdc[12248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306555, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.3@KRBTEST.COM
I20260809 20:15:58.018759 13058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:58.001806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54054 (local address 127.14.181.3:44469)
0809 20:15:58.001977 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:58.001981 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:58.002082 (+ 101us) server_negotiation.cc:407] Connection header received
0809 20:15:58.002270 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:58.002274 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:58.002385 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:58.002476 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:58.004353 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:58.005132 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:58.007002 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:58.007416 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:58.007510 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:58.012943 (+ 5433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:58.012957 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:58.012973 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:15:58.013012 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:58.015993 (+ 2981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:58.016811 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:58.016821 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:58.016823 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:58.016970 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:15:58.017348 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:15:58.017351 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:15:58.017353 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:15:58.017693 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:58.017923 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:58.018235 (+ 312us) server_negotiation.cc:299] Negotiation successful
0809 20:15:58.018449 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 20:15:58.019486 13026 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:15:58.136934 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 12839
I20260809 20:15:58.162081 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 12266
I20260809 20:15:58.163118 12375 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:15:58.270269 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 12266
2026-08-09T20:15:58Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4428 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-09T20:15:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:15:58Z Disabled control of system clock
I20260809 20:15:58.356359 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:44577
--webserver_interface=127.14.181.62
--webserver_port=0
--builtin_ntp_servers=127.14.181.20:33407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:44577
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 20:15:58.669541 13111 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:15:58.669785 13111 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:15:58.669868 13111 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:15:58.676908 13111 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:15:58.677006 13111 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:15:58.677047 13111 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:15:58.677102 13111 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:15:58.677145 13111 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:15:58.685928 13111 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:33407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:44577
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:44577
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:15:58.687165 13111 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:15:58.688849 13111 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:15:58.699577 13120 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:58.699651 13122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:58.699620 13125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:15:58.700618 13111 server_base.cc:1034] running on GCE node
I20260809 20:15:58.701314 13111 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:15:58.702591 13111 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:15:58.703792 13111 hybrid_clock.cc:648] HybridClock initialized: now 1786306558703747 us; error 36 us; skew 500 ppm
I20260809 20:15:58.704116 13111 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 20:15:58.706246 13111 webserver.cc:460] Webserver started at http://127.14.181.62:44525/ using document root <none> and password file <none>
I20260809 20:15:58.706913 13111 fs_manager.cc:359] Metadata directory not provided
I20260809 20:15:58.707016 13111 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:15:58.707314 13111 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:15:58.710033 13111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "96f86ca4e0344f28a1111dda82a74494"
format_stamp: "Formatted at 2026-08-09 20:15:58 on dist-test-slave-6zbq"
server_key: "1d4c77d27c699384999f99cdd96a88df"
server_key_iv: "1c11b294ac640b323088adbc948f931a"
server_key_version: "encryptionkey@0"
I20260809 20:15:58.710834 13111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "96f86ca4e0344f28a1111dda82a74494"
format_stamp: "Formatted at 2026-08-09 20:15:58 on dist-test-slave-6zbq"
server_key: "1d4c77d27c699384999f99cdd96a88df"
server_key_iv: "1c11b294ac640b323088adbc948f931a"
server_key_version: "encryptionkey@0"
I20260809 20:15:58.715487 13111 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 20:15:58.718601 13133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:58.719774 13111 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:15:58.719924 13111 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "96f86ca4e0344f28a1111dda82a74494"
format_stamp: "Formatted at 2026-08-09 20:15:58 on dist-test-slave-6zbq"
server_key: "1d4c77d27c699384999f99cdd96a88df"
server_key_iv: "1c11b294ac640b323088adbc948f931a"
server_key_version: "encryptionkey@0"
I20260809 20:15:58.720115 13111 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:15:58.745146 13111 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:15:58.745878 13111 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:15:58.746126 13111 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:15:58.762012 13111 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:44577
I20260809 20:15:58.762042 13220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:44577 every 8 connection(s)
I20260809 20:15:58.763181 13111 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:15:58.765290 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 13111
I20260809 20:15:58.765461 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:15:58.765998 15060 external_mini_cluster.cc:1428] Setting key 37665df85643b9aeb3b5b3e7f340a2f5
I20260809 20:15:58.767133 13223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:15:58.780269 13230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:58.767869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53788 (local address 127.14.181.62:44577)
0809 20:15:58.768870 (+ 1001us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:58.768884 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:58.768934 (+ 50us) server_negotiation.cc:407] Connection header received
0809 20:15:58.770670 (+ 1736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:58.770698 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:58.771261 (+ 563us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:58.771671 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:58.772153 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:58.774105 (+ 1952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:58.775475 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:58.776446 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:58.776625 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:58.777633 (+ 1008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:58.777646 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:58.777663 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:15:58.778380 (+ 717us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:58.778467 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:15:58.778494 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:58.778616 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:58.778808 (+ 192us) server_negotiation.cc:299] Negotiation successful
0809 20:15:58.779115 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":340,"threads_started":1}
I20260809 20:15:58.781373 13223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96f86ca4e0344f28a1111dda82a74494: Bootstrap starting.
I20260809 20:15:58.784168 13223 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 96f86ca4e0344f28a1111dda82a74494: Neither blocks nor log segments found. Creating new log.
I20260809 20:15:58.785063 13223 log.cc:824] T 00000000000000000000000000000000 P 96f86ca4e0344f28a1111dda82a74494: Log is configured to *not* fsync() on all Append() calls
I20260809 20:15:58.787503 13223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96f86ca4e0344f28a1111dda82a74494: No bootstrap required, opened a new log
I20260809 20:15:58.794407 13223 raft_consensus.cc:348] T 00000000000000000000000000000000 P 96f86ca4e0344f28a1111dda82a74494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96f86ca4e0344f28a1111dda82a74494" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 44577 } }
I20260809 20:15:58.794728 13223 raft_consensus.cc:374] T 00000000000000000000000000000000 P 96f86ca4e0344f28a1111dda82a74494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:15:58.794817 13223 raft_consensus.cc:729] T 00000000000000000000000000000000 P 96f86ca4e0344f28a1111dda82a74494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96f86ca4e0344f28a1111dda82a74494, State: Initialized, Role: FOLLOWER
I20260809 20:15:58.795336 13223 consensus_queue.cc:260] T 00000000000000000000000000000000 P 96f86ca4e0344f28a1111dda82a74494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96f86ca4e0344f28a1111dda82a74494" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 44577 } }
I20260809 20:15:58.795539 13223 raft_consensus.cc:388] T 00000000000000000000000000000000 P 96f86ca4e0344f28a1111dda82a74494 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:15:58.795660 13223 raft_consensus.cc:482] T 00000000000000000000000000000000 P 96f86ca4e0344f28a1111dda82a74494 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:15:58.795805 13223 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 96f86ca4e0344f28a1111dda82a74494 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:15:58.797784 13223 raft_consensus.cc:504] T 00000000000000000000000000000000 P 96f86ca4e0344f28a1111dda82a74494 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96f86ca4e0344f28a1111dda82a74494" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 44577 } }
I20260809 20:15:58.798233 13223 leader_election.cc:302] T 00000000000000000000000000000000 P 96f86ca4e0344f28a1111dda82a74494 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 96f86ca4e0344f28a1111dda82a74494; no voters:
I20260809 20:15:58.798827 13223 leader_election.cc:288] T 00000000000000000000000000000000 P 96f86ca4e0344f28a1111dda82a74494 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:15:58.798964 13233 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 96f86ca4e0344f28a1111dda82a74494 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:15:58.799688 13233 raft_consensus.cc:686] T 00000000000000000000000000000000 P 96f86ca4e0344f28a1111dda82a74494 [term 1 LEADER]: Becoming Leader. State: Replica: 96f86ca4e0344f28a1111dda82a74494, State: Running, Role: LEADER
I20260809 20:15:58.800156 13233 consensus_queue.cc:237] T 00000000000000000000000000000000 P 96f86ca4e0344f28a1111dda82a74494 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96f86ca4e0344f28a1111dda82a74494" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 44577 } }
I20260809 20:15:58.800637 13223 sys_catalog.cc:564] T 00000000000000000000000000000000 P 96f86ca4e0344f28a1111dda82a74494 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:15:58.802764 13239 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96f86ca4e0344f28a1111dda82a74494 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 96f86ca4e0344f28a1111dda82a74494. Latest consensus state: current_term: 1 leader_uuid: "96f86ca4e0344f28a1111dda82a74494" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96f86ca4e0344f28a1111dda82a74494" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 44577 } } }
I20260809 20:15:58.803282 13239 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96f86ca4e0344f28a1111dda82a74494 [sys.catalog]: This master's current role is: LEADER
I20260809 20:15:58.803496 13235 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96f86ca4e0344f28a1111dda82a74494 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "96f86ca4e0344f28a1111dda82a74494" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96f86ca4e0344f28a1111dda82a74494" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 44577 } } }
I20260809 20:15:58.803836 13235 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96f86ca4e0344f28a1111dda82a74494 [sys.catalog]: This master's current role is: LEADER
I20260809 20:15:58.810716 13247 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:15:58.815415 13247 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:15:58.823508 13247 catalog_manager.cc:1347] Generated new cluster ID: cc751e4dd4e74bc8a8c3e92ce19a26f4
I20260809 20:15:58.823611 13247 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:15:58.846558 13247 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:15:58.847715 13247 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:15:58.859754 13247 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 96f86ca4e0344f28a1111dda82a74494: Generated new TSK 0
I20260809 20:15:58.860450 13247 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:15:58.866129 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:0
--local_ip_for_outbound_sockets=127.14.181.1
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:44577
--builtin_ntp_servers=127.14.181.20:33407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 20:15:59.186556 13267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:15:59.186801 13267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:15:59.186918 13267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:15:59.193953 13267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:15:59.194036 13267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:15:59.194171 13267 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:15:59.202940 13267 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:33407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:44577
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:15:59.204027 13267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:15:59.205772 13267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:15:59.218271 13273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:59.218264 13276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:59.218232 13274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:15:59.219039 13267 server_base.cc:1034] running on GCE node
I20260809 20:15:59.219561 13267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:15:59.220386 13267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:15:59.221580 13267 hybrid_clock.cc:648] HybridClock initialized: now 1786306559221527 us; error 45 us; skew 500 ppm
I20260809 20:15:59.221870 13267 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 20:15:59.223929 13267 webserver.cc:460] Webserver started at http://127.14.181.1:38703/ using document root <none> and password file <none>
I20260809 20:15:59.224591 13267 fs_manager.cc:359] Metadata directory not provided
I20260809 20:15:59.224691 13267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:15:59.224967 13267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:15:59.227669 13267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-0/data/instance:
uuid: "7fc7b7d602554f7eab566a3d3fb68810"
format_stamp: "Formatted at 2026-08-09 20:15:59 on dist-test-slave-6zbq"
server_key: "0056b164a0c0834f32a2bf81de5f2e33"
server_key_iv: "2a37f4e88735b23ece269f7a430a20f0"
server_key_version: "encryptionkey@0"
I20260809 20:15:59.228407 13267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance:
uuid: "7fc7b7d602554f7eab566a3d3fb68810"
format_stamp: "Formatted at 2026-08-09 20:15:59 on dist-test-slave-6zbq"
server_key: "0056b164a0c0834f32a2bf81de5f2e33"
server_key_iv: "2a37f4e88735b23ece269f7a430a20f0"
server_key_version: "encryptionkey@0"
I20260809 20:15:59.233063 13267 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260809 20:15:59.236214 13284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:59.237375 13267 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 20:15:59.237521 13267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "7fc7b7d602554f7eab566a3d3fb68810"
format_stamp: "Formatted at 2026-08-09 20:15:59 on dist-test-slave-6zbq"
server_key: "0056b164a0c0834f32a2bf81de5f2e33"
server_key_iv: "2a37f4e88735b23ece269f7a430a20f0"
server_key_version: "encryptionkey@0"
I20260809 20:15:59.237712 13267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:15:59.265786 13267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:15:59.266573 13267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:15:59.266834 13267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:15:59.267729 13267 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:15:59.269088 13267 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:15:59.269181 13267 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:59.269294 13267 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:15:59.269363 13267 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:59.298686 13267 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:41141
I20260809 20:15:59.298763 13461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:41141 every 8 connection(s)
I20260809 20:15:59.299837 13267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:15:59.304738 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 13267
I20260809 20:15:59.304901 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance
I20260809 20:15:59.305328 15060 external_mini_cluster.cc:1428] Setting key 2a7c9b4e8aeaa965188895abf4750419
I20260809 20:15:59.308104 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:0
--local_ip_for_outbound_sockets=127.14.181.2
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:44577
--builtin_ntp_servers=127.14.181.20:33407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 20:15:59.312148 13467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:59.302150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:47049 (local address 127.14.181.62:44577)
0809 20:15:59.302604 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:59.302610 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:59.303763 (+ 1153us) server_negotiation.cc:407] Connection header received
0809 20:15:59.305732 (+ 1969us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:59.305739 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:59.305824 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:59.305929 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:59.307269 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:59.307949 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:59.309515 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:59.309919 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:59.310028 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:59.311332 (+ 1304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:59.311338 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:59.311341 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:15:59.311358 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:59.311403 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:15:59.311416 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:59.311491 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:59.311711 (+ 220us) server_negotiation.cc:299] Negotiation successful
0809 20:15:59.311807 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":221,"threads_started":1}
I20260809 20:15:59.313042 13468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:59.302800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:44577 (local address 127.14.181.1:47049)
0809 20:15:59.303605 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:59.303642 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:59.305481 (+ 1839us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:59.306183 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:59.306191 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:59.306294 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:15:59.307099 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:59.307122 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:59.308104 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:59.308110 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:59.309371 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:59.309384 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:59.310129 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:59.310137 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:59.310428 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:59.311048 (+ 620us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 20:15:59.311050 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:15:59.311086 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 20:15:59.311155 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:15:59.311503 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:15:59.311516 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:15:59.311524 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 20:15:59.311668 (+ 144us) client_negotiation.cc:240] Negotiation successful
0809 20:15:59.312028 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":252,"threads_started":1}
I20260809 20:15:59.314517 13462 heartbeater.cc:347] Connected to a master server at 127.14.181.62:44577
I20260809 20:15:59.314775 13462 heartbeater.cc:464] Registering TS with master...
I20260809 20:15:59.315450 13462 heartbeater.cc:511] Master 127.14.181.62:44577 requested a full tablet report, sending...
I20260809 20:15:59.317308 13164 ts_manager.cc:194] Registered new tserver with Master: 7fc7b7d602554f7eab566a3d3fb68810 (127.14.181.1:41141)
I20260809 20:15:59.318790 13164 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.181.1:47049
W20260809 20:15:59.623255 13470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:15:59.623533 13470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:15:59.623662 13470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:15:59.630731 13470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:15:59.630826 13470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:15:59.630965 13470 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:15:59.639493 13470 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:33407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:44577
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:15:59.640666 13470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:15:59.642452 13470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:15:59.654394 13475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:59.654647 13480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:15:59.654577 13483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:15:59.655586 13470 server_base.cc:1034] running on GCE node
I20260809 20:15:59.656127 13470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:15:59.656968 13470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:15:59.658159 13470 hybrid_clock.cc:648] HybridClock initialized: now 1786306559658110 us; error 48 us; skew 500 ppm
I20260809 20:15:59.658478 13470 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 20:15:59.660442 13470 webserver.cc:460] Webserver started at http://127.14.181.2:35895/ using document root <none> and password file <none>
I20260809 20:15:59.661046 13470 fs_manager.cc:359] Metadata directory not provided
I20260809 20:15:59.661155 13470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:15:59.661439 13470 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:15:59.664151 13470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-1/data/instance:
uuid: "e5b6032983684e9d96ebe054de2abc2c"
format_stamp: "Formatted at 2026-08-09 20:15:59 on dist-test-slave-6zbq"
server_key: "7674b6a3b7dd7f9d32023cd6325156e0"
server_key_iv: "3fdc480b506e870d4f09ef773ff74ff4"
server_key_version: "encryptionkey@0"
I20260809 20:15:59.664885 13470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance:
uuid: "e5b6032983684e9d96ebe054de2abc2c"
format_stamp: "Formatted at 2026-08-09 20:15:59 on dist-test-slave-6zbq"
server_key: "7674b6a3b7dd7f9d32023cd6325156e0"
server_key_iv: "3fdc480b506e870d4f09ef773ff74ff4"
server_key_version: "encryptionkey@0"
I20260809 20:15:59.669437 13470 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 20:15:59.672500 13498 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:59.673611 13470 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 20:15:59.673763 13470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "e5b6032983684e9d96ebe054de2abc2c"
format_stamp: "Formatted at 2026-08-09 20:15:59 on dist-test-slave-6zbq"
server_key: "7674b6a3b7dd7f9d32023cd6325156e0"
server_key_iv: "3fdc480b506e870d4f09ef773ff74ff4"
server_key_version: "encryptionkey@0"
I20260809 20:15:59.673954 13470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:15:59.695355 13470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:15:59.696023 13470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:15:59.696328 13470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:15:59.697203 13470 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:15:59.698505 13470 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:15:59.698596 13470 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:59.698668 13470 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:15:59.698731 13470 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:15:59.726966 13470 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:41151
I20260809 20:15:59.727038 13671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:41151 every 8 connection(s)
I20260809 20:15:59.728148 13470 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:15:59.734771 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 13470
I20260809 20:15:59.734941 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance
I20260809 20:15:59.735402 15060 external_mini_cluster.cc:1428] Setting key 5c5e9c899df755b7182816fc187b7cca
I20260809 20:15:59.738109 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:0
--local_ip_for_outbound_sockets=127.14.181.3
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:44577
--builtin_ntp_servers=127.14.181.20:33407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 20:15:59.740025 13467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:59.730386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:56115 (local address 127.14.181.62:44577)
0809 20:15:59.730545 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 20:15:59.730549 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:15:59.731790 (+ 1241us) server_negotiation.cc:407] Connection header received
0809 20:15:59.733518 (+ 1728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:15:59.733524 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:15:59.733671 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:15:59.733760 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:15:59.734793 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:59.735616 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:59.737489 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:15:59.737886 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:15:59.737978 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:59.739377 (+ 1399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:15:59.739382 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:15:59.739385 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:15:59.739406 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:15:59.739438 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:15:59.739449 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:15:59.739514 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 20:15:59.739728 (+ 214us) server_negotiation.cc:299] Negotiation successful
0809 20:15:59.739806 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 20:15:59.741199 13678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:15:59.730825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:44577 (local address 127.14.181.2:56115)
0809 20:15:59.731648 (+ 823us) negotiation.cc:107] Waiting for socket to connect
0809 20:15:59.731687 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 20:15:59.733260 (+ 1573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:15:59.733973 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:15:59.733981 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:15:59.734067 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:15:59.734634 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:59.734652 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:59.735818 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:59.735823 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:59.737355 (+ 1532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:15:59.737371 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:15:59.738100 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:15:59.738108 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:15:59.738417 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:15:59.739060 (+ 643us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 20:15:59.739063 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:15:59.739110 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 20:15:59.739204 (+ 94us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:15:59.739529 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:15:59.739539 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:15:59.739546 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 20:15:59.739710 (+ 164us) client_negotiation.cc:240] Negotiation successful
0809 20:15:59.740048 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":245,"threads_started":1}
I20260809 20:15:59.742444 13674 heartbeater.cc:347] Connected to a master server at 127.14.181.62:44577
I20260809 20:15:59.742718 13674 heartbeater.cc:464] Registering TS with master...
I20260809 20:15:59.743360 13674 heartbeater.cc:511] Master 127.14.181.62:44577 requested a full tablet report, sending...
I20260809 20:15:59.744616 13164 ts_manager.cc:194] Registered new tserver with Master: e5b6032983684e9d96ebe054de2abc2c (127.14.181.2:41151)
I20260809 20:15:59.745383 13164 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.181.2:56115
W20260809 20:16:00.056340 13679 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:00.056578 13679 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:00.056668 13679 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:00.063529 13679 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:00.063613 13679 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:00.063726 13679 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:16:00.072283 13679 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:33407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:44577
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:00.073324 13679 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:00.074980 13679 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:00.086943 13689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:00.086903 13692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:00.086980 13694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:00.087728 13679 server_base.cc:1034] running on GCE node
I20260809 20:16:00.088289 13679 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:00.089174 13679 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:00.090456 13679 hybrid_clock.cc:648] HybridClock initialized: now 1786306560090409 us; error 36 us; skew 500 ppm
I20260809 20:16:00.090754 13679 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 20:16:00.092816 13679 webserver.cc:460] Webserver started at http://127.14.181.3:45353/ using document root <none> and password file <none>
I20260809 20:16:00.093425 13679 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:00.093532 13679 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:00.093827 13679 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:00.096527 13679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-2/data/instance:
uuid: "2e7744069deb48e68bbc262cf97d1f6b"
format_stamp: "Formatted at 2026-08-09 20:16:00 on dist-test-slave-6zbq"
server_key: "7e6700b562bc6a83c3acd838d84b5c7c"
server_key_iv: "dfdab2648ae2158fc6c05f28e786958d"
server_key_version: "encryptionkey@0"
I20260809 20:16:00.097292 13679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance:
uuid: "2e7744069deb48e68bbc262cf97d1f6b"
format_stamp: "Formatted at 2026-08-09 20:16:00 on dist-test-slave-6zbq"
server_key: "7e6700b562bc6a83c3acd838d84b5c7c"
server_key_iv: "dfdab2648ae2158fc6c05f28e786958d"
server_key_version: "encryptionkey@0"
I20260809 20:16:00.102061 13679 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.002s
I20260809 20:16:00.105330 13703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:00.106549 13679 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 20:16:00.106694 13679 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "2e7744069deb48e68bbc262cf97d1f6b"
format_stamp: "Formatted at 2026-08-09 20:16:00 on dist-test-slave-6zbq"
server_key: "7e6700b562bc6a83c3acd838d84b5c7c"
server_key_iv: "dfdab2648ae2158fc6c05f28e786958d"
server_key_version: "encryptionkey@0"
I20260809 20:16:00.106877 13679 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:00.140753 13679 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:00.141530 13679 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:00.141809 13679 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:00.142735 13679 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:16:00.144099 13679 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:16:00.144196 13679 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:00.144297 13679 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:16:00.144374 13679 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:00.174032 13679 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:34431
I20260809 20:16:00.174098 13886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:34431 every 8 connection(s)
I20260809 20:16:00.175304 13679 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:16:00.176297 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 13679
I20260809 20:16:00.176473 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance
I20260809 20:16:00.176990 15060 external_mini_cluster.cc:1428] Setting key 544d2a9f489640a9e986f212f2617656
I20260809 20:16:00.187250 13467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:00.177842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:46285 (local address 127.14.181.62:44577)
0809 20:16:00.178045 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:00.178051 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:00.179578 (+ 1527us) server_negotiation.cc:407] Connection header received
0809 20:16:00.181371 (+ 1793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:00.181376 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:00.181455 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:00.181537 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:00.182569 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.183284 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.184748 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.185147 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.185262 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:00.186441 (+ 1179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:00.186446 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:00.186449 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:00.186465 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:00.186495 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:00.186507 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:00.186580 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:00.186784 (+ 204us) server_negotiation.cc:299] Negotiation successful
0809 20:16:00.186923 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 20:16:00.188077 13890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:00.178504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:44577 (local address 127.14.181.3:46285)
0809 20:16:00.179432 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:00.179475 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:00.181129 (+ 1654us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:00.181766 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:00.181774 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:00.181854 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:16:00.182418 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:00.182437 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.183426 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.183431 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:00.184614 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:00.184626 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.185361 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.185369 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:00.185569 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:00.186143 (+ 574us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 20:16:00.186145 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:16:00.186180 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 20:16:00.186254 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:16:00.186592 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:16:00.186603 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:16:00.186610 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 20:16:00.186760 (+ 150us) client_negotiation.cc:240] Negotiation successful
0809 20:16:00.187114 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":334,"threads_started":1}
I20260809 20:16:00.189188 13887 heartbeater.cc:347] Connected to a master server at 127.14.181.62:44577
I20260809 20:16:00.189421 13887 heartbeater.cc:464] Registering TS with master...
I20260809 20:16:00.190042 13887 heartbeater.cc:511] Master 127.14.181.62:44577 requested a full tablet report, sending...
I20260809 20:16:00.191371 13164 ts_manager.cc:194] Registered new tserver with Master: 2e7744069deb48e68bbc262cf97d1f6b (127.14.181.3:34431)
I20260809 20:16:00.192122 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 20:16:00.192281 13164 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.181.3:46285
I20260809 20:16:00.201887 13467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:00.196658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53796 (local address 127.14.181.62:44577)
0809 20:16:00.196831 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:00.196837 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:00.197194 (+ 357us) server_negotiation.cc:407] Connection header received
0809 20:16:00.197302 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:00.197305 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:00.197359 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:00.197430 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:00.197866 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.198569 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.199806 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.200199 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.200285 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:00.201260 (+ 975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:00.201265 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:00.201268 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:00.201283 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:00.201310 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:00.201321 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:00.201423 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:00.201533 (+ 110us) server_negotiation.cc:299] Negotiation successful
0809 20:16:00.201580 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 20:16:00.205307 13164 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53796:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 20:16:00.212044 13164 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 20:16:00.232251 13904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:00.222794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41620 (local address 127.14.181.3:34431)
0809 20:16:00.224469 (+ 1675us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:00.224475 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:00.224499 (+ 24us) server_negotiation.cc:407] Connection header received
0809 20:16:00.224563 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:00.224568 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:00.224750 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:00.224928 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:16:00.225740 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.226747 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.229276 (+ 2529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.230653 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.230750 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:00.231009 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:00.231784 (+ 775us) server_negotiation.cc:299] Negotiation successful
0809 20:16:00.231937 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1541,"thread_start_us":1411,"threads_started":1}
I20260809 20:16:00.232405 13905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:00.222774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:34431 (local address 127.0.0.1:41620)
0809 20:16:00.223668 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:00.223716 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:00.223875 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:00.225207 (+ 1332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:00.225213 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:00.225237 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:16:00.225535 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:00.225543 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.226878 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.226883 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:00.229051 (+ 2168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:00.229067 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.231246 (+ 2179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.231254 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:00.231505 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:00.231566 (+ 61us) client_negotiation.cc:769] Sending connection context
0809 20:16:00.231709 (+ 143us) client_negotiation.cc:240] Negotiation successful
0809 20:16:00.232037 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"mutex_wait_us":155,"thread_start_us":447,"threads_started":1}
I20260809 20:16:00.235661 13906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:00.223418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:41141 (local address 127.0.0.1:32814)
0809 20:16:00.227681 (+ 4263us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:00.227698 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:00.227817 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:00.228428 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:00.228433 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:00.228458 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:16:00.228822 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:00.228834 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.230653 (+ 1819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.230658 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:00.233069 (+ 2411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:00.233085 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.234897 (+ 1812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.234903 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:00.235073 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:00.235103 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 20:16:00.235200 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 20:16:00.235314 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4129,"mutex_wait_us":106,"thread_start_us":3959,"threads_started":1}
I20260809 20:16:00.235729 13910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:00.223961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32814 (local address 127.14.181.1:41141)
0809 20:16:00.227242 (+ 3281us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:00.227250 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:00.227933 (+ 683us) server_negotiation.cc:407] Connection header received
0809 20:16:00.228035 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:00.228042 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:00.228249 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:00.228422 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:16:00.228998 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.230479 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.233279 (+ 2800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.234706 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.234838 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:00.235043 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:00.235245 (+ 202us) server_negotiation.cc:299] Negotiation successful
0809 20:16:00.235415 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3123,"thread_start_us":3026,"threads_started":1}
I20260809 20:16:00.236238 13909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:00.223948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:41151 (local address 127.0.0.1:54088)
0809 20:16:00.228371 (+ 4423us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:00.228387 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:00.228518 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:00.229135 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:00.229139 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:00.229162 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:16:00.229541 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:00.229554 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.231457 (+ 1903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.231463 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:00.233417 (+ 1954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:00.233431 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.235460 (+ 2029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.235466 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:00.235643 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:00.235680 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 20:16:00.235767 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 20:16:00.235881 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4322,"mutex_wait_us":6,"spinlock_wait_cycles":6528,"thread_start_us":4189,"threads_started":1}
I20260809 20:16:00.236974 13913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:00.224527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54088 (local address 127.14.181.2:41151)
0809 20:16:00.225122 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:00.225130 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:00.228640 (+ 3510us) server_negotiation.cc:407] Connection header received
0809 20:16:00.228751 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:00.228758 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:00.228966 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:00.229125 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:16:00.229690 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.231327 (+ 1637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.233643 (+ 2316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.234971 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.235091 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:00.235335 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:00.236552 (+ 1217us) server_negotiation.cc:299] Negotiation successful
0809 20:16:00.236715 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":255,"threads_started":1}
I20260809 20:16:00.236476 13780 tablet_service.cc:1467] Processing CreateTablet for tablet 3d9cc14079a845fd8a563041f7e1c397 (DEFAULT_TABLE table=test-table [id=36d0a9c6962947ad8cb63377542a6306]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:16:00.237905 13780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d9cc14079a845fd8a563041f7e1c397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:00.239224 13363 tablet_service.cc:1467] Processing CreateTablet for tablet 3d9cc14079a845fd8a563041f7e1c397 (DEFAULT_TABLE table=test-table [id=36d0a9c6962947ad8cb63377542a6306]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:16:00.239480 13567 tablet_service.cc:1467] Processing CreateTablet for tablet 3d9cc14079a845fd8a563041f7e1c397 (DEFAULT_TABLE table=test-table [id=36d0a9c6962947ad8cb63377542a6306]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:16:00.240538 13363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d9cc14079a845fd8a563041f7e1c397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:00.240863 13567 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d9cc14079a845fd8a563041f7e1c397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:00.251850 13915 tablet_bootstrap.cc:492] T 3d9cc14079a845fd8a563041f7e1c397 P e5b6032983684e9d96ebe054de2abc2c: Bootstrap starting.
I20260809 20:16:00.253609 13917 tablet_bootstrap.cc:492] T 3d9cc14079a845fd8a563041f7e1c397 P 2e7744069deb48e68bbc262cf97d1f6b: Bootstrap starting.
I20260809 20:16:00.254985 13918 tablet_bootstrap.cc:492] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810: Bootstrap starting.
I20260809 20:16:00.256559 13915 tablet_bootstrap.cc:654] T 3d9cc14079a845fd8a563041f7e1c397 P e5b6032983684e9d96ebe054de2abc2c: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:00.256987 13917 tablet_bootstrap.cc:654] T 3d9cc14079a845fd8a563041f7e1c397 P 2e7744069deb48e68bbc262cf97d1f6b: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:00.257619 13918 tablet_bootstrap.cc:654] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:00.257751 13915 log.cc:824] T 3d9cc14079a845fd8a563041f7e1c397 P e5b6032983684e9d96ebe054de2abc2c: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:00.258112 13917 log.cc:824] T 3d9cc14079a845fd8a563041f7e1c397 P 2e7744069deb48e68bbc262cf97d1f6b: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:00.258606 13918 log.cc:824] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:00.261109 13915 tablet_bootstrap.cc:492] T 3d9cc14079a845fd8a563041f7e1c397 P e5b6032983684e9d96ebe054de2abc2c: No bootstrap required, opened a new log
I20260809 20:16:00.261130 13917 tablet_bootstrap.cc:492] T 3d9cc14079a845fd8a563041f7e1c397 P 2e7744069deb48e68bbc262cf97d1f6b: No bootstrap required, opened a new log
I20260809 20:16:00.261376 13917 ts_tablet_manager.cc:1397] T 3d9cc14079a845fd8a563041f7e1c397 P 2e7744069deb48e68bbc262cf97d1f6b: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260809 20:16:00.261377 13915 ts_tablet_manager.cc:1397] T 3d9cc14079a845fd8a563041f7e1c397 P e5b6032983684e9d96ebe054de2abc2c: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.008s
I20260809 20:16:00.261415 13918 tablet_bootstrap.cc:492] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810: No bootstrap required, opened a new log
I20260809 20:16:00.261646 13918 ts_tablet_manager.cc:1397] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.006s
I20260809 20:16:00.268179 13918 raft_consensus.cc:348] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7744069deb48e68bbc262cf97d1f6b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 34431 } } peers { permanent_uuid: "e5b6032983684e9d96ebe054de2abc2c" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 41151 } } peers { permanent_uuid: "7fc7b7d602554f7eab566a3d3fb68810" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41141 } }
I20260809 20:16:00.268492 13918 raft_consensus.cc:374] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:00.268615 13918 raft_consensus.cc:729] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fc7b7d602554f7eab566a3d3fb68810, State: Initialized, Role: FOLLOWER
I20260809 20:16:00.269172 13918 consensus_queue.cc:260] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7744069deb48e68bbc262cf97d1f6b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 34431 } } peers { permanent_uuid: "e5b6032983684e9d96ebe054de2abc2c" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 41151 } } peers { permanent_uuid: "7fc7b7d602554f7eab566a3d3fb68810" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41141 } }
I20260809 20:16:00.270748 13462 heartbeater.cc:503] Master 127.14.181.62:44577 was elected leader, sending a full tablet report...
I20260809 20:16:00.271668 13915 raft_consensus.cc:348] T 3d9cc14079a845fd8a563041f7e1c397 P e5b6032983684e9d96ebe054de2abc2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7744069deb48e68bbc262cf97d1f6b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 34431 } } peers { permanent_uuid: "e5b6032983684e9d96ebe054de2abc2c" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 41151 } } peers { permanent_uuid: "7fc7b7d602554f7eab566a3d3fb68810" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41141 } }
I20260809 20:16:00.271668 13917 raft_consensus.cc:348] T 3d9cc14079a845fd8a563041f7e1c397 P 2e7744069deb48e68bbc262cf97d1f6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7744069deb48e68bbc262cf97d1f6b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 34431 } } peers { permanent_uuid: "e5b6032983684e9d96ebe054de2abc2c" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 41151 } } peers { permanent_uuid: "7fc7b7d602554f7eab566a3d3fb68810" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41141 } }
I20260809 20:16:00.272066 13917 raft_consensus.cc:374] T 3d9cc14079a845fd8a563041f7e1c397 P 2e7744069deb48e68bbc262cf97d1f6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:00.272171 13915 raft_consensus.cc:374] T 3d9cc14079a845fd8a563041f7e1c397 P e5b6032983684e9d96ebe054de2abc2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:00.272205 13917 raft_consensus.cc:729] T 3d9cc14079a845fd8a563041f7e1c397 P 2e7744069deb48e68bbc262cf97d1f6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7744069deb48e68bbc262cf97d1f6b, State: Initialized, Role: FOLLOWER
I20260809 20:16:00.272320 13915 raft_consensus.cc:729] T 3d9cc14079a845fd8a563041f7e1c397 P e5b6032983684e9d96ebe054de2abc2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5b6032983684e9d96ebe054de2abc2c, State: Initialized, Role: FOLLOWER
I20260809 20:16:00.272454 13918 ts_tablet_manager.cc:1428] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810: Time spent starting tablet: real 0.011s user 0.009s sys 0.000s
I20260809 20:16:00.272919 13917 consensus_queue.cc:260] T 3d9cc14079a845fd8a563041f7e1c397 P 2e7744069deb48e68bbc262cf97d1f6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7744069deb48e68bbc262cf97d1f6b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 34431 } } peers { permanent_uuid: "e5b6032983684e9d96ebe054de2abc2c" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 41151 } } peers { permanent_uuid: "7fc7b7d602554f7eab566a3d3fb68810" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41141 } }
I20260809 20:16:00.272945 13915 consensus_queue.cc:260] T 3d9cc14079a845fd8a563041f7e1c397 P e5b6032983684e9d96ebe054de2abc2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7744069deb48e68bbc262cf97d1f6b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 34431 } } peers { permanent_uuid: "e5b6032983684e9d96ebe054de2abc2c" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 41151 } } peers { permanent_uuid: "7fc7b7d602554f7eab566a3d3fb68810" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41141 } }
I20260809 20:16:00.273967 13674 heartbeater.cc:503] Master 127.14.181.62:44577 was elected leader, sending a full tablet report...
I20260809 20:16:00.274549 13887 heartbeater.cc:503] Master 127.14.181.62:44577 was elected leader, sending a full tablet report...
I20260809 20:16:00.275039 13917 ts_tablet_manager.cc:1428] T 3d9cc14079a845fd8a563041f7e1c397 P 2e7744069deb48e68bbc262cf97d1f6b: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260809 20:16:00.276187 13915 ts_tablet_manager.cc:1428] T 3d9cc14079a845fd8a563041f7e1c397 P e5b6032983684e9d96ebe054de2abc2c: Time spent starting tablet: real 0.015s user 0.012s sys 0.000s
W20260809 20:16:00.301797 13464 tablet.cc:2369] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:16:00.317397 13925 raft_consensus.cc:482] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:16:00.317677 13925 raft_consensus.cc:504] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7744069deb48e68bbc262cf97d1f6b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 34431 } } peers { permanent_uuid: "e5b6032983684e9d96ebe054de2abc2c" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 41151 } } peers { permanent_uuid: "7fc7b7d602554f7eab566a3d3fb68810" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41141 } }
I20260809 20:16:00.319146 13925 leader_election.cc:288] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7744069deb48e68bbc262cf97d1f6b (127.14.181.3:34431), e5b6032983684e9d96ebe054de2abc2c (127.14.181.2:41151)
I20260809 20:16:00.326148 13904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:00.319554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:57603 (local address 127.14.181.3:34431)
0809 20:16:00.319726 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:00.319730 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:00.320241 (+ 511us) server_negotiation.cc:407] Connection header received
0809 20:16:00.320468 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:00.320473 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:00.320548 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:00.320652 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:16:00.321243 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.322180 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.324187 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.325299 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.325431 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:00.325481 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:00.325805 (+ 324us) server_negotiation.cc:299] Negotiation successful
0809 20:16:00.325919 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 20:16:00.326177 13930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:00.319511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:34431 (local address 127.14.181.1:57603)
0809 20:16:00.320136 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:00.320159 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:00.320298 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:00.320690 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:00.320694 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:00.320719 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:16:00.321062 (+ 343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:00.321072 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.322316 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.322322 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:00.324012 (+ 1690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:00.324025 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.325477 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.325484 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:00.325655 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:00.325691 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 20:16:00.325793 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 20:16:00.325917 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":333,"threads_started":1}
I20260809 20:16:00.326664 13913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:00.320505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:56737 (local address 127.14.181.2:41151)
0809 20:16:00.320705 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:00.320712 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:00.321167 (+ 455us) server_negotiation.cc:407] Connection header received
0809 20:16:00.321319 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:00.321323 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:00.321380 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:00.321439 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:16:00.321994 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.322926 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.324863 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.325769 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.325905 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:00.325964 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:00.326356 (+ 392us) server_negotiation.cc:299] Negotiation successful
0809 20:16:00.326484 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 20:16:00.327191 13931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:00.320270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:41151 (local address 127.14.181.1:56737)
0809 20:16:00.321059 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:00.321072 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:00.321191 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:00.321474 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:00.321479 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:00.321503 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:16:00.321857 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:00.321868 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.323050 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.323053 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:00.324703 (+ 1650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:00.324718 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.325946 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.325952 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:00.326119 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:00.326151 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 20:16:00.326868 (+ 717us) client_negotiation.cc:240] Negotiation successful
0809 20:16:00.326979 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":688,"thread_start_us":475,"threads_started":1}
I20260809 20:16:00.327169 13810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d9cc14079a845fd8a563041f7e1c397" candidate_uuid: "7fc7b7d602554f7eab566a3d3fb68810" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7744069deb48e68bbc262cf97d1f6b" is_pre_election: true
I20260809 20:16:00.327704 13810 raft_consensus.cc:2454] T 3d9cc14079a845fd8a563041f7e1c397 P 2e7744069deb48e68bbc262cf97d1f6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fc7b7d602554f7eab566a3d3fb68810 in term 0.
I20260809 20:16:00.328352 13285 leader_election.cc:302] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7744069deb48e68bbc262cf97d1f6b, 7fc7b7d602554f7eab566a3d3fb68810; no voters:
I20260809 20:16:00.328312 13598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d9cc14079a845fd8a563041f7e1c397" candidate_uuid: "7fc7b7d602554f7eab566a3d3fb68810" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5b6032983684e9d96ebe054de2abc2c" is_pre_election: true
I20260809 20:16:00.328696 13925 raft_consensus.cc:2781] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:16:00.328756 13598 raft_consensus.cc:2454] T 3d9cc14079a845fd8a563041f7e1c397 P e5b6032983684e9d96ebe054de2abc2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fc7b7d602554f7eab566a3d3fb68810 in term 0.
I20260809 20:16:00.328856 13925 raft_consensus.cc:482] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:16:00.328955 13925 raft_consensus.cc:3037] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:00.331180 13925 raft_consensus.cc:504] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7744069deb48e68bbc262cf97d1f6b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 34431 } } peers { permanent_uuid: "e5b6032983684e9d96ebe054de2abc2c" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 41151 } } peers { permanent_uuid: "7fc7b7d602554f7eab566a3d3fb68810" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41141 } }
I20260809 20:16:00.331717 13925 leader_election.cc:288] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810 [CANDIDATE]: Term 1 election: Requested vote from peers 2e7744069deb48e68bbc262cf97d1f6b (127.14.181.3:34431), e5b6032983684e9d96ebe054de2abc2c (127.14.181.2:41151)
I20260809 20:16:00.332095 13810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d9cc14079a845fd8a563041f7e1c397" candidate_uuid: "7fc7b7d602554f7eab566a3d3fb68810" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7744069deb48e68bbc262cf97d1f6b"
I20260809 20:16:00.332175 13598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d9cc14079a845fd8a563041f7e1c397" candidate_uuid: "7fc7b7d602554f7eab566a3d3fb68810" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5b6032983684e9d96ebe054de2abc2c"
I20260809 20:16:00.332319 13810 raft_consensus.cc:3037] T 3d9cc14079a845fd8a563041f7e1c397 P 2e7744069deb48e68bbc262cf97d1f6b [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:00.332340 13598 raft_consensus.cc:3037] T 3d9cc14079a845fd8a563041f7e1c397 P e5b6032983684e9d96ebe054de2abc2c [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:00.335410 13810 raft_consensus.cc:2454] T 3d9cc14079a845fd8a563041f7e1c397 P 2e7744069deb48e68bbc262cf97d1f6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fc7b7d602554f7eab566a3d3fb68810 in term 1.
I20260809 20:16:00.335417 13598 raft_consensus.cc:2454] T 3d9cc14079a845fd8a563041f7e1c397 P e5b6032983684e9d96ebe054de2abc2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fc7b7d602554f7eab566a3d3fb68810 in term 1.
I20260809 20:16:00.335772 13285 leader_election.cc:302] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7744069deb48e68bbc262cf97d1f6b, 7fc7b7d602554f7eab566a3d3fb68810; no voters:
I20260809 20:16:00.336022 13925 raft_consensus.cc:2781] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:16:00.336411 13925 raft_consensus.cc:686] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810 [term 1 LEADER]: Becoming Leader. State: Replica: 7fc7b7d602554f7eab566a3d3fb68810, State: Running, Role: LEADER
I20260809 20:16:00.336879 13925 consensus_queue.cc:237] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7744069deb48e68bbc262cf97d1f6b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 34431 } } peers { permanent_uuid: "e5b6032983684e9d96ebe054de2abc2c" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 41151 } } peers { permanent_uuid: "7fc7b7d602554f7eab566a3d3fb68810" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41141 } }
I20260809 20:16:00.340945 13163 catalog_manager.cc:5495] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fc7b7d602554f7eab566a3d3fb68810 (127.14.181.1). New cstate: current_term: 1 leader_uuid: "7fc7b7d602554f7eab566a3d3fb68810" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7744069deb48e68bbc262cf97d1f6b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 34431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5b6032983684e9d96ebe054de2abc2c" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 41151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fc7b7d602554f7eab566a3d3fb68810" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 41141 } health_report { overall_health: HEALTHY } } }
I20260809 20:16:00.363647 13910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:00.358427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32816 (local address 127.14.181.1:41141)
0809 20:16:00.358609 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:00.358615 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:00.358632 (+ 17us) server_negotiation.cc:407] Connection header received
0809 20:16:00.358808 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:00.358814 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:00.358898 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:00.359018 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:16:00.359403 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.360076 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.361490 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.361900 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.362004 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:00.362629 (+ 625us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:16:00.363071 (+ 442us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:16:00.363225 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:00.363390 (+ 165us) server_negotiation.cc:299] Negotiation successful
0809 20:16:00.363427 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 20:16:00.370746 13598 raft_consensus.cc:1261] T 3d9cc14079a845fd8a563041f7e1c397 P e5b6032983684e9d96ebe054de2abc2c [term 1 FOLLOWER]: Refusing update from remote peer 7fc7b7d602554f7eab566a3d3fb68810: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:16:00.370793 13810 raft_consensus.cc:1261] T 3d9cc14079a845fd8a563041f7e1c397 P 2e7744069deb48e68bbc262cf97d1f6b [term 1 FOLLOWER]: Refusing update from remote peer 7fc7b7d602554f7eab566a3d3fb68810: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:16:00.371533 13932 consensus_queue.cc:1035] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5b6032983684e9d96ebe054de2abc2c" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 41151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:16:00.371896 13925 consensus_queue.cc:1035] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7744069deb48e68bbc262cf97d1f6b" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 34431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:16:00.382092 13936 mvcc.cc:205] Tried to move back new op lower bound from 7316711671270158336 to 7316711671143366656. Current Snapshot: MvccSnapshot[applied={T|T < 7316711671270158336}]
I20260809 20:16:00.393646 13163 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53796:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:16:00.393875 13163 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53796:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:16:00.405057 13163 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 96f86ca4e0344f28a1111dda82a74494: Sending DeleteTablet for 3 replicas of tablet 3d9cc14079a845fd8a563041f7e1c397
I20260809 20:16:00.406221 13780 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d9cc14079a845fd8a563041f7e1c397 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:16:00 UTC) from {username='slave'} at 127.0.0.1:41620
I20260809 20:16:00.406629 13567 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d9cc14079a845fd8a563041f7e1c397 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:16:00 UTC) from {username='slave'} at 127.0.0.1:54088
I20260809 20:16:00.407716 13363 tablet_service.cc:1514] Processing DeleteTablet for tablet 3d9cc14079a845fd8a563041f7e1c397 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:16:00 UTC) from {username='slave'} at 127.0.0.1:32814
I20260809 20:16:00.408339 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 13267
I20260809 20:16:00.419981 13947 tablet_replica.cc:330] T 3d9cc14079a845fd8a563041f7e1c397 P 2e7744069deb48e68bbc262cf97d1f6b: stopping tablet replica
I20260809 20:16:00.420986 13947 raft_consensus.cc:2229] T 3d9cc14079a845fd8a563041f7e1c397 P 2e7744069deb48e68bbc262cf97d1f6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:16:00.422057 13947 raft_consensus.cc:2258] T 3d9cc14079a845fd8a563041f7e1c397 P 2e7744069deb48e68bbc262cf97d1f6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:16:00.425802 13947 ts_tablet_manager.cc:1905] T 3d9cc14079a845fd8a563041f7e1c397 P 2e7744069deb48e68bbc262cf97d1f6b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:16:00.426525 13948 tablet_replica.cc:330] T 3d9cc14079a845fd8a563041f7e1c397 P e5b6032983684e9d96ebe054de2abc2c: stopping tablet replica
I20260809 20:16:00.427038 13948 raft_consensus.cc:2229] T 3d9cc14079a845fd8a563041f7e1c397 P e5b6032983684e9d96ebe054de2abc2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:16:00.427542 13948 raft_consensus.cc:2258] T 3d9cc14079a845fd8a563041f7e1c397 P e5b6032983684e9d96ebe054de2abc2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:16:00.428129 13950 tablet_replica.cc:330] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810: stopping tablet replica
I20260809 20:16:00.428742 13950 raft_consensus.cc:2229] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810 [term 1 LEADER]: Raft consensus shutting down.
I20260809 20:16:00.429350 13950 raft_consensus.cc:2258] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:16:00.430121 13948 ts_tablet_manager.cc:1905] T 3d9cc14079a845fd8a563041f7e1c397 P e5b6032983684e9d96ebe054de2abc2c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:16:00.431246 13950 ts_tablet_manager.cc:1905] T 3d9cc14079a845fd8a563041f7e1c397 P 7fc7b7d602554f7eab566a3d3fb68810: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:16:00.433135 13947 ts_tablet_manager.cc:1918] T 3d9cc14079a845fd8a563041f7e1c397 P 2e7744069deb48e68bbc262cf97d1f6b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:16:00.433346 13947 log.cc:1196] T 3d9cc14079a845fd8a563041f7e1c397 P 2e7744069deb48e68bbc262cf97d1f6b: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-2/wal/wals/3d9cc14079a845fd8a563041f7e1c397
I20260809 20:16:00.433701 13910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:00.409312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32826 (local address 127.14.181.1:41141)
0809 20:16:00.409481 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:00.409488 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:00.424745 (+ 15257us) server_negotiation.cc:407] Connection header received
0809 20:16:00.425264 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:00.425270 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:00.425372 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:00.425444 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:00.426723 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.427901 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.429903 (+ 2002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.430596 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.430689 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:00.432057 (+ 1368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:00.432068 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:00.432083 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:00.432799 (+ 716us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:00.432861 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:00.432886 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:00.432962 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:00.433208 (+ 246us) server_negotiation.cc:299] Negotiation successful
0809 20:16:00.433308 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 20:16:00.434123 13947 ts_tablet_manager.cc:1939] T 3d9cc14079a845fd8a563041f7e1c397 P 2e7744069deb48e68bbc262cf97d1f6b: Deleting consensus metadata
I20260809 20:16:00.434762 13455 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:16:00.435901 13136 catalog_manager.cc:4841] TS 2e7744069deb48e68bbc262cf97d1f6b (127.14.181.3:34431): tablet 3d9cc14079a845fd8a563041f7e1c397 (table test-table [id=36d0a9c6962947ad8cb63377542a6306]) successfully deleted
I20260809 20:16:00.437901 13948 ts_tablet_manager.cc:1918] T 3d9cc14079a845fd8a563041f7e1c397 P e5b6032983684e9d96ebe054de2abc2c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:16:00.438058 13948 log.cc:1196] T 3d9cc14079a845fd8a563041f7e1c397 P e5b6032983684e9d96ebe054de2abc2c: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786306256699363-15060-0/minicluster-data/ts-1/wal/wals/3d9cc14079a845fd8a563041f7e1c397
I20260809 20:16:00.438582 13948 ts_tablet_manager.cc:1939] T 3d9cc14079a845fd8a563041f7e1c397 P e5b6032983684e9d96ebe054de2abc2c: Deleting consensus metadata
I20260809 20:16:00.440079 13136 catalog_manager.cc:4841] TS e5b6032983684e9d96ebe054de2abc2c (127.14.181.2:41151): tablet 3d9cc14079a845fd8a563041f7e1c397 (table test-table [id=36d0a9c6962947ad8cb63377542a6306]) successfully deleted
I20260809 20:16:00.530431 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 13267
W20260809 20:16:00.553251 13138 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.14.181.1:41141 (error 108)
I20260809 20:16:00.553428 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 13470
I20260809 20:16:00.555076 13909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:00.554670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:41141 (local address 127.0.0.1:32836)
0809 20:16:00.554828 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:00.554939 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:41141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 20:16:00.555305 13138 catalog_manager.cc:4584] TS 7fc7b7d602554f7eab566a3d3fb68810 (127.14.181.1:41141): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3d9cc14079a845fd8a563041f7e1c397: Network error: Client connection negotiation failed: client connection to 127.14.181.1:41141: connect: Connection refused (error 111)
I20260809 20:16:00.560094 13913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:00.554219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54098 (local address 127.14.181.2:41151)
0809 20:16:00.554428 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:00.554435 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:00.554456 (+ 21us) server_negotiation.cc:407] Connection header received
0809 20:16:00.554625 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:00.554629 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:00.554725 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:00.554831 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:00.555309 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.556147 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.557349 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.557735 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.557824 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:00.558869 (+ 1045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:00.558877 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:00.558889 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:00.559432 (+ 543us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:00.559489 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:00.559514 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:00.559616 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:00.559723 (+ 107us) server_negotiation.cc:299] Negotiation successful
0809 20:16:00.559809 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 20:16:00.560724 13665 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:16:00.610041 13909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:00.608286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:41141 (local address 127.0.0.1:32842)
0809 20:16:00.609773 (+ 1487us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:00.609872 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:41141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1324}
I20260809 20:16:00.611101 13909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:00.610749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:41141 (local address 127.0.0.1:32848)
0809 20:16:00.610900 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:00.610995 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:41141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260809 20:16:00.661060 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 13470
I20260809 20:16:00.671716 13909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:00.671130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:41141 (local address 127.0.0.1:32862)
0809 20:16:00.671389 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:00.671498 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:41141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260809 20:16:00.672758 13909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:00.672354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:41141 (local address 127.0.0.1:32870)
0809 20:16:00.672510 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:00.672619 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:41141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 20:16:00.681622 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 13679
I20260809 20:16:00.687892 13904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:00.682305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41626 (local address 127.14.181.3:34431)
0809 20:16:00.682524 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:00.682528 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:00.682547 (+ 19us) server_negotiation.cc:407] Connection header received
0809 20:16:00.682713 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:00.682717 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:00.682802 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:00.682884 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:00.683224 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.683940 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.685179 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:00.685559 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:00.685648 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:00.686665 (+ 1017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:00.686674 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:00.686690 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:00.687256 (+ 566us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:00.687302 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:00.687322 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:00.687405 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:00.687498 (+ 93us) server_negotiation.cc:299] Negotiation successful
0809 20:16:00.687583 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260809 20:16:00.688455 13880 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:16:00.753448 13909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:00.753062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:41141 (local address 127.0.0.1:32886)
0809 20:16:00.753245 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:00.753319 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:41141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 20:16:00.754388 13909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:00.754000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:41141 (local address 127.0.0.1:32900)
0809 20:16:00.754185 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:00.754252 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.1:41141: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260809 20:16:00.774039 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 13679
I20260809 20:16:00.793416 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 13111
I20260809 20:16:00.794377 13214 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:16:00.898324 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 13111
2026-08-09T20:16:00Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (2624 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:16:01 dist-test-slave-6zbq krb5kdc[13963](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:16:01 dist-test-slave-6zbq krb5kdc[13963](info): set up 2 sockets
Aug 09 20:16:01 dist-test-slave-6zbq krb5kdc[13963](info): commencing operation
krb5kdc: starting...
W20260809 20:16:02.111001 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.004s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:16:02 dist-test-slave-6zbq krb5kdc[13963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306562, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:16:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:16:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:16:02.343398 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:38213
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:45239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:38213
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:16:02.656355 13982 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:02.656618 13982 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:02.656756 13982 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:02.663718 13982 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:16:02.663821 13982 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:02.663895 13982 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:02.663971 13982 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:16:02.664031 13982 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:16:02.673193 13982 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:45239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:38213
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:38213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:02.674242 13982 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:02.675393 13982 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:02.686043 13991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:02.686007 13997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:02.686081 13994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:02.686843 13982 server_base.cc:1034] running on GCE node
I20260809 20:16:02.687525 13982 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:02.688699 13982 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:02.689899 13982 hybrid_clock.cc:648] HybridClock initialized: now 1786306562689854 us; error 29 us; skew 500 ppm
I20260809 20:16:02.690198 13982 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:16:02 dist-test-slave-6zbq krb5kdc[13963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306562, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:16:02.696842 13982 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:16:02.698189 13982 webserver.cc:460] Webserver started at http://127.14.181.62:34579/ using document root <none> and password file <none>
I20260809 20:16:02.698827 13982 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:02.698944 13982 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:02.699201 13982 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:02.701881 13982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "6c5d742bd7b14515b8ff95ff0c01820c"
format_stamp: "Formatted at 2026-08-09 20:16:02 on dist-test-slave-6zbq"
server_key: "869a7d6d66300e7d066dbeca978038ff"
server_key_iv: "e55c9d5bf2b913678440eb6a78315880"
server_key_version: "encryptionkey@0"
I20260809 20:16:02.702623 13982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "6c5d742bd7b14515b8ff95ff0c01820c"
format_stamp: "Formatted at 2026-08-09 20:16:02 on dist-test-slave-6zbq"
server_key: "869a7d6d66300e7d066dbeca978038ff"
server_key_iv: "e55c9d5bf2b913678440eb6a78315880"
server_key_version: "encryptionkey@0"
I20260809 20:16:02.707289 13982 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 20:16:02.710384 14007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:02.711503 13982 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 20:16:02.711656 13982 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "6c5d742bd7b14515b8ff95ff0c01820c"
format_stamp: "Formatted at 2026-08-09 20:16:02 on dist-test-slave-6zbq"
server_key: "869a7d6d66300e7d066dbeca978038ff"
server_key_iv: "e55c9d5bf2b913678440eb6a78315880"
server_key_version: "encryptionkey@0"
I20260809 20:16:02.711820 13982 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:02.733675 13982 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:02.737164 13982 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:02.737406 13982 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:02.754426 13982 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:38213
I20260809 20:16:02.754472 14100 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:38213 every 8 connection(s)
I20260809 20:16:02.755618 13982 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:16:02.759019 14106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:02.762632 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 13982
I20260809 20:16:02.762804 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:16:02.763200 15060 external_mini_cluster.cc:1428] Setting key acb057474c1a24572c4794e0bdaa12d5
I20260809 20:16:02.770489 14106 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c5d742bd7b14515b8ff95ff0c01820c: Bootstrap starting.
I20260809 20:16:02.773840 14106 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c5d742bd7b14515b8ff95ff0c01820c: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:02.775027 14106 log.cc:824] T 00000000000000000000000000000000 P 6c5d742bd7b14515b8ff95ff0c01820c: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:02.777637 14106 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c5d742bd7b14515b8ff95ff0c01820c: No bootstrap required, opened a new log
Aug 09 20:16:02 dist-test-slave-6zbq krb5kdc[13963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306562, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:16:02.787528 14114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:02.764965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49758 (local address 127.14.181.62:38213)
0809 20:16:02.765842 (+ 877us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:02.765857 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:02.766231 (+ 374us) server_negotiation.cc:407] Connection header received
0809 20:16:02.768831 (+ 2600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:02.768857 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:02.769320 (+ 463us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:02.769720 (+ 400us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:02.770988 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:02.772939 (+ 1951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:02.774172 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:02.775208 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:02.775388 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:02.779430 (+ 4042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:02.779440 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:02.779462 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:02.779502 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:02.783396 (+ 3894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:02.784011 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:02.784019 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:02.784027 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:02.784233 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:02.784560 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:02.784565 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:02.784569 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:02.785222 (+ 653us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:02.785498 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:02.785843 (+ 345us) server_negotiation.cc:299] Negotiation successful
0809 20:16:02.786273 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":642,"thread_start_us":382,"threads_started":1}
I20260809 20:16:02.787528 14106 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c5d742bd7b14515b8ff95ff0c01820c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c5d742bd7b14515b8ff95ff0c01820c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 38213 } }
I20260809 20:16:02.788014 14106 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6c5d742bd7b14515b8ff95ff0c01820c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:02.788121 14106 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c5d742bd7b14515b8ff95ff0c01820c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5d742bd7b14515b8ff95ff0c01820c, State: Initialized, Role: FOLLOWER
I20260809 20:16:02.788636 14106 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c5d742bd7b14515b8ff95ff0c01820c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c5d742bd7b14515b8ff95ff0c01820c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 38213 } }
I20260809 20:16:02.788872 14106 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6c5d742bd7b14515b8ff95ff0c01820c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:16:02.789002 14106 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c5d742bd7b14515b8ff95ff0c01820c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:16:02.789175 14106 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c5d742bd7b14515b8ff95ff0c01820c [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:02.791327 14106 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c5d742bd7b14515b8ff95ff0c01820c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c5d742bd7b14515b8ff95ff0c01820c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 38213 } }
I20260809 20:16:02.791761 14106 leader_election.cc:302] T 00000000000000000000000000000000 P 6c5d742bd7b14515b8ff95ff0c01820c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c5d742bd7b14515b8ff95ff0c01820c; no voters:
I20260809 20:16:02.792285 14106 leader_election.cc:288] T 00000000000000000000000000000000 P 6c5d742bd7b14515b8ff95ff0c01820c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:16:02.792415 14118 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6c5d742bd7b14515b8ff95ff0c01820c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:16:02.793015 14118 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6c5d742bd7b14515b8ff95ff0c01820c [term 1 LEADER]: Becoming Leader. State: Replica: 6c5d742bd7b14515b8ff95ff0c01820c, State: Running, Role: LEADER
I20260809 20:16:02.793588 14118 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c5d742bd7b14515b8ff95ff0c01820c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c5d742bd7b14515b8ff95ff0c01820c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 38213 } }
I20260809 20:16:02.794116 14106 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c5d742bd7b14515b8ff95ff0c01820c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:16:02.796264 14119 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c5d742bd7b14515b8ff95ff0c01820c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6c5d742bd7b14515b8ff95ff0c01820c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c5d742bd7b14515b8ff95ff0c01820c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 38213 } } }
I20260809 20:16:02.796241 14120 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c5d742bd7b14515b8ff95ff0c01820c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c5d742bd7b14515b8ff95ff0c01820c. Latest consensus state: current_term: 1 leader_uuid: "6c5d742bd7b14515b8ff95ff0c01820c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c5d742bd7b14515b8ff95ff0c01820c" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 38213 } } }
I20260809 20:16:02.796650 14119 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c5d742bd7b14515b8ff95ff0c01820c [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:02.796650 14120 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c5d742bd7b14515b8ff95ff0c01820c [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:02.798492 14127 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:16:02.803521 14127 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:16:02.812578 14127 catalog_manager.cc:1347] Generated new cluster ID: 57a757fbc30f41d8b2e1863b164bbcb8
I20260809 20:16:02.812668 14127 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:16:02.837460 14127 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:16:02.838706 14127 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:16:02.847077 14127 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6c5d742bd7b14515b8ff95ff0c01820c: Generated new TSK 0
I20260809 20:16:02.847958 14127 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.14.181.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
Entry for principal kudu/127.14.181.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab.
I20260809 20:16:02.912897 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:0
--local_ip_for_outbound_sockets=127.14.181.1
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:38213
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:45239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:16:03.224229 14150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:03.224457 14150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:03.224577 14150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:03.231383 14150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:03.231474 14150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:03.231621 14150 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:16:03.240664 14150 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:45239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.1.keytab
--principal=kudu/127.14.181.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:38213
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:03.241631 14150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:03.242794 14150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:03.254426 14156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:03.254477 14159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:03.254508 14161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:03.255227 14150 server_base.cc:1034] running on GCE node
I20260809 20:16:03.255753 14150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:03.256553 14150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:03.257743 14150 hybrid_clock.cc:648] HybridClock initialized: now 1786306563257691 us; error 42 us; skew 500 ppm
I20260809 20:16:03.258013 14150 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:16:03 dist-test-slave-6zbq krb5kdc[13963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306563, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:16:03.260907 14150 init.cc:377] Logged in from keytab as kudu/127.14.181.1@KRBTEST.COM (short username kudu)
I20260809 20:16:03.262171 14150 webserver.cc:460] Webserver started at http://127.14.181.1:39313/ using document root <none> and password file <none>
I20260809 20:16:03.262799 14150 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:03.262912 14150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:03.263190 14150 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:03.265751 14150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-0/data/instance:
uuid: "140de158c6b94f5292a74a68f20a0af6"
format_stamp: "Formatted at 2026-08-09 20:16:03 on dist-test-slave-6zbq"
server_key: "83481fe755e5bcf158d50fa6ff941ac3"
server_key_iv: "fad6f44e5609dd44ede216c445f20fb3"
server_key_version: "encryptionkey@0"
I20260809 20:16:03.266492 14150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance:
uuid: "140de158c6b94f5292a74a68f20a0af6"
format_stamp: "Formatted at 2026-08-09 20:16:03 on dist-test-slave-6zbq"
server_key: "83481fe755e5bcf158d50fa6ff941ac3"
server_key_iv: "fad6f44e5609dd44ede216c445f20fb3"
server_key_version: "encryptionkey@0"
I20260809 20:16:03.271055 14150 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 20:16:03.274083 14175 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:03.275229 14150 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 20:16:03.275372 14150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "140de158c6b94f5292a74a68f20a0af6"
format_stamp: "Formatted at 2026-08-09 20:16:03 on dist-test-slave-6zbq"
server_key: "83481fe755e5bcf158d50fa6ff941ac3"
server_key_iv: "fad6f44e5609dd44ede216c445f20fb3"
server_key_version: "encryptionkey@0"
I20260809 20:16:03.275544 14150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:03.289234 14150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:03.292577 14150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:03.292804 14150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:03.293594 14150 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:16:03.294854 14150 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:16:03.294930 14150 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:03.295038 14150 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:16:03.295094 14150 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:03.326869 14150 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:35607
I20260809 20:16:03.326908 14350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:35607 every 8 connection(s)
I20260809 20:16:03.327984 14150 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:16:03.333179 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 14150
I20260809 20:16:03.333356 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance
I20260809 20:16:03.333832 15060 external_mini_cluster.cc:1428] Setting key a96235cd7fcf96db72ff258cd5be30e9
Aug 09 20:16:03 dist-test-slave-6zbq krb5kdc[13963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306563, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.1@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:16:03.348897 14357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:03.330667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:38213 (local address 127.14.181.1:45221)
0809 20:16:03.331348 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:03.331386 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:03.332980 (+ 1594us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:03.333649 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:03.333657 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:03.334302 (+ 645us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:16:03.334976 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:03.334996 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:03.336217 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:03.336222 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:03.338004 (+ 1782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:03.338020 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:03.338777 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:03.338783 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:03.339031 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:03.339689 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:16:03.339716 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:16:03.342002 (+ 2286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:16:03.344951 (+ 2949us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:03.344958 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:03.344971 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:03.345485 (+ 514us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:03.345799 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:03.345803 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:03.345806 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:03.346033 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:03.346593 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:16:03.346600 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:16:03.346963 (+ 363us) client_negotiation.cc:769] Sending connection context
0809 20:16:03.347233 (+ 270us) client_negotiation.cc:240] Negotiation successful
0809 20:16:03.347699 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":263,"threads_started":1}
I20260809 20:16:03.349915 14355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:03.330142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:45221 (local address 127.14.181.62:38213)
0809 20:16:03.330597 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:03.330603 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:03.331501 (+ 898us) server_negotiation.cc:407] Connection header received
0809 20:16:03.333240 (+ 1739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:03.333246 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:03.333335 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:03.333461 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:03.335138 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:03.336059 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:03.338126 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:03.338565 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:03.338652 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:03.342213 (+ 3561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:03.342218 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:03.342221 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:03.342251 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:03.344805 (+ 2554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:03.345580 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:03.345585 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:03.345588 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:03.345708 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:03.346127 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:03.346130 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:03.346133 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:03.346463 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:03.346582 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:03.348918 (+ 2336us) server_negotiation.cc:299] Negotiation successful
0809 20:16:03.349553 (+ 635us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":322,"thread_start_us":222,"threads_started":1}
I20260809 20:16:03.351091 14351 heartbeater.cc:347] Connected to a master server at 127.14.181.62:38213
I20260809 20:16:03.351372 14351 heartbeater.cc:464] Registering TS with master...
I20260809 20:16:03.352010 14351 heartbeater.cc:511] Master 127.14.181.62:38213 requested a full tablet report, sending...
I20260809 20:16:03.354121 14041 ts_manager.cc:194] Registered new tserver with Master: 140de158c6b94f5292a74a68f20a0af6 (127.14.181.1:35607)
I20260809 20:16:03.356019 14041 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.1@KRBTEST.COM'} at 127.14.181.1:45221
WARNING: no policy specified for kudu/127.14.181.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
Entry for principal kudu/127.14.181.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab.
I20260809 20:16:03.394797 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:0
--local_ip_for_outbound_sockets=127.14.181.2
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:38213
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:45239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:16:03.703475 14360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:03.703704 14360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:03.703814 14360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:03.710604 14360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:03.710690 14360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:03.710824 14360 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:16:03.720302 14360 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:45239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.2.keytab
--principal=kudu/127.14.181.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:38213
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:03.721338 14360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:03.722524 14360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:03.734246 14368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:03.734315 14370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:03.734310 14374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:03.734988 14360 server_base.cc:1034] running on GCE node
I20260809 20:16:03.735467 14360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:03.736207 14360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:03.737386 14360 hybrid_clock.cc:648] HybridClock initialized: now 1786306563737345 us; error 36 us; skew 500 ppm
I20260809 20:16:03.737656 14360 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:16:03 dist-test-slave-6zbq krb5kdc[13963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306563, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:16:03.740463 14360 init.cc:377] Logged in from keytab as kudu/127.14.181.2@KRBTEST.COM (short username kudu)
I20260809 20:16:03.741756 14360 webserver.cc:460] Webserver started at http://127.14.181.2:34137/ using document root <none> and password file <none>
I20260809 20:16:03.742372 14360 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:03.742491 14360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:03.742767 14360 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:03.745474 14360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-1/data/instance:
uuid: "28f4f50a8a384090bcf005c874547105"
format_stamp: "Formatted at 2026-08-09 20:16:03 on dist-test-slave-6zbq"
server_key: "30acc0a2ac9c13df389e74028a4107ff"
server_key_iv: "ad11fe112fd2571587ce1ef3b1aa6a52"
server_key_version: "encryptionkey@0"
I20260809 20:16:03.746171 14360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance:
uuid: "28f4f50a8a384090bcf005c874547105"
format_stamp: "Formatted at 2026-08-09 20:16:03 on dist-test-slave-6zbq"
server_key: "30acc0a2ac9c13df389e74028a4107ff"
server_key_iv: "ad11fe112fd2571587ce1ef3b1aa6a52"
server_key_version: "encryptionkey@0"
I20260809 20:16:03.750784 14360 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 20:16:03.753818 14393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:03.755110 14360 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 20:16:03.755255 14360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "28f4f50a8a384090bcf005c874547105"
format_stamp: "Formatted at 2026-08-09 20:16:03 on dist-test-slave-6zbq"
server_key: "30acc0a2ac9c13df389e74028a4107ff"
server_key_iv: "ad11fe112fd2571587ce1ef3b1aa6a52"
server_key_version: "encryptionkey@0"
I20260809 20:16:03.755424 14360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:03.777398 14360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:03.781157 14360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:03.781399 14360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:03.782259 14360 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:16:03.783447 14360 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:16:03.783519 14360 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:03.783636 14360 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:16:03.783686 14360 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:03.811738 14360 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:35519
I20260809 20:16:03.811802 14576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:35519 every 8 connection(s)
I20260809 20:16:03.812830 14360 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:16:03.818318 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 14360
I20260809 20:16:03.818516 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance
I20260809 20:16:03.818929 15060 external_mini_cluster.cc:1428] Setting key 1a86ea8886b639f512b45e28a06b2dd5
Aug 09 20:16:03 dist-test-slave-6zbq krb5kdc[13963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306563, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.2@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:16:03.832242 14355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:03.815039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:45197 (local address 127.14.181.62:38213)
0809 20:16:03.815204 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:03.815209 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:03.816351 (+ 1142us) server_negotiation.cc:407] Connection header received
0809 20:16:03.818088 (+ 1737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:03.818094 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:03.818176 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:03.818265 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:03.819723 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:03.820729 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:03.822823 (+ 2094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:03.823219 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:03.823319 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:03.826992 (+ 3673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:03.827001 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:03.827004 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:03.827035 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:03.829395 (+ 2360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:03.830062 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:03.830066 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:03.830069 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:03.830201 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:03.830639 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:03.830643 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:03.830645 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:03.830904 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:03.831034 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:03.831688 (+ 654us) server_negotiation.cc:299] Negotiation successful
0809 20:16:03.831925 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 20:16:03.833024 14582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:03.815514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:38213 (local address 127.14.181.2:45197)
0809 20:16:03.816218 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:03.816252 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:03.817823 (+ 1571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:03.818521 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:03.818529 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:03.819008 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:16:03.819537 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:03.819556 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:03.820876 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:03.820881 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:03.822681 (+ 1800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:03.822697 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:03.823427 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:03.823433 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:03.823686 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:03.824299 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:16:03.824324 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:16:03.826782 (+ 2458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:16:03.829526 (+ 2744us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:03.829535 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:03.829549 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:03.829939 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:03.830304 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:03.830308 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:03.830312 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:03.830524 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:03.831025 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:16:03.831031 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:16:03.831332 (+ 301us) client_negotiation.cc:769] Sending connection context
0809 20:16:03.831548 (+ 216us) client_negotiation.cc:240] Negotiation successful
0809 20:16:03.831993 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":289,"threads_started":1}
I20260809 20:16:03.834327 14577 heartbeater.cc:347] Connected to a master server at 127.14.181.62:38213
I20260809 20:16:03.834616 14577 heartbeater.cc:464] Registering TS with master...
I20260809 20:16:03.835233 14577 heartbeater.cc:511] Master 127.14.181.62:38213 requested a full tablet report, sending...
I20260809 20:16:03.836566 14041 ts_manager.cc:194] Registered new tserver with Master: 28f4f50a8a384090bcf005c874547105 (127.14.181.2:35519)
I20260809 20:16:03.837335 14041 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.2@KRBTEST.COM'} at 127.14.181.2:45197
WARNING: no policy specified for kudu/127.14.181.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
Entry for principal kudu/127.14.181.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab.
I20260809 20:16:03.875384 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:0
--local_ip_for_outbound_sockets=127.14.181.3
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:38213
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:45239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:16:04.179323 14596 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:04.179549 14596 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:04.179646 14596 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:04.186354 14596 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:04.186439 14596 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:04.186546 14596 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:16:04.195326 14596 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:45239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.3.keytab
--principal=kudu/127.14.181.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:38213
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:04.196288 14596 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:04.197365 14596 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:04.208940 14606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:04.209157 14603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:04.209057 14604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:04.209913 14596 server_base.cc:1034] running on GCE node
I20260809 20:16:04.210462 14596 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:04.211211 14596 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:04.212393 14596 hybrid_clock.cc:648] HybridClock initialized: now 1786306564212344 us; error 45 us; skew 500 ppm
I20260809 20:16:04.212637 14596 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:16:04 dist-test-slave-6zbq krb5kdc[13963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306564, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:16:04.215520 14596 init.cc:377] Logged in from keytab as kudu/127.14.181.3@KRBTEST.COM (short username kudu)
I20260809 20:16:04.216853 14596 webserver.cc:460] Webserver started at http://127.14.181.3:45979/ using document root <none> and password file <none>
I20260809 20:16:04.217423 14596 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:04.217528 14596 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:04.217809 14596 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:04.220393 14596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-2/data/instance:
uuid: "3458bf9aadff4c958794c47921c10c6e"
format_stamp: "Formatted at 2026-08-09 20:16:04 on dist-test-slave-6zbq"
server_key: "2bda464341d9f4c422b83261b5030312"
server_key_iv: "d0c853a9fa00d80dd32b1b4240136dfc"
server_key_version: "encryptionkey@0"
I20260809 20:16:04.221065 14596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance:
uuid: "3458bf9aadff4c958794c47921c10c6e"
format_stamp: "Formatted at 2026-08-09 20:16:04 on dist-test-slave-6zbq"
server_key: "2bda464341d9f4c422b83261b5030312"
server_key_iv: "d0c853a9fa00d80dd32b1b4240136dfc"
server_key_version: "encryptionkey@0"
I20260809 20:16:04.225543 14596 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260809 20:16:04.228578 14619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:04.229692 14596 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 20:16:04.229828 14596 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "3458bf9aadff4c958794c47921c10c6e"
format_stamp: "Formatted at 2026-08-09 20:16:04 on dist-test-slave-6zbq"
server_key: "2bda464341d9f4c422b83261b5030312"
server_key_iv: "d0c853a9fa00d80dd32b1b4240136dfc"
server_key_version: "encryptionkey@0"
I20260809 20:16:04.229990 14596 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:04.256588 14596 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:04.260090 14596 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:04.260336 14596 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:04.261147 14596 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:16:04.262428 14596 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:16:04.262506 14596 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:04.262619 14596 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:16:04.262669 14596 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:04.289754 14596 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:33109
I20260809 20:16:04.289806 14803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:33109 every 8 connection(s)
I20260809 20:16:04.290868 14596 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:16:04.294788 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 14596
I20260809 20:16:04.294989 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance
I20260809 20:16:04.295526 15060 external_mini_cluster.cc:1428] Setting key 01f06c696bf3deee0892184b9f292938
Aug 09 20:16:04 dist-test-slave-6zbq krb5kdc[13963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306564, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.3@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:16:04.308977 14355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:04.293038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:56975 (local address 127.14.181.62:38213)
0809 20:16:04.293205 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:04.293211 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:04.294231 (+ 1020us) server_negotiation.cc:407] Connection header received
0809 20:16:04.296506 (+ 2275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:04.296511 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:04.296592 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:04.296678 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:04.298011 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.298880 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.300421 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.300876 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.300983 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:04.303993 (+ 3010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:04.303998 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:04.304001 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:04.304033 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:04.306263 (+ 2230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:04.306916 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:04.306920 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:04.306922 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:04.307049 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:04.307447 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:04.307450 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:04.307452 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:04.307704 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:04.307838 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:04.308444 (+ 606us) server_negotiation.cc:299] Negotiation successful
0809 20:16:04.308658 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 20:16:04.309734 14807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:04.293414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:38213 (local address 127.14.181.3:56975)
0809 20:16:04.294086 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:04.294121 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:04.296248 (+ 2127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:04.296908 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:04.296916 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:04.297360 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:16:04.297854 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:04.297870 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.299026 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.299030 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:04.300288 (+ 1258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:04.300301 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.301095 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.301104 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:04.301322 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:04.301819 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:16:04.301839 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:16:04.303802 (+ 1963us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:16:04.306406 (+ 2604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:04.306414 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:04.306427 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:04.306807 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:04.307150 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:04.307156 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:04.307160 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:04.307328 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:04.307825 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:16:04.307832 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:16:04.308101 (+ 269us) client_negotiation.cc:769] Sending connection context
0809 20:16:04.308310 (+ 209us) client_negotiation.cc:240] Negotiation successful
0809 20:16:04.308755 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":251,"threads_started":1}
I20260809 20:16:04.310950 14804 heartbeater.cc:347] Connected to a master server at 127.14.181.62:38213
I20260809 20:16:04.311213 14804 heartbeater.cc:464] Registering TS with master...
I20260809 20:16:04.311810 14804 heartbeater.cc:511] Master 127.14.181.62:38213 requested a full tablet report, sending...
I20260809 20:16:04.313040 14041 ts_manager.cc:194] Registered new tserver with Master: 3458bf9aadff4c958794c47921c10c6e (127.14.181.3:33109)
I20260809 20:16:04.313802 14041 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.14.181.3@KRBTEST.COM'} at 127.14.181.3:56975
I20260809 20:16:04.321687 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 20:16:04.337277 14355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:04.325587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49762 (local address 127.14.181.62:38213)
0809 20:16:04.325763 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:04.325769 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:04.326103 (+ 334us) server_negotiation.cc:407] Connection header received
0809 20:16:04.326243 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:04.326248 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:04.326314 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:04.326448 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:04.327706 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.328721 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.329976 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.330426 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.330526 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:04.332677 (+ 2151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:04.332683 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:04.332688 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:04.332715 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:04.334948 (+ 2233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:04.335520 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:04.335524 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:04.335526 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:04.335647 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:04.335992 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:04.335996 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:04.335999 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:04.336281 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:04.336498 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:04.336809 (+ 311us) server_negotiation.cc:299] Negotiation successful
0809 20:16:04.336995 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 20:16:04.340477 14041 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49762:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 20:16:04.346901 14041 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 20:16:04.359175 14351 heartbeater.cc:503] Master 127.14.181.62:38213 was elected leader, sending a full tablet report...
I20260809 20:16:04.378269 14827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:04.357179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:35519 (local address 127.0.0.1:59504)
0809 20:16:04.357973 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:04.358019 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:04.358175 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:04.371359 (+ 13184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:04.371366 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:04.371397 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:16:04.371786 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:04.371802 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.373933 (+ 2131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.373938 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:04.376108 (+ 2170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:04.376120 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.377421 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.377427 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:04.377607 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:04.377659 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 20:16:04.377756 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 20:16:04.377935 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":397,"threads_started":1}
I20260809 20:16:04.378968 14831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:04.357253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59504 (local address 127.14.181.2:35519)
0809 20:16:04.369884 (+ 12631us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:04.369893 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:04.369924 (+ 31us) server_negotiation.cc:407] Connection header received
0809 20:16:04.370033 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:04.370040 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:04.370262 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:04.372009 (+ 1747us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:16:04.372257 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.373781 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.376254 (+ 2473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.377190 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.378071 (+ 881us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:04.378263 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:04.378555 (+ 292us) server_negotiation.cc:299] Negotiation successful
0809 20:16:04.378741 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12466,"thread_start_us":13806,"threads_started":1}
I20260809 20:16:04.380231 14835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:04.358318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:35607 (local address 127.0.0.1:56444)
0809 20:16:04.372163 (+ 13845us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:04.372181 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:04.372302 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:04.373112 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:04.373117 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:04.373141 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:16:04.373751 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:04.373771 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.375339 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.375345 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:04.377436 (+ 2091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:04.377452 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.379481 (+ 2029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.379488 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:04.379645 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:04.379678 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 20:16:04.379754 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 20:16:04.379869 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13709,"mutex_wait_us":3,"thread_start_us":13884,"threads_started":1}
I20260809 20:16:04.380462 14837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:04.358781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56444 (local address 127.14.181.1:35607)
0809 20:16:04.372613 (+ 13832us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:04.372621 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:04.372648 (+ 27us) server_negotiation.cc:407] Connection header received
0809 20:16:04.372735 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:04.372742 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:04.372935 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:04.373103 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:16:04.374011 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.375215 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.377617 (+ 2402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.379001 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.379127 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:04.379346 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:04.380012 (+ 666us) server_negotiation.cc:299] Negotiation successful
0809 20:16:04.380168 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13678,"thread_start_us":14036,"threads_started":1}
I20260809 20:16:04.381392 14832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:04.357317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:33109 (local address 127.0.0.1:48700)
0809 20:16:04.370854 (+ 13537us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:04.370872 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:04.370983 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:04.373443 (+ 2460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:04.373448 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:04.373475 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:16:04.373873 (+ 398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:04.373889 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.375787 (+ 1898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.375792 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:04.377890 (+ 2098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:04.377904 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.380606 (+ 2702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.380613 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:04.380773 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:04.380803 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 20:16:04.380897 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 20:16:04.381011 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13402,"mutex_wait_us":19,"thread_start_us":13254,"threads_started":1}
I20260809 20:16:04.382477 14833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:04.357879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48700 (local address 127.14.181.3:33109)
0809 20:16:04.372928 (+ 15049us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:04.372936 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:04.372965 (+ 29us) server_negotiation.cc:407] Connection header received
0809 20:16:04.373042 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:04.373049 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:04.373252 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:04.373442 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:16:04.374072 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.375639 (+ 1567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.378085 (+ 2446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.379579 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.379692 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:04.379904 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:04.380965 (+ 1061us) server_negotiation.cc:299] Negotiation successful
0809 20:16:04.382138 (+ 1173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14916,"thread_start_us":14771,"threads_started":1}
I20260809 20:16:04.382246 14467 tablet_service.cc:1467] Processing CreateTablet for tablet e76912b5b7924722961228396797bb31 (DEFAULT_TABLE table=test-table [id=cf18363c7c0746aba66e51b248463f78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:16:04.383625 14467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e76912b5b7924722961228396797bb31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:04.383419 14248 tablet_service.cc:1467] Processing CreateTablet for tablet e76912b5b7924722961228396797bb31 (DEFAULT_TABLE table=test-table [id=cf18363c7c0746aba66e51b248463f78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:16:04.384801 14248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e76912b5b7924722961228396797bb31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:04.385869 14689 tablet_service.cc:1467] Processing CreateTablet for tablet e76912b5b7924722961228396797bb31 (DEFAULT_TABLE table=test-table [id=cf18363c7c0746aba66e51b248463f78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:16:04.387253 14689 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e76912b5b7924722961228396797bb31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:04.394167 14839 tablet_bootstrap.cc:492] T e76912b5b7924722961228396797bb31 P 28f4f50a8a384090bcf005c874547105: Bootstrap starting.
I20260809 20:16:04.397030 14839 tablet_bootstrap.cc:654] T e76912b5b7924722961228396797bb31 P 28f4f50a8a384090bcf005c874547105: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:04.398034 14839 log.cc:824] T e76912b5b7924722961228396797bb31 P 28f4f50a8a384090bcf005c874547105: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:04.398425 14841 tablet_bootstrap.cc:492] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6: Bootstrap starting.
I20260809 20:16:04.401976 14841 tablet_bootstrap.cc:654] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:04.403041 14845 tablet_bootstrap.cc:492] T e76912b5b7924722961228396797bb31 P 3458bf9aadff4c958794c47921c10c6e: Bootstrap starting.
I20260809 20:16:04.403219 14841 log.cc:824] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:04.404642 14839 tablet_bootstrap.cc:492] T e76912b5b7924722961228396797bb31 P 28f4f50a8a384090bcf005c874547105: No bootstrap required, opened a new log
I20260809 20:16:04.404881 14839 ts_tablet_manager.cc:1397] T e76912b5b7924722961228396797bb31 P 28f4f50a8a384090bcf005c874547105: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260809 20:16:04.406917 14845 tablet_bootstrap.cc:654] T e76912b5b7924722961228396797bb31 P 3458bf9aadff4c958794c47921c10c6e: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:04.408095 14845 log.cc:824] T e76912b5b7924722961228396797bb31 P 3458bf9aadff4c958794c47921c10c6e: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:04.410964 14845 tablet_bootstrap.cc:492] T e76912b5b7924722961228396797bb31 P 3458bf9aadff4c958794c47921c10c6e: No bootstrap required, opened a new log
I20260809 20:16:04.411207 14845 ts_tablet_manager.cc:1397] T e76912b5b7924722961228396797bb31 P 3458bf9aadff4c958794c47921c10c6e: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260809 20:16:04.413462 14841 tablet_bootstrap.cc:492] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6: No bootstrap required, opened a new log
I20260809 20:16:04.413709 14841 ts_tablet_manager.cc:1397] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6: Time spent bootstrapping tablet: real 0.016s user 0.011s sys 0.000s
I20260809 20:16:04.413581 14839 raft_consensus.cc:348] T e76912b5b7924722961228396797bb31 P 28f4f50a8a384090bcf005c874547105 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28f4f50a8a384090bcf005c874547105" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35519 } } peers { permanent_uuid: "3458bf9aadff4c958794c47921c10c6e" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 33109 } } peers { permanent_uuid: "140de158c6b94f5292a74a68f20a0af6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35607 } }
I20260809 20:16:04.413956 14839 raft_consensus.cc:374] T e76912b5b7924722961228396797bb31 P 28f4f50a8a384090bcf005c874547105 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:04.414053 14839 raft_consensus.cc:729] T e76912b5b7924722961228396797bb31 P 28f4f50a8a384090bcf005c874547105 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28f4f50a8a384090bcf005c874547105, State: Initialized, Role: FOLLOWER
I20260809 20:16:04.414638 14839 consensus_queue.cc:260] T e76912b5b7924722961228396797bb31 P 28f4f50a8a384090bcf005c874547105 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28f4f50a8a384090bcf005c874547105" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35519 } } peers { permanent_uuid: "3458bf9aadff4c958794c47921c10c6e" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 33109 } } peers { permanent_uuid: "140de158c6b94f5292a74a68f20a0af6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35607 } }
I20260809 20:16:04.415755 14577 heartbeater.cc:503] Master 127.14.181.62:38213 was elected leader, sending a full tablet report...
I20260809 20:16:04.416404 14839 ts_tablet_manager.cc:1428] T e76912b5b7924722961228396797bb31 P 28f4f50a8a384090bcf005c874547105: Time spent starting tablet: real 0.011s user 0.009s sys 0.004s
I20260809 20:16:04.421063 14845 raft_consensus.cc:348] T e76912b5b7924722961228396797bb31 P 3458bf9aadff4c958794c47921c10c6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28f4f50a8a384090bcf005c874547105" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35519 } } peers { permanent_uuid: "3458bf9aadff4c958794c47921c10c6e" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 33109 } } peers { permanent_uuid: "140de158c6b94f5292a74a68f20a0af6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35607 } }
I20260809 20:16:04.421455 14845 raft_consensus.cc:374] T e76912b5b7924722961228396797bb31 P 3458bf9aadff4c958794c47921c10c6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:04.421547 14845 raft_consensus.cc:729] T e76912b5b7924722961228396797bb31 P 3458bf9aadff4c958794c47921c10c6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3458bf9aadff4c958794c47921c10c6e, State: Initialized, Role: FOLLOWER
I20260809 20:16:04.422101 14845 consensus_queue.cc:260] T e76912b5b7924722961228396797bb31 P 3458bf9aadff4c958794c47921c10c6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28f4f50a8a384090bcf005c874547105" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35519 } } peers { permanent_uuid: "3458bf9aadff4c958794c47921c10c6e" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 33109 } } peers { permanent_uuid: "140de158c6b94f5292a74a68f20a0af6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35607 } }
I20260809 20:16:04.423112 14804 heartbeater.cc:503] Master 127.14.181.62:38213 was elected leader, sending a full tablet report...
I20260809 20:16:04.423712 14845 ts_tablet_manager.cc:1428] T e76912b5b7924722961228396797bb31 P 3458bf9aadff4c958794c47921c10c6e: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260809 20:16:04.423935 14841 raft_consensus.cc:348] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28f4f50a8a384090bcf005c874547105" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35519 } } peers { permanent_uuid: "3458bf9aadff4c958794c47921c10c6e" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 33109 } } peers { permanent_uuid: "140de158c6b94f5292a74a68f20a0af6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35607 } }
I20260809 20:16:04.424316 14841 raft_consensus.cc:374] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:04.424398 14841 raft_consensus.cc:729] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 140de158c6b94f5292a74a68f20a0af6, State: Initialized, Role: FOLLOWER
I20260809 20:16:04.424932 14841 consensus_queue.cc:260] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28f4f50a8a384090bcf005c874547105" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35519 } } peers { permanent_uuid: "3458bf9aadff4c958794c47921c10c6e" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 33109 } } peers { permanent_uuid: "140de158c6b94f5292a74a68f20a0af6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35607 } }
I20260809 20:16:04.426491 14841 ts_tablet_manager.cc:1428] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6: Time spent starting tablet: real 0.013s user 0.013s sys 0.001s
I20260809 20:16:04.447773 14852 raft_consensus.cc:482] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:16:04.447994 14852 raft_consensus.cc:504] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28f4f50a8a384090bcf005c874547105" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35519 } } peers { permanent_uuid: "3458bf9aadff4c958794c47921c10c6e" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 33109 } } peers { permanent_uuid: "140de158c6b94f5292a74a68f20a0af6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35607 } }
I20260809 20:16:04.449386 14852 leader_election.cc:288] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28f4f50a8a384090bcf005c874547105 (127.14.181.2:35519), 3458bf9aadff4c958794c47921c10c6e (127.14.181.3:33109)
I20260809 20:16:04.457674 14833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:04.449803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:42637 (local address 127.14.181.3:33109)
0809 20:16:04.449957 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:04.449963 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:04.450655 (+ 692us) server_negotiation.cc:407] Connection header received
0809 20:16:04.450771 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:04.450777 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:04.450849 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:04.450942 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:16:04.451784 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.452796 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.455467 (+ 2671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.456653 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.456805 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:04.456872 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:04.457300 (+ 428us) server_negotiation.cc:299] Negotiation successful
0809 20:16:04.457428 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 20:16:04.457675 14831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:04.449772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:38511 (local address 127.14.181.2:35519)
0809 20:16:04.449957 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:04.449962 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:04.450586 (+ 624us) server_negotiation.cc:407] Connection header received
0809 20:16:04.450771 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:04.450777 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:04.450849 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:04.450955 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:16:04.451710 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.452795 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.455473 (+ 2678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.456655 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.456800 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:04.456872 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:04.457305 (+ 433us) server_negotiation.cc:299] Negotiation successful
0809 20:16:04.457428 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 20:16:04.457964 14854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:04.449729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:33109 (local address 127.14.181.1:42637)
0809 20:16:04.450563 (+ 834us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:04.450577 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:04.450668 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:04.450964 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:04.450969 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:04.450996 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:16:04.451636 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:04.451646 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.452913 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.452919 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:04.455336 (+ 2417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:04.455345 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.456885 (+ 1540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.456890 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:04.457089 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:04.457175 (+ 86us) client_negotiation.cc:769] Sending connection context
0809 20:16:04.457266 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 20:16:04.457439 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":731,"mutex_wait_us":235,"thread_start_us":444,"threads_started":1}
I20260809 20:16:04.458178 14853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:04.449572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:35519 (local address 127.14.181.1:38511)
0809 20:16:04.450480 (+ 908us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:04.450500 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:04.450643 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:04.450964 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:04.450969 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:04.451054 (+ 85us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:16:04.451549 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:04.451566 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.452918 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.452922 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:04.455330 (+ 2408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:04.455345 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.456868 (+ 1523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.456874 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:04.457084 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:04.457175 (+ 91us) client_negotiation.cc:769] Sending connection context
0809 20:16:04.457263 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 20:16:04.457439 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":752,"mutex_wait_us":160,"spinlock_wait_cycles":18304,"thread_start_us":556,"threads_started":1}
I20260809 20:16:04.458927 14727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76912b5b7924722961228396797bb31" candidate_uuid: "140de158c6b94f5292a74a68f20a0af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3458bf9aadff4c958794c47921c10c6e" is_pre_election: true
I20260809 20:16:04.459009 14499 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76912b5b7924722961228396797bb31" candidate_uuid: "140de158c6b94f5292a74a68f20a0af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28f4f50a8a384090bcf005c874547105" is_pre_election: true
I20260809 20:16:04.459400 14727 raft_consensus.cc:2454] T e76912b5b7924722961228396797bb31 P 3458bf9aadff4c958794c47921c10c6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 140de158c6b94f5292a74a68f20a0af6 in term 0.
I20260809 20:16:04.459434 14499 raft_consensus.cc:2454] T e76912b5b7924722961228396797bb31 P 28f4f50a8a384090bcf005c874547105 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 140de158c6b94f5292a74a68f20a0af6 in term 0.
I20260809 20:16:04.460011 14177 leader_election.cc:302] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 140de158c6b94f5292a74a68f20a0af6, 28f4f50a8a384090bcf005c874547105, 3458bf9aadff4c958794c47921c10c6e; no voters:
I20260809 20:16:04.460361 14852 raft_consensus.cc:2781] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:16:04.460479 14852 raft_consensus.cc:482] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:16:04.460572 14852 raft_consensus.cc:3037] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:04.462777 14852 raft_consensus.cc:504] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28f4f50a8a384090bcf005c874547105" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35519 } } peers { permanent_uuid: "3458bf9aadff4c958794c47921c10c6e" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 33109 } } peers { permanent_uuid: "140de158c6b94f5292a74a68f20a0af6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35607 } }
I20260809 20:16:04.463348 14852 leader_election.cc:288] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6 [CANDIDATE]: Term 1 election: Requested vote from peers 28f4f50a8a384090bcf005c874547105 (127.14.181.2:35519), 3458bf9aadff4c958794c47921c10c6e (127.14.181.3:33109)
I20260809 20:16:04.463716 14499 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76912b5b7924722961228396797bb31" candidate_uuid: "140de158c6b94f5292a74a68f20a0af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28f4f50a8a384090bcf005c874547105"
I20260809 20:16:04.463757 14727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e76912b5b7924722961228396797bb31" candidate_uuid: "140de158c6b94f5292a74a68f20a0af6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3458bf9aadff4c958794c47921c10c6e"
I20260809 20:16:04.463864 14499 raft_consensus.cc:3037] T e76912b5b7924722961228396797bb31 P 28f4f50a8a384090bcf005c874547105 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:04.463912 14727 raft_consensus.cc:3037] T e76912b5b7924722961228396797bb31 P 3458bf9aadff4c958794c47921c10c6e [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:04.466176 14499 raft_consensus.cc:2454] T e76912b5b7924722961228396797bb31 P 28f4f50a8a384090bcf005c874547105 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 140de158c6b94f5292a74a68f20a0af6 in term 1.
I20260809 20:16:04.466234 14727 raft_consensus.cc:2454] T e76912b5b7924722961228396797bb31 P 3458bf9aadff4c958794c47921c10c6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 140de158c6b94f5292a74a68f20a0af6 in term 1.
I20260809 20:16:04.466542 14182 leader_election.cc:302] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 140de158c6b94f5292a74a68f20a0af6, 28f4f50a8a384090bcf005c874547105; no voters:
I20260809 20:16:04.466827 14852 raft_consensus.cc:2781] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:16:04.467232 14852 raft_consensus.cc:686] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6 [term 1 LEADER]: Becoming Leader. State: Replica: 140de158c6b94f5292a74a68f20a0af6, State: Running, Role: LEADER
I20260809 20:16:04.467685 14852 consensus_queue.cc:237] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28f4f50a8a384090bcf005c874547105" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35519 } } peers { permanent_uuid: "3458bf9aadff4c958794c47921c10c6e" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 33109 } } peers { permanent_uuid: "140de158c6b94f5292a74a68f20a0af6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35607 } }
I20260809 20:16:04.471973 14041 catalog_manager.cc:5495] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 140de158c6b94f5292a74a68f20a0af6 (127.14.181.1). New cstate: current_term: 1 leader_uuid: "140de158c6b94f5292a74a68f20a0af6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28f4f50a8a384090bcf005c874547105" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3458bf9aadff4c958794c47921c10c6e" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 33109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "140de158c6b94f5292a74a68f20a0af6" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 35607 } health_report { overall_health: HEALTHY } } }
I20260809 20:16:04.499959 14837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:04.495460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56448 (local address 127.14.181.1:35607)
0809 20:16:04.495609 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:04.495614 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:04.495629 (+ 15us) server_negotiation.cc:407] Connection header received
0809 20:16:04.495753 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:04.495756 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:04.495838 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:04.495948 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:16:04.496238 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.496903 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.498151 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.498565 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.498651 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:04.499080 (+ 429us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:16:04.499551 (+ 471us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:16:04.499667 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:04.499724 (+ 57us) server_negotiation.cc:299] Negotiation successful
0809 20:16:04.499786 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 20:16:04.506964 14727 raft_consensus.cc:1261] T e76912b5b7924722961228396797bb31 P 3458bf9aadff4c958794c47921c10c6e [term 1 FOLLOWER]: Refusing update from remote peer 140de158c6b94f5292a74a68f20a0af6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:16:04.506999 14499 raft_consensus.cc:1261] T e76912b5b7924722961228396797bb31 P 28f4f50a8a384090bcf005c874547105 [term 1 FOLLOWER]: Refusing update from remote peer 140de158c6b94f5292a74a68f20a0af6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:16:04.507795 14855 consensus_queue.cc:1035] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28f4f50a8a384090bcf005c874547105" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 35519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:16:04.508080 14852 consensus_queue.cc:1035] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3458bf9aadff4c958794c47921c10c6e" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 33109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:16:04.528924 14040 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49762:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:16:04.529160 14040 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49762:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:16:04.532362 14040 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6c5d742bd7b14515b8ff95ff0c01820c: Sending DeleteTablet for 3 replicas of tablet e76912b5b7924722961228396797bb31
I20260809 20:16:04.533341 14467 tablet_service.cc:1514] Processing DeleteTablet for tablet e76912b5b7924722961228396797bb31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:16:04 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:59504
I20260809 20:16:04.533483 14689 tablet_service.cc:1514] Processing DeleteTablet for tablet e76912b5b7924722961228396797bb31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:16:04 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:48700
I20260809 20:16:04.534267 14248 tablet_service.cc:1514] Processing DeleteTablet for tablet e76912b5b7924722961228396797bb31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:16:04 UTC) from {username='kudu', principal='kudu/127.14.181.62@KRBTEST.COM'} at 127.0.0.1:56444
I20260809 20:16:04.534811 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 14150
I20260809 20:16:04.543022 14876 tablet_replica.cc:330] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6: stopping tablet replica
I20260809 20:16:04.543442 14876 raft_consensus.cc:2229] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6 [term 1 LEADER]: Raft consensus shutting down.
I20260809 20:16:04.544116 14876 raft_consensus.cc:2258] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:16:04.546211 14876 ts_tablet_manager.cc:1905] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:16:04.551313 14873 tablet_replica.cc:330] T e76912b5b7924722961228396797bb31 P 28f4f50a8a384090bcf005c874547105: stopping tablet replica
I20260809 20:16:04.551690 14873 raft_consensus.cc:2229] T e76912b5b7924722961228396797bb31 P 28f4f50a8a384090bcf005c874547105 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:16:04.552168 14873 raft_consensus.cc:2258] T e76912b5b7924722961228396797bb31 P 28f4f50a8a384090bcf005c874547105 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:16:04.553328 14876 ts_tablet_manager.cc:1918] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:16:04.553493 14876 log.cc:1196] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-0/wal/wals/e76912b5b7924722961228396797bb31
I20260809 20:16:04.554047 14876 ts_tablet_manager.cc:1939] T e76912b5b7924722961228396797bb31 P 140de158c6b94f5292a74a68f20a0af6: Deleting consensus metadata
I20260809 20:16:04.554224 14873 ts_tablet_manager.cc:1905] T e76912b5b7924722961228396797bb31 P 28f4f50a8a384090bcf005c874547105: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:16:04.558701 14874 tablet_replica.cc:330] T e76912b5b7924722961228396797bb31 P 3458bf9aadff4c958794c47921c10c6e: stopping tablet replica
I20260809 20:16:04.559059 14874 raft_consensus.cc:2229] T e76912b5b7924722961228396797bb31 P 3458bf9aadff4c958794c47921c10c6e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:16:04.559864 14874 raft_consensus.cc:2258] T e76912b5b7924722961228396797bb31 P 3458bf9aadff4c958794c47921c10c6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:16:04.560662 14015 catalog_manager.cc:4841] TS 140de158c6b94f5292a74a68f20a0af6 (127.14.181.1:35607): tablet e76912b5b7924722961228396797bb31 (table test-table [id=cf18363c7c0746aba66e51b248463f78]) successfully deleted
I20260809 20:16:04.562464 14874 ts_tablet_manager.cc:1905] T e76912b5b7924722961228396797bb31 P 3458bf9aadff4c958794c47921c10c6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:16:04.563072 14873 ts_tablet_manager.cc:1918] T e76912b5b7924722961228396797bb31 P 28f4f50a8a384090bcf005c874547105: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:16:04.563215 14873 log.cc:1196] T e76912b5b7924722961228396797bb31 P 28f4f50a8a384090bcf005c874547105: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-1/wal/wals/e76912b5b7924722961228396797bb31
Aug 09 20:16:04 dist-test-slave-6zbq krb5kdc[13963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306562, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.1@KRBTEST.COM
I20260809 20:16:04.563720 14873 ts_tablet_manager.cc:1939] T e76912b5b7924722961228396797bb31 P 28f4f50a8a384090bcf005c874547105: Deleting consensus metadata
I20260809 20:16:04.565534 14015 catalog_manager.cc:4841] TS 28f4f50a8a384090bcf005c874547105 (127.14.181.2:35519): tablet e76912b5b7924722961228396797bb31 (table test-table [id=cf18363c7c0746aba66e51b248463f78]) successfully deleted
I20260809 20:16:04.569389 14874 ts_tablet_manager.cc:1918] T e76912b5b7924722961228396797bb31 P 3458bf9aadff4c958794c47921c10c6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:16:04.569538 14874 log.cc:1196] T e76912b5b7924722961228396797bb31 P 3458bf9aadff4c958794c47921c10c6e: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786306256699363-15060-0/minicluster-data/ts-2/wal/wals/e76912b5b7924722961228396797bb31
I20260809 20:16:04.570041 14874 ts_tablet_manager.cc:1939] T e76912b5b7924722961228396797bb31 P 3458bf9aadff4c958794c47921c10c6e: Deleting consensus metadata
I20260809 20:16:04.570375 14837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:04.536148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56458 (local address 127.14.181.1:35607)
0809 20:16:04.536313 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:04.536320 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:04.542759 (+ 6439us) server_negotiation.cc:407] Connection header received
0809 20:16:04.543019 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:04.543024 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:04.543096 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:04.543174 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:04.554659 (+ 11485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.555851 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.557781 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.558462 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.558559 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:04.564525 (+ 5966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:04.564539 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:04.564554 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:04.564600 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:04.567667 (+ 3067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:04.568288 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:04.568294 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:04.568296 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:04.568431 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:04.568796 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:04.568799 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:04.568801 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:04.569132 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:04.569411 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:04.569748 (+ 337us) server_negotiation.cc:299] Negotiation successful
0809 20:16:04.569974 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 20:16:04.570966 14341 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:16:04.571550 14010 catalog_manager.cc:4841] TS 3458bf9aadff4c958794c47921c10c6e (127.14.181.3:33109): tablet e76912b5b7924722961228396797bb31 (table test-table [id=cf18363c7c0746aba66e51b248463f78]) successfully deleted
I20260809 20:16:04.667111 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 14150
I20260809 20:16:04.688380 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 14360
Aug 09 20:16:04 dist-test-slave-6zbq krb5kdc[13963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306562, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.2@KRBTEST.COM
I20260809 20:16:04.702312 14831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:04.689068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59510 (local address 127.14.181.2:35519)
0809 20:16:04.689258 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:04.689263 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:04.689281 (+ 18us) server_negotiation.cc:407] Connection header received
0809 20:16:04.689441 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:04.689445 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:04.689508 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:04.689596 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:04.690835 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.691549 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.692686 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.693042 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.693125 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:04.697202 (+ 4077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:04.697216 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:04.697232 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:04.697263 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:04.699881 (+ 2618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:04.700571 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:04.700577 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:04.700580 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:04.700700 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:04.701011 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:04.701015 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:04.701019 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:04.701397 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:04.701616 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:04.701833 (+ 217us) server_negotiation.cc:299] Negotiation successful
0809 20:16:04.701986 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 20:16:04.702926 14571 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:16:04.787487 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 14360
I20260809 20:16:04.812219 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 14596
Aug 09 20:16:04 dist-test-slave-6zbq krb5kdc[13963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306562, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.3@KRBTEST.COM
I20260809 20:16:04.826483 14833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:04.812896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48702 (local address 127.14.181.3:33109)
0809 20:16:04.813067 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:04.813072 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:04.813092 (+ 20us) server_negotiation.cc:407] Connection header received
0809 20:16:04.813258 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:04.813263 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:04.813329 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:04.813411 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:04.814713 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.815458 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.816804 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:04.817186 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:04.817296 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:04.821360 (+ 4064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:04.821376 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:04.821392 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:04.821429 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:04.823819 (+ 2390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:04.824430 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:04.824438 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:04.824440 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:04.824586 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:04.824927 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:04.824931 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:04.824933 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:04.825267 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:04.825546 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:04.825840 (+ 294us) server_negotiation.cc:299] Negotiation successful
0809 20:16:04.826050 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 20:16:04.827061 14795 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:16:04.912883 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 14596
I20260809 20:16:04.932883 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 13982
I20260809 20:16:04.933897 14096 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:16:05.038223 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 13982
2026-08-09T20:16:05Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4137 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-09T20:16:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:16:05Z Disabled control of system clock
I20260809 20:16:05.117404 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:45721
--webserver_interface=127.14.181.62
--webserver_port=0
--builtin_ntp_servers=127.14.181.20:38837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:45721
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 20:16:05.429487 14887 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:05.429740 14887 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:05.429822 14887 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:05.436830 14887 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:16:05.436918 14887 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:05.436962 14887 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:05.437018 14887 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:16:05.437060 14887 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:16:05.445744 14887 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:38837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:45721
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:45721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:05.446993 14887 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:05.448666 14887 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:05.459820 14898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:05.459908 14902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:05.459940 14895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:05.460521 14887 server_base.cc:1034] running on GCE node
I20260809 20:16:05.461217 14887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:05.462498 14887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:05.463692 14887 hybrid_clock.cc:648] HybridClock initialized: now 1786306565463644 us; error 43 us; skew 500 ppm
I20260809 20:16:05.464049 14887 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 20:16:05.466176 14887 webserver.cc:460] Webserver started at http://127.14.181.62:39469/ using document root <none> and password file <none>
I20260809 20:16:05.466845 14887 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:05.466943 14887 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:05.467235 14887 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:05.469898 14887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "c745fffcd43e4f5482dea2b36c3f894d"
format_stamp: "Formatted at 2026-08-09 20:16:05 on dist-test-slave-6zbq"
server_key: "41d10b02c5e4b86508c7ea8c75ca6251"
server_key_iv: "59316ee5ed9a99c64315b197b8e23b26"
server_key_version: "encryptionkey@0"
I20260809 20:16:05.470695 14887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "c745fffcd43e4f5482dea2b36c3f894d"
format_stamp: "Formatted at 2026-08-09 20:16:05 on dist-test-slave-6zbq"
server_key: "41d10b02c5e4b86508c7ea8c75ca6251"
server_key_iv: "59316ee5ed9a99c64315b197b8e23b26"
server_key_version: "encryptionkey@0"
I20260809 20:16:05.475396 14887 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260809 20:16:05.478554 14911 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:05.479717 14887 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 20:16:05.479867 14887 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "c745fffcd43e4f5482dea2b36c3f894d"
format_stamp: "Formatted at 2026-08-09 20:16:05 on dist-test-slave-6zbq"
server_key: "41d10b02c5e4b86508c7ea8c75ca6251"
server_key_iv: "59316ee5ed9a99c64315b197b8e23b26"
server_key_version: "encryptionkey@0"
I20260809 20:16:05.480049 14887 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:05.493084 14887 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:05.493801 14887 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:05.494050 14887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:05.510988 14887 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:45721
I20260809 20:16:05.511008 15001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:45721 every 8 connection(s)
I20260809 20:16:05.512233 14887 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:16:05.515652 15002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:05.517131 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 14887
I20260809 20:16:05.517304 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:16:05.517731 15060 external_mini_cluster.cc:1428] Setting key 6bfb2128efce924f22edc0a65fe0487b
I20260809 20:16:05.529167 15002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c745fffcd43e4f5482dea2b36c3f894d: Bootstrap starting.
I20260809 20:16:05.531719 15005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:05.519507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36722 (local address 127.14.181.62:45721)
0809 20:16:05.520578 (+ 1071us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:05.520593 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:05.520640 (+ 47us) server_negotiation.cc:407] Connection header received
0809 20:16:05.522372 (+ 1732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:05.522403 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:05.522964 (+ 561us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:05.523351 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:05.523825 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:05.525662 (+ 1837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:05.526961 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:05.527947 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:05.528123 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:05.529104 (+ 981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:05.529114 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:05.529131 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:05.529794 (+ 663us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:05.529893 (+ 99us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:05.529919 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:05.530028 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:05.530190 (+ 162us) server_negotiation.cc:299] Negotiation successful
0809 20:16:05.530511 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":594,"thread_start_us":352,"threads_started":1}
I20260809 20:16:05.532761 15002 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c745fffcd43e4f5482dea2b36c3f894d: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:05.533721 15002 log.cc:824] T 00000000000000000000000000000000 P c745fffcd43e4f5482dea2b36c3f894d: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:05.536149 15002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c745fffcd43e4f5482dea2b36c3f894d: No bootstrap required, opened a new log
I20260809 20:16:05.542892 15002 raft_consensus.cc:348] T 00000000000000000000000000000000 P c745fffcd43e4f5482dea2b36c3f894d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c745fffcd43e4f5482dea2b36c3f894d" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 45721 } }
I20260809 20:16:05.543229 15002 raft_consensus.cc:374] T 00000000000000000000000000000000 P c745fffcd43e4f5482dea2b36c3f894d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:05.543334 15002 raft_consensus.cc:729] T 00000000000000000000000000000000 P c745fffcd43e4f5482dea2b36c3f894d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c745fffcd43e4f5482dea2b36c3f894d, State: Initialized, Role: FOLLOWER
I20260809 20:16:05.543828 15002 consensus_queue.cc:260] T 00000000000000000000000000000000 P c745fffcd43e4f5482dea2b36c3f894d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c745fffcd43e4f5482dea2b36c3f894d" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 45721 } }
I20260809 20:16:05.544041 15002 raft_consensus.cc:388] T 00000000000000000000000000000000 P c745fffcd43e4f5482dea2b36c3f894d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:16:05.544159 15002 raft_consensus.cc:482] T 00000000000000000000000000000000 P c745fffcd43e4f5482dea2b36c3f894d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:16:05.544301 15002 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c745fffcd43e4f5482dea2b36c3f894d [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:05.546285 15002 raft_consensus.cc:504] T 00000000000000000000000000000000 P c745fffcd43e4f5482dea2b36c3f894d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c745fffcd43e4f5482dea2b36c3f894d" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 45721 } }
I20260809 20:16:05.546768 15002 leader_election.cc:302] T 00000000000000000000000000000000 P c745fffcd43e4f5482dea2b36c3f894d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c745fffcd43e4f5482dea2b36c3f894d; no voters:
I20260809 20:16:05.547313 15002 leader_election.cc:288] T 00000000000000000000000000000000 P c745fffcd43e4f5482dea2b36c3f894d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:16:05.547438 15009 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c745fffcd43e4f5482dea2b36c3f894d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:16:05.548445 15009 raft_consensus.cc:686] T 00000000000000000000000000000000 P c745fffcd43e4f5482dea2b36c3f894d [term 1 LEADER]: Becoming Leader. State: Replica: c745fffcd43e4f5482dea2b36c3f894d, State: Running, Role: LEADER
I20260809 20:16:05.548893 15009 consensus_queue.cc:237] T 00000000000000000000000000000000 P c745fffcd43e4f5482dea2b36c3f894d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c745fffcd43e4f5482dea2b36c3f894d" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 45721 } }
I20260809 20:16:05.549401 15002 sys_catalog.cc:564] T 00000000000000000000000000000000 P c745fffcd43e4f5482dea2b36c3f894d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:16:05.551432 15013 sys_catalog.cc:455] T 00000000000000000000000000000000 P c745fffcd43e4f5482dea2b36c3f894d [sys.catalog]: SysCatalogTable state changed. Reason: New leader c745fffcd43e4f5482dea2b36c3f894d. Latest consensus state: current_term: 1 leader_uuid: "c745fffcd43e4f5482dea2b36c3f894d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c745fffcd43e4f5482dea2b36c3f894d" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 45721 } } }
I20260809 20:16:05.551821 15013 sys_catalog.cc:458] T 00000000000000000000000000000000 P c745fffcd43e4f5482dea2b36c3f894d [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:05.552533 15012 sys_catalog.cc:455] T 00000000000000000000000000000000 P c745fffcd43e4f5482dea2b36c3f894d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c745fffcd43e4f5482dea2b36c3f894d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c745fffcd43e4f5482dea2b36c3f894d" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 45721 } } }
I20260809 20:16:05.552815 15012 sys_catalog.cc:458] T 00000000000000000000000000000000 P c745fffcd43e4f5482dea2b36c3f894d [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:05.554492 15022 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:16:05.559396 15022 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:16:05.567987 15022 catalog_manager.cc:1347] Generated new cluster ID: 0424981a728a4d2ea5441a0dbb8b703e
I20260809 20:16:05.568075 15022 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:16:05.600602 15022 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:16:05.602283 15022 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:16:05.617624 15022 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c745fffcd43e4f5482dea2b36c3f894d: Generated new TSK 0
I20260809 20:16:05.618546 15022 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:16:05.627096 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.1:0
--local_ip_for_outbound_sockets=127.14.181.1
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:45721
--builtin_ntp_servers=127.14.181.20:38837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 20:16:05.945413 15042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:05.945662 15042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:05.945833 15042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:05.952867 15042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:05.952961 15042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:05.953096 15042 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.1
I20260809 20:16:05.962114 15042 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:38837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.181.1
--webserver_port=0
--tserver_master_addrs=127.14.181.62:45721
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.1
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:05.963263 15042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:05.964924 15042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:05.976863 15055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:05.976908 15049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:05.976939 15052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:05.977646 15042 server_base.cc:1034] running on GCE node
I20260809 20:16:05.978250 15042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:05.979081 15042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:05.980278 15042 hybrid_clock.cc:648] HybridClock initialized: now 1786306565980242 us; error 30 us; skew 500 ppm
I20260809 20:16:05.980556 15042 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 20:16:05.982616 15042 webserver.cc:460] Webserver started at http://127.14.181.1:46789/ using document root <none> and password file <none>
I20260809 20:16:05.983294 15042 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:05.983388 15042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:05.983664 15042 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:05.986280 15042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-0/data/instance:
uuid: "364d7f472a37446b9573631484560aa4"
format_stamp: "Formatted at 2026-08-09 20:16:05 on dist-test-slave-6zbq"
server_key: "0bae0381a9bc08a40c99b80d330bba72"
server_key_iv: "373ff3c04c3958fcafcebfaa17bb10b0"
server_key_version: "encryptionkey@0"
I20260809 20:16:05.987046 15042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance:
uuid: "364d7f472a37446b9573631484560aa4"
format_stamp: "Formatted at 2026-08-09 20:16:05 on dist-test-slave-6zbq"
server_key: "0bae0381a9bc08a40c99b80d330bba72"
server_key_iv: "373ff3c04c3958fcafcebfaa17bb10b0"
server_key_version: "encryptionkey@0"
I20260809 20:16:05.991639 15042 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260809 20:16:05.994899 15078 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:05.996068 15042 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260809 20:16:05.996224 15042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-0/wal
uuid: "364d7f472a37446b9573631484560aa4"
format_stamp: "Formatted at 2026-08-09 20:16:05 on dist-test-slave-6zbq"
server_key: "0bae0381a9bc08a40c99b80d330bba72"
server_key_iv: "373ff3c04c3958fcafcebfaa17bb10b0"
server_key_version: "encryptionkey@0"
I20260809 20:16:05.996414 15042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:06.021685 15042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:06.022444 15042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:06.022710 15042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:06.023567 15042 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:16:06.024860 15042 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:16:06.024951 15042 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:06.025051 15042 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:16:06.025122 15042 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:06.054358 15042 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.1:45127
I20260809 20:16:06.054454 15260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.1:45127 every 8 connection(s)
I20260809 20:16:06.055549 15042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-0/data/info.pb
I20260809 20:16:06.065690 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 15042
I20260809 20:16:06.065840 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-0/wal/instance
I20260809 20:16:06.066394 15060 external_mini_cluster.cc:1428] Setting key 218429ab8396228e26b3922719219058
I20260809 20:16:06.066825 15266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:06.057700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:34107 (local address 127.14.181.62:45721)
0809 20:16:06.058116 (+ 416us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:06.058122 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:06.059255 (+ 1133us) server_negotiation.cc:407] Connection header received
0809 20:16:06.060995 (+ 1740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:06.061000 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:06.061065 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:06.061166 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:06.062082 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:06.062813 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:06.064212 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:06.064604 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:06.064690 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:06.065985 (+ 1295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:06.065992 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:06.065996 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:06.066018 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:06.066066 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:06.066082 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:06.066174 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:06.066380 (+ 206us) server_negotiation.cc:299] Negotiation successful
0809 20:16:06.066478 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":184,"threads_started":1}
I20260809 20:16:06.067646 15267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:06.058254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:45721 (local address 127.14.181.1:34107)
0809 20:16:06.059125 (+ 871us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:06.059158 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:06.060780 (+ 1622us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:06.061332 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:06.061340 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:06.061423 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:16:06.061959 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:06.061976 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:06.062931 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:06.062934 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:06.064096 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:06.064108 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:06.064776 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:06.064781 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:06.064999 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:06.065633 (+ 634us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 20:16:06.065636 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:16:06.065670 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 20:16:06.065751 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:16:06.066176 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:16:06.066185 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:16:06.066191 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 20:16:06.066326 (+ 135us) client_negotiation.cc:240] Negotiation successful
0809 20:16:06.066643 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":254,"threads_started":1}
I20260809 20:16:06.069115 15261 heartbeater.cc:347] Connected to a master server at 127.14.181.62:45721
I20260809 20:16:06.069198 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.2:0
--local_ip_for_outbound_sockets=127.14.181.2
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:45721
--builtin_ntp_servers=127.14.181.20:38837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 20:16:06.069387 15261 heartbeater.cc:464] Registering TS with master...
I20260809 20:16:06.070011 15261 heartbeater.cc:511] Master 127.14.181.62:45721 requested a full tablet report, sending...
I20260809 20:16:06.072036 14941 ts_manager.cc:194] Registered new tserver with Master: 364d7f472a37446b9573631484560aa4 (127.14.181.1:45127)
I20260809 20:16:06.073838 14941 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.181.1:34107
W20260809 20:16:06.380302 15270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:06.380551 15270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:06.380674 15270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:06.387676 15270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:06.387769 15270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:06.387907 15270 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.2
I20260809 20:16:06.396456 15270 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:38837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.181.2
--webserver_port=0
--tserver_master_addrs=127.14.181.62:45721
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.2
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:06.397512 15270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:06.399196 15270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:06.411155 15279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:06.411190 15287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:06.411283 15280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:06.412154 15270 server_base.cc:1034] running on GCE node
I20260809 20:16:06.412649 15270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:06.413422 15270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:06.414611 15270 hybrid_clock.cc:648] HybridClock initialized: now 1786306566414560 us; error 39 us; skew 500 ppm
I20260809 20:16:06.414897 15270 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 20:16:06.417472 15270 webserver.cc:460] Webserver started at http://127.14.181.2:34797/ using document root <none> and password file <none>
I20260809 20:16:06.418143 15270 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:06.418268 15270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:06.418593 15270 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:06.421177 15270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-1/data/instance:
uuid: "ce456ae8db9a4c90be5ad4d3e61dd565"
format_stamp: "Formatted at 2026-08-09 20:16:06 on dist-test-slave-6zbq"
server_key: "ec503ce0bc0d3271ba1648fbfcc94f64"
server_key_iv: "b5e1216283ea15b717c594795a2f220a"
server_key_version: "encryptionkey@0"
I20260809 20:16:06.421924 15270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance:
uuid: "ce456ae8db9a4c90be5ad4d3e61dd565"
format_stamp: "Formatted at 2026-08-09 20:16:06 on dist-test-slave-6zbq"
server_key: "ec503ce0bc0d3271ba1648fbfcc94f64"
server_key_iv: "b5e1216283ea15b717c594795a2f220a"
server_key_version: "encryptionkey@0"
I20260809 20:16:06.426520 15270 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 20:16:06.429555 15299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:06.430768 15270 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:16:06.430907 15270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-1/wal
uuid: "ce456ae8db9a4c90be5ad4d3e61dd565"
format_stamp: "Formatted at 2026-08-09 20:16:06 on dist-test-slave-6zbq"
server_key: "ec503ce0bc0d3271ba1648fbfcc94f64"
server_key_iv: "b5e1216283ea15b717c594795a2f220a"
server_key_version: "encryptionkey@0"
I20260809 20:16:06.431087 15270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:06.443337 15270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:06.444000 15270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:06.444262 15270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:06.445106 15270 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:16:06.446435 15270 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:16:06.446529 15270 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:06.446631 15270 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:16:06.446698 15270 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:06.474669 15270 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.2:43463
I20260809 20:16:06.474731 15472 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.2:43463 every 8 connection(s)
I20260809 20:16:06.475895 15270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-1/data/info.pb
I20260809 20:16:06.485832 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 15270
I20260809 20:16:06.486011 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-1/wal/instance
I20260809 20:16:06.486572 15060 external_mini_cluster.cc:1428] Setting key c67a16ca9627185b903c62d1d6e3654e
I20260809 20:16:06.488513 15266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:06.479486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.2:57529 (local address 127.14.181.62:45721)
0809 20:16:06.479684 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:06.479690 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:06.480915 (+ 1225us) server_negotiation.cc:407] Connection header received
0809 20:16:06.482571 (+ 1656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:06.482575 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:06.482650 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:06.482741 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:06.483693 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:06.484439 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:06.485901 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:06.486491 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:06.486614 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:06.487795 (+ 1181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:06.487802 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:06.487806 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:06.487826 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:06.487864 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:06.487878 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:06.487965 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:06.488125 (+ 160us) server_negotiation.cc:299] Negotiation successful
0809 20:16:06.488225 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 20:16:06.489485 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.181.3:0
--local_ip_for_outbound_sockets=127.14.181.3
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:45721
--builtin_ntp_servers=127.14.181.20:38837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 20:16:06.489606 15479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:06.479942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:45721 (local address 127.14.181.2:57529)
0809 20:16:06.480779 (+ 837us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:06.480819 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:06.482311 (+ 1492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:06.482932 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:06.482942 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:06.483022 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:16:06.483570 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:06.483587 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:06.484565 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:06.484569 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:06.485767 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:06.485779 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:06.486692 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:06.486700 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:06.486909 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:06.487519 (+ 610us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 20:16:06.487522 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:16:06.487558 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 20:16:06.487625 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:16:06.487960 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:16:06.487966 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:16:06.487971 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 20:16:06.488107 (+ 136us) client_negotiation.cc:240] Negotiation successful
0809 20:16:06.488412 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":268,"threads_started":1}
I20260809 20:16:06.490850 15475 heartbeater.cc:347] Connected to a master server at 127.14.181.62:45721
I20260809 20:16:06.491128 15475 heartbeater.cc:464] Registering TS with master...
I20260809 20:16:06.491888 15475 heartbeater.cc:511] Master 127.14.181.62:45721 requested a full tablet report, sending...
I20260809 20:16:06.493228 14941 ts_manager.cc:194] Registered new tserver with Master: ce456ae8db9a4c90be5ad4d3e61dd565 (127.14.181.2:43463)
I20260809 20:16:06.494170 14941 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.181.2:57529
W20260809 20:16:06.809885 15480 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:06.810130 15480 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:06.810237 15480 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:06.817324 15480 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:06.817409 15480 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:06.817541 15480 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.181.3
I20260809 20:16:06.826076 15480 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:38837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.181.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.181.3
--webserver_port=0
--tserver_master_addrs=127.14.181.62:45721
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.181.3
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:06.827200 15480 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:06.828855 15480 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:06.840925 15488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:06.840842 15491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:06.840888 15493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:06.841869 15480 server_base.cc:1034] running on GCE node
I20260809 20:16:06.842473 15480 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:06.843317 15480 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:06.844513 15480 hybrid_clock.cc:648] HybridClock initialized: now 1786306566844464 us; error 42 us; skew 500 ppm
I20260809 20:16:06.844805 15480 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 20:16:06.846832 15480 webserver.cc:460] Webserver started at http://127.14.181.3:43129/ using document root <none> and password file <none>
I20260809 20:16:06.847437 15480 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:06.847535 15480 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:06.847832 15480 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:06.850574 15480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-2/data/instance:
uuid: "056dcf048d0f47bb8697327ee2e69fca"
format_stamp: "Formatted at 2026-08-09 20:16:06 on dist-test-slave-6zbq"
server_key: "50a80685887aea7ef2a60a11b85e4aa1"
server_key_iv: "8a37c3fda1b6017ad387caf5bd59c4b5"
server_key_version: "encryptionkey@0"
I20260809 20:16:06.851306 15480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance:
uuid: "056dcf048d0f47bb8697327ee2e69fca"
format_stamp: "Formatted at 2026-08-09 20:16:06 on dist-test-slave-6zbq"
server_key: "50a80685887aea7ef2a60a11b85e4aa1"
server_key_iv: "8a37c3fda1b6017ad387caf5bd59c4b5"
server_key_version: "encryptionkey@0"
I20260809 20:16:06.855908 15480 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 20:16:06.859133 15501 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:06.860280 15480 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 20:16:06.860414 15480 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-2/wal
uuid: "056dcf048d0f47bb8697327ee2e69fca"
format_stamp: "Formatted at 2026-08-09 20:16:06 on dist-test-slave-6zbq"
server_key: "50a80685887aea7ef2a60a11b85e4aa1"
server_key_iv: "8a37c3fda1b6017ad387caf5bd59c4b5"
server_key_version: "encryptionkey@0"
I20260809 20:16:06.860590 15480 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:06.890866 15480 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:06.891571 15480 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:06.891834 15480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:06.892688 15480 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 20:16:06.894004 15480 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 20:16:06.894098 15480 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:06.894209 15480 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 20:16:06.894280 15480 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:06.923337 15480 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.3:35479
I20260809 20:16:06.923400 15672 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.3:35479 every 8 connection(s)
I20260809 20:16:06.924518 15480 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-2/data/info.pb
I20260809 20:16:06.926606 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 15480
I20260809 20:16:06.926791 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-2/wal/instance
I20260809 20:16:06.927244 15060 external_mini_cluster.cc:1428] Setting key 7a822cafa250c054d88c203b9274608b
I20260809 20:16:06.935902 15266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:06.926902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.3:59207 (local address 127.14.181.62:45721)
0809 20:16:06.927117 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:06.927123 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:06.928512 (+ 1389us) server_negotiation.cc:407] Connection header received
0809 20:16:06.930367 (+ 1855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:06.930374 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:06.930445 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:06.930523 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:06.931430 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:06.932149 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:06.933538 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:06.933997 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:06.934084 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:06.935301 (+ 1217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:06.935306 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:06.935309 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:06.935325 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:06.935355 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:06.935366 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:06.935436 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:06.935592 (+ 156us) server_negotiation.cc:299] Negotiation successful
0809 20:16:06.935666 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 20:16:06.936733 15676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:06.927437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:45721 (local address 127.14.181.3:59207)
0809 20:16:06.928370 (+ 933us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:06.928424 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:06.930113 (+ 1689us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:06.930709 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:06.930717 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:06.930795 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:16:06.931309 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:06.931325 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:06.932259 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:06.932263 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:06.933436 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:06.933448 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:06.934160 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:06.934165 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:06.934384 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:06.935046 (+ 662us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 20:16:06.935048 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:16:06.935085 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 20:16:06.935151 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:16:06.935444 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:16:06.935450 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:16:06.935456 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 20:16:06.935577 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 20:16:06.935834 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":279,"threads_started":1}
I20260809 20:16:06.937867 15673 heartbeater.cc:347] Connected to a master server at 127.14.181.62:45721
I20260809 20:16:06.938089 15673 heartbeater.cc:464] Registering TS with master...
I20260809 20:16:06.938762 15673 heartbeater.cc:511] Master 127.14.181.62:45721 requested a full tablet report, sending...
I20260809 20:16:06.939987 14941 ts_manager.cc:194] Registered new tserver with Master: 056dcf048d0f47bb8697327ee2e69fca (127.14.181.3:35479)
I20260809 20:16:06.940912 14941 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.14.181.3:59207
I20260809 20:16:06.942148 15060 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 20:16:06.951138 15266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:06.945904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33900 (local address 127.14.181.62:45721)
0809 20:16:06.946045 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:06.946049 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:06.946517 (+ 468us) server_negotiation.cc:407] Connection header received
0809 20:16:06.946660 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:06.946663 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:06.946731 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:06.946812 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:06.947226 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:06.947863 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:06.949132 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:06.949556 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:06.949642 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:06.950562 (+ 920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:06.950569 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:06.950573 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:06.950594 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:06.950629 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:06.950645 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:06.950712 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:06.950871 (+ 159us) server_negotiation.cc:299] Negotiation successful
0809 20:16:06.950935 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 20:16:06.954324 14941 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33900:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 20:16:06.961253 14941 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 20:16:06.992380 15694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:06.972058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:35479 (local address 127.0.0.1:48648)
0809 20:16:06.983020 (+ 10962us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:06.983071 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:06.983234 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:06.985306 (+ 2072us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:06.985315 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:06.985349 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:16:06.985831 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:06.985854 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:06.987671 (+ 1817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:06.987676 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:06.989750 (+ 2074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:06.989764 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:06.991483 (+ 1719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:06.991489 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:06.991684 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:06.991737 (+ 53us) client_negotiation.cc:769] Sending connection context
0809 20:16:06.991855 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 20:16:06.992050 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10733,"thread_start_us":11246,"threads_started":1}
I20260809 20:16:06.992774 15690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:06.972321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:43463 (local address 127.0.0.1:57572)
0809 20:16:06.983572 (+ 11251us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:06.983595 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:06.983745 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:06.985774 (+ 2029us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:06.985780 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:06.985821 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:16:06.986265 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:06.986276 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:06.988304 (+ 2028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:06.988310 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:06.990503 (+ 2193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:06.990515 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:06.992000 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:06.992007 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:06.992177 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:06.992208 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 20:16:06.992271 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 20:16:06.992407 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11107,"mutex_wait_us":64,"thread_start_us":13409,"threads_started":1}
I20260809 20:16:06.993400 15691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:06.972217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48648 (local address 127.14.181.3:35479)
0809 20:16:06.984400 (+ 12183us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:06.984409 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:06.984447 (+ 38us) server_negotiation.cc:407] Connection header received
0809 20:16:06.984549 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:06.984557 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:06.984808 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:06.984995 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:16:06.986101 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:06.987560 (+ 1459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:06.989950 (+ 2390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:06.991312 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:06.991426 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:06.991706 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:06.991919 (+ 213us) server_negotiation.cc:299] Negotiation successful
0809 20:16:06.992076 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11925,"thread_start_us":11765,"threads_started":1}
I20260809 20:16:06.993755 15692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:06.972662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.1:45127 (local address 127.0.0.1:57150)
0809 20:16:06.986010 (+ 13348us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:06.986032 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:06.986180 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:06.986838 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:06.986843 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:06.986868 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:16:06.987191 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:06.987202 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:06.988783 (+ 1581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:06.988789 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:06.991002 (+ 2213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:06.991017 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:06.993042 (+ 2025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:06.993048 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:06.993218 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:06.993248 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 20:16:06.993336 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 20:16:06.993454 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13219,"mutex_wait_us":26,"thread_start_us":9995,"threads_started":1}
I20260809 20:16:06.993870 15695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:06.972803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57150 (local address 127.14.181.1:45127)
0809 20:16:06.985653 (+ 12850us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:06.985661 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:06.986317 (+ 656us) server_negotiation.cc:407] Connection header received
0809 20:16:06.986438 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:06.986446 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:06.986654 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:06.986844 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:16:06.987387 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:06.988623 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:06.991201 (+ 2578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:06.992564 (+ 1363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:06.992685 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:06.992925 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:06.993392 (+ 467us) server_negotiation.cc:299] Negotiation successful
0809 20:16:06.993563 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12694,"thread_start_us":12577,"threads_started":1}
I20260809 20:16:06.994120 15698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:06.973282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57572 (local address 127.14.181.2:43463)
0809 20:16:06.984734 (+ 11452us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:06.984744 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:06.984776 (+ 32us) server_negotiation.cc:407] Connection header received
0809 20:16:06.984884 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:06.984892 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:06.985110 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:06.986494 (+ 1384us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:16:06.986761 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:06.988152 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:06.990664 (+ 2512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:06.991788 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:06.993252 (+ 1464us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:06.993584 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:06.993658 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 20:16:06.993813 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11303,"thread_start_us":11167,"threads_started":1}
I20260809 20:16:06.997121 15152 tablet_service.cc:1467] Processing CreateTablet for tablet 0f8e3a1dbbbf40f8a7141a9353841d00 (DEFAULT_TABLE table=test-table [id=1eebbc9696ed41949aba8c9123a51fe4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:16:06.997174 15571 tablet_service.cc:1467] Processing CreateTablet for tablet 0f8e3a1dbbbf40f8a7141a9353841d00 (DEFAULT_TABLE table=test-table [id=1eebbc9696ed41949aba8c9123a51fe4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:16:06.997174 15375 tablet_service.cc:1467] Processing CreateTablet for tablet 0f8e3a1dbbbf40f8a7141a9353841d00 (DEFAULT_TABLE table=test-table [id=1eebbc9696ed41949aba8c9123a51fe4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 20:16:06.998268 15152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f8e3a1dbbbf40f8a7141a9353841d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:06.998476 15375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f8e3a1dbbbf40f8a7141a9353841d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:06.998476 15571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f8e3a1dbbbf40f8a7141a9353841d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:07.009259 15699 tablet_bootstrap.cc:492] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4: Bootstrap starting.
I20260809 20:16:07.012260 15700 tablet_bootstrap.cc:492] T 0f8e3a1dbbbf40f8a7141a9353841d00 P ce456ae8db9a4c90be5ad4d3e61dd565: Bootstrap starting.
I20260809 20:16:07.012522 15699 tablet_bootstrap.cc:654] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:07.014561 15699 log.cc:824] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:07.015669 15700 tablet_bootstrap.cc:654] T 0f8e3a1dbbbf40f8a7141a9353841d00 P ce456ae8db9a4c90be5ad4d3e61dd565: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:07.016682 15701 tablet_bootstrap.cc:492] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 056dcf048d0f47bb8697327ee2e69fca: Bootstrap starting.
I20260809 20:16:07.016921 15700 log.cc:824] T 0f8e3a1dbbbf40f8a7141a9353841d00 P ce456ae8db9a4c90be5ad4d3e61dd565: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:07.017704 15699 tablet_bootstrap.cc:492] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4: No bootstrap required, opened a new log
I20260809 20:16:07.017933 15699 ts_tablet_manager.cc:1397] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260809 20:16:07.019430 15701 tablet_bootstrap.cc:654] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 056dcf048d0f47bb8697327ee2e69fca: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:07.019767 15700 tablet_bootstrap.cc:492] T 0f8e3a1dbbbf40f8a7141a9353841d00 P ce456ae8db9a4c90be5ad4d3e61dd565: No bootstrap required, opened a new log
I20260809 20:16:07.020082 15700 ts_tablet_manager.cc:1397] T 0f8e3a1dbbbf40f8a7141a9353841d00 P ce456ae8db9a4c90be5ad4d3e61dd565: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260809 20:16:07.020457 15701 log.cc:824] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 056dcf048d0f47bb8697327ee2e69fca: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:07.022764 15701 tablet_bootstrap.cc:492] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 056dcf048d0f47bb8697327ee2e69fca: No bootstrap required, opened a new log
I20260809 20:16:07.022977 15701 ts_tablet_manager.cc:1397] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 056dcf048d0f47bb8697327ee2e69fca: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.001s
I20260809 20:16:07.028250 15699 raft_consensus.cc:348] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "056dcf048d0f47bb8697327ee2e69fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35479 } } peers { permanent_uuid: "ce456ae8db9a4c90be5ad4d3e61dd565" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 43463 } } peers { permanent_uuid: "364d7f472a37446b9573631484560aa4" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45127 } }
I20260809 20:16:07.028755 15699 raft_consensus.cc:374] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:07.029194 15699 raft_consensus.cc:729] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 364d7f472a37446b9573631484560aa4, State: Initialized, Role: FOLLOWER
I20260809 20:16:07.029600 15701 raft_consensus.cc:348] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 056dcf048d0f47bb8697327ee2e69fca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "056dcf048d0f47bb8697327ee2e69fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35479 } } peers { permanent_uuid: "ce456ae8db9a4c90be5ad4d3e61dd565" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 43463 } } peers { permanent_uuid: "364d7f472a37446b9573631484560aa4" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45127 } }
I20260809 20:16:07.029925 15701 raft_consensus.cc:374] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 056dcf048d0f47bb8697327ee2e69fca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:07.030019 15701 raft_consensus.cc:729] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 056dcf048d0f47bb8697327ee2e69fca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 056dcf048d0f47bb8697327ee2e69fca, State: Initialized, Role: FOLLOWER
I20260809 20:16:07.029868 15699 consensus_queue.cc:260] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "056dcf048d0f47bb8697327ee2e69fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35479 } } peers { permanent_uuid: "ce456ae8db9a4c90be5ad4d3e61dd565" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 43463 } } peers { permanent_uuid: "364d7f472a37446b9573631484560aa4" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45127 } }
I20260809 20:16:07.029783 15700 raft_consensus.cc:348] T 0f8e3a1dbbbf40f8a7141a9353841d00 P ce456ae8db9a4c90be5ad4d3e61dd565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "056dcf048d0f47bb8697327ee2e69fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35479 } } peers { permanent_uuid: "ce456ae8db9a4c90be5ad4d3e61dd565" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 43463 } } peers { permanent_uuid: "364d7f472a37446b9573631484560aa4" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45127 } }
I20260809 20:16:07.030172 15700 raft_consensus.cc:374] T 0f8e3a1dbbbf40f8a7141a9353841d00 P ce456ae8db9a4c90be5ad4d3e61dd565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:07.030330 15700 raft_consensus.cc:729] T 0f8e3a1dbbbf40f8a7141a9353841d00 P ce456ae8db9a4c90be5ad4d3e61dd565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce456ae8db9a4c90be5ad4d3e61dd565, State: Initialized, Role: FOLLOWER
I20260809 20:16:07.030571 15701 consensus_queue.cc:260] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 056dcf048d0f47bb8697327ee2e69fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "056dcf048d0f47bb8697327ee2e69fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35479 } } peers { permanent_uuid: "ce456ae8db9a4c90be5ad4d3e61dd565" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 43463 } } peers { permanent_uuid: "364d7f472a37446b9573631484560aa4" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45127 } }
I20260809 20:16:07.030963 15261 heartbeater.cc:503] Master 127.14.181.62:45721 was elected leader, sending a full tablet report...
I20260809 20:16:07.031018 15700 consensus_queue.cc:260] T 0f8e3a1dbbbf40f8a7141a9353841d00 P ce456ae8db9a4c90be5ad4d3e61dd565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "056dcf048d0f47bb8697327ee2e69fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35479 } } peers { permanent_uuid: "ce456ae8db9a4c90be5ad4d3e61dd565" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 43463 } } peers { permanent_uuid: "364d7f472a37446b9573631484560aa4" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45127 } }
I20260809 20:16:07.031561 15673 heartbeater.cc:503] Master 127.14.181.62:45721 was elected leader, sending a full tablet report...
I20260809 20:16:07.032128 15475 heartbeater.cc:503] Master 127.14.181.62:45721 was elected leader, sending a full tablet report...
I20260809 20:16:07.032809 15700 ts_tablet_manager.cc:1428] T 0f8e3a1dbbbf40f8a7141a9353841d00 P ce456ae8db9a4c90be5ad4d3e61dd565: Time spent starting tablet: real 0.013s user 0.007s sys 0.004s
I20260809 20:16:07.033726 15701 ts_tablet_manager.cc:1428] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 056dcf048d0f47bb8697327ee2e69fca: Time spent starting tablet: real 0.011s user 0.000s sys 0.009s
I20260809 20:16:07.034771 15699 ts_tablet_manager.cc:1428] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4: Time spent starting tablet: real 0.017s user 0.010s sys 0.004s
I20260809 20:16:07.049621 15708 raft_consensus.cc:482] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 20:16:07.049832 15708 raft_consensus.cc:504] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "056dcf048d0f47bb8697327ee2e69fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35479 } } peers { permanent_uuid: "ce456ae8db9a4c90be5ad4d3e61dd565" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 43463 } } peers { permanent_uuid: "364d7f472a37446b9573631484560aa4" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45127 } }
I20260809 20:16:07.051247 15708 leader_election.cc:288] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 056dcf048d0f47bb8697327ee2e69fca (127.14.181.3:35479), ce456ae8db9a4c90be5ad4d3e61dd565 (127.14.181.2:43463)
W20260809 20:16:07.057557 15265 tablet.cc:2369] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:16:07.059355 15691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:07.051882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:46351 (local address 127.14.181.3:35479)
0809 20:16:07.052223 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:07.052229 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:07.052850 (+ 621us) server_negotiation.cc:407] Connection header received
0809 20:16:07.053017 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:07.053021 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:07.053072 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:07.053150 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:16:07.053872 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:07.054674 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:07.057312 (+ 2638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:07.058480 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:07.058640 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:07.058707 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:07.059014 (+ 307us) server_negotiation.cc:299] Negotiation successful
0809 20:16:07.059134 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223}
I20260809 20:16:07.059432 15711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:07.051397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.3:35479 (local address 127.14.181.1:46351)
0809 20:16:07.052756 (+ 1359us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:07.052770 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:07.052900 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:07.053178 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:07.053183 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:07.053205 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:16:07.053659 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:07.053676 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:07.054782 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:07.054788 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:07.057094 (+ 2306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:07.057116 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:07.058670 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:07.058677 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:07.058862 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:07.058886 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 20:16:07.058968 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 20:16:07.059091 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1234,"mutex_wait_us":98,"thread_start_us":1025,"threads_started":1}
I20260809 20:16:07.059885 15698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:07.051608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.14.181.1:37449 (local address 127.14.181.2:43463)
0809 20:16:07.052079 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:07.052087 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:07.052919 (+ 832us) server_negotiation.cc:407] Connection header received
0809 20:16:07.053066 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:07.053071 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:07.053132 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:07.053217 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 20:16:07.053977 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:07.055055 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:07.057559 (+ 2504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:07.058614 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:07.058728 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:07.058793 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:07.059299 (+ 506us) server_negotiation.cc:299] Negotiation successful
0809 20:16:07.059651 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342}
I20260809 20:16:07.060269 15603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f8e3a1dbbbf40f8a7141a9353841d00" candidate_uuid: "364d7f472a37446b9573631484560aa4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "056dcf048d0f47bb8697327ee2e69fca" is_pre_election: true
I20260809 20:16:07.060539 15713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:07.051609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.2:43463 (local address 127.14.181.1:37449)
0809 20:16:07.052824 (+ 1215us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:07.052839 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:07.052955 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:07.053266 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:07.053271 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:07.053306 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 20:16:07.053825 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:07.053837 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:07.055195 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:07.055201 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:07.057346 (+ 2145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:07.057360 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:07.058938 (+ 1578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:07.058944 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:07.059125 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:07.059156 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 20:16:07.060081 (+ 925us) client_negotiation.cc:240] Negotiation successful
0809 20:16:07.060219 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1108,"mutex_wait_us":2,"thread_start_us":849,"threads_started":1}
I20260809 20:16:07.060693 15603 raft_consensus.cc:2454] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 056dcf048d0f47bb8697327ee2e69fca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 364d7f472a37446b9573631484560aa4 in term 0.
I20260809 20:16:07.061332 15085 leader_election.cc:302] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 056dcf048d0f47bb8697327ee2e69fca, 364d7f472a37446b9573631484560aa4; no voters:
I20260809 20:16:07.061378 15409 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f8e3a1dbbbf40f8a7141a9353841d00" candidate_uuid: "364d7f472a37446b9573631484560aa4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce456ae8db9a4c90be5ad4d3e61dd565" is_pre_election: true
I20260809 20:16:07.061703 15708 raft_consensus.cc:2781] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 20:16:07.061838 15708 raft_consensus.cc:482] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 20:16:07.061786 15409 raft_consensus.cc:2454] T 0f8e3a1dbbbf40f8a7141a9353841d00 P ce456ae8db9a4c90be5ad4d3e61dd565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 364d7f472a37446b9573631484560aa4 in term 0.
I20260809 20:16:07.061954 15708 raft_consensus.cc:3037] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:07.064998 15708 raft_consensus.cc:504] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "056dcf048d0f47bb8697327ee2e69fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35479 } } peers { permanent_uuid: "ce456ae8db9a4c90be5ad4d3e61dd565" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 43463 } } peers { permanent_uuid: "364d7f472a37446b9573631484560aa4" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45127 } }
I20260809 20:16:07.065662 15708 leader_election.cc:288] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4 [CANDIDATE]: Term 1 election: Requested vote from peers 056dcf048d0f47bb8697327ee2e69fca (127.14.181.3:35479), ce456ae8db9a4c90be5ad4d3e61dd565 (127.14.181.2:43463)
I20260809 20:16:07.066022 15603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f8e3a1dbbbf40f8a7141a9353841d00" candidate_uuid: "364d7f472a37446b9573631484560aa4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "056dcf048d0f47bb8697327ee2e69fca"
I20260809 20:16:07.066072 15409 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f8e3a1dbbbf40f8a7141a9353841d00" candidate_uuid: "364d7f472a37446b9573631484560aa4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce456ae8db9a4c90be5ad4d3e61dd565"
I20260809 20:16:07.066205 15603 raft_consensus.cc:3037] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 056dcf048d0f47bb8697327ee2e69fca [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:07.066227 15409 raft_consensus.cc:3037] T 0f8e3a1dbbbf40f8a7141a9353841d00 P ce456ae8db9a4c90be5ad4d3e61dd565 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:07.068785 15409 raft_consensus.cc:2454] T 0f8e3a1dbbbf40f8a7141a9353841d00 P ce456ae8db9a4c90be5ad4d3e61dd565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 364d7f472a37446b9573631484560aa4 in term 1.
I20260809 20:16:07.069133 15083 leader_election.cc:302] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 364d7f472a37446b9573631484560aa4, ce456ae8db9a4c90be5ad4d3e61dd565; no voters:
I20260809 20:16:07.069134 15603 raft_consensus.cc:2454] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 056dcf048d0f47bb8697327ee2e69fca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 364d7f472a37446b9573631484560aa4 in term 1.
I20260809 20:16:07.069382 15708 raft_consensus.cc:2781] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:16:07.069788 15708 raft_consensus.cc:686] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4 [term 1 LEADER]: Becoming Leader. State: Replica: 364d7f472a37446b9573631484560aa4, State: Running, Role: LEADER
I20260809 20:16:07.070232 15708 consensus_queue.cc:237] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "056dcf048d0f47bb8697327ee2e69fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35479 } } peers { permanent_uuid: "ce456ae8db9a4c90be5ad4d3e61dd565" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 43463 } } peers { permanent_uuid: "364d7f472a37446b9573631484560aa4" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45127 } }
I20260809 20:16:07.073989 14941 catalog_manager.cc:5495] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 364d7f472a37446b9573631484560aa4 (127.14.181.1). New cstate: current_term: 1 leader_uuid: "364d7f472a37446b9573631484560aa4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "056dcf048d0f47bb8697327ee2e69fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce456ae8db9a4c90be5ad4d3e61dd565" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 43463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "364d7f472a37446b9573631484560aa4" member_type: VOTER last_known_addr { host: "127.14.181.1" port: 45127 } health_report { overall_health: HEALTHY } } }
I20260809 20:16:07.096820 15695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:07.092140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57162 (local address 127.14.181.1:45127)
0809 20:16:07.092292 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:07.092296 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:07.092427 (+ 131us) server_negotiation.cc:407] Connection header received
0809 20:16:07.092569 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:07.092573 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:07.092649 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:07.092765 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:16:07.093119 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:07.093782 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:07.095169 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:07.095553 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:07.095637 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:07.096011 (+ 374us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:16:07.096399 (+ 388us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:16:07.096493 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:07.096567 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 20:16:07.096621 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 20:16:07.103578 15409 raft_consensus.cc:1261] T 0f8e3a1dbbbf40f8a7141a9353841d00 P ce456ae8db9a4c90be5ad4d3e61dd565 [term 1 FOLLOWER]: Refusing update from remote peer 364d7f472a37446b9573631484560aa4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:16:07.103693 15603 raft_consensus.cc:1261] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 056dcf048d0f47bb8697327ee2e69fca [term 1 FOLLOWER]: Refusing update from remote peer 364d7f472a37446b9573631484560aa4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:16:07.104406 15718 consensus_queue.cc:1035] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce456ae8db9a4c90be5ad4d3e61dd565" member_type: VOTER last_known_addr { host: "127.14.181.2" port: 43463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:16:07.104710 15708 consensus_queue.cc:1035] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "056dcf048d0f47bb8697327ee2e69fca" member_type: VOTER last_known_addr { host: "127.14.181.3" port: 35479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:16:07.113091 15722 mvcc.cc:205] Tried to move back new op lower bound from 7316711698848894976 to 7316711698723258368. Current Snapshot: MvccSnapshot[applied={T|T < 7316711698848894976}]
I20260809 20:16:07.114660 15723 mvcc.cc:205] Tried to move back new op lower bound from 7316711698848894976 to 7316711698723258368. Current Snapshot: MvccSnapshot[applied={T|T < 7316711698848894976}]
I20260809 20:16:07.119258 15727 mvcc.cc:205] Tried to move back new op lower bound from 7316711698848894976 to 7316711698723258368. Current Snapshot: MvccSnapshot[applied={T|T < 7316711698848894976}]
I20260809 20:16:07.125993 14940 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33900:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:16:07.126257 14940 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33900:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 20:16:07.129770 14940 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c745fffcd43e4f5482dea2b36c3f894d: Sending DeleteTablet for 3 replicas of tablet 0f8e3a1dbbbf40f8a7141a9353841d00
I20260809 20:16:07.130718 15571 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f8e3a1dbbbf40f8a7141a9353841d00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:16:07 UTC) from {username='slave'} at 127.0.0.1:48648
I20260809 20:16:07.130772 15375 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f8e3a1dbbbf40f8a7141a9353841d00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:16:07 UTC) from {username='slave'} at 127.0.0.1:57572
I20260809 20:16:07.130812 15152 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f8e3a1dbbbf40f8a7141a9353841d00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 20:16:07 UTC) from {username='slave'} at 127.0.0.1:57150
I20260809 20:16:07.134181 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 15042
I20260809 20:16:07.142040 15746 tablet_replica.cc:330] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4: stopping tablet replica
I20260809 20:16:07.142453 15746 raft_consensus.cc:2229] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4 [term 1 LEADER]: Raft consensus shutting down.
I20260809 20:16:07.143035 15746 raft_consensus.cc:2258] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:16:07.143782 15745 tablet_replica.cc:330] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 056dcf048d0f47bb8697327ee2e69fca: stopping tablet replica
I20260809 20:16:07.144138 15745 raft_consensus.cc:2229] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 056dcf048d0f47bb8697327ee2e69fca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:16:07.144587 15745 raft_consensus.cc:2258] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 056dcf048d0f47bb8697327ee2e69fca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:16:07.145356 15747 tablet_replica.cc:330] T 0f8e3a1dbbbf40f8a7141a9353841d00 P ce456ae8db9a4c90be5ad4d3e61dd565: stopping tablet replica
I20260809 20:16:07.145709 15747 raft_consensus.cc:2229] T 0f8e3a1dbbbf40f8a7141a9353841d00 P ce456ae8db9a4c90be5ad4d3e61dd565 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 20:16:07.146121 15747 raft_consensus.cc:2258] T 0f8e3a1dbbbf40f8a7141a9353841d00 P ce456ae8db9a4c90be5ad4d3e61dd565 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 20:16:07.147632 15746 ts_tablet_manager.cc:1905] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:16:07.147867 15745 ts_tablet_manager.cc:1905] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 056dcf048d0f47bb8697327ee2e69fca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:16:07.148249 15747 ts_tablet_manager.cc:1905] T 0f8e3a1dbbbf40f8a7141a9353841d00 P ce456ae8db9a4c90be5ad4d3e61dd565: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 20:16:07.154294 15745 ts_tablet_manager.cc:1918] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 056dcf048d0f47bb8697327ee2e69fca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:16:07.154456 15745 log.cc:1196] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 056dcf048d0f47bb8697327ee2e69fca: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-2/wal/wals/0f8e3a1dbbbf40f8a7141a9353841d00
I20260809 20:16:07.154959 15745 ts_tablet_manager.cc:1939] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 056dcf048d0f47bb8697327ee2e69fca: Deleting consensus metadata
I20260809 20:16:07.155521 15746 ts_tablet_manager.cc:1918] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:16:07.155772 15746 log.cc:1196] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-0/wal/wals/0f8e3a1dbbbf40f8a7141a9353841d00
I20260809 20:16:07.156324 15746 ts_tablet_manager.cc:1939] T 0f8e3a1dbbbf40f8a7141a9353841d00 P 364d7f472a37446b9573631484560aa4: Deleting consensus metadata
I20260809 20:16:07.156642 14920 catalog_manager.cc:4841] TS 056dcf048d0f47bb8697327ee2e69fca (127.14.181.3:35479): tablet 0f8e3a1dbbbf40f8a7141a9353841d00 (table test-table [id=1eebbc9696ed41949aba8c9123a51fe4]) successfully deleted
I20260809 20:16:07.158578 14916 catalog_manager.cc:4841] TS 364d7f472a37446b9573631484560aa4 (127.14.181.1:45127): tablet 0f8e3a1dbbbf40f8a7141a9353841d00 (table test-table [id=1eebbc9696ed41949aba8c9123a51fe4]) successfully deleted
I20260809 20:16:07.158419 15747 ts_tablet_manager.cc:1918] T 0f8e3a1dbbbf40f8a7141a9353841d00 P ce456ae8db9a4c90be5ad4d3e61dd565: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 20:16:07.158887 15747 log.cc:1196] T 0f8e3a1dbbbf40f8a7141a9353841d00 P ce456ae8db9a4c90be5ad4d3e61dd565: Deleting WAL directory at /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786306256699363-15060-0/minicluster-data/ts-1/wal/wals/0f8e3a1dbbbf40f8a7141a9353841d00
I20260809 20:16:07.159369 15747 ts_tablet_manager.cc:1939] T 0f8e3a1dbbbf40f8a7141a9353841d00 P ce456ae8db9a4c90be5ad4d3e61dd565: Deleting consensus metadata
I20260809 20:16:07.160890 14917 catalog_manager.cc:4841] TS ce456ae8db9a4c90be5ad4d3e61dd565 (127.14.181.2:43463): tablet 0f8e3a1dbbbf40f8a7141a9353841d00 (table test-table [id=1eebbc9696ed41949aba8c9123a51fe4]) successfully deleted
I20260809 20:16:07.161346 15695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:07.135629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57174 (local address 127.14.181.1:45127)
0809 20:16:07.135827 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:07.135833 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:07.146814 (+ 10981us) server_negotiation.cc:407] Connection header received
0809 20:16:07.150946 (+ 4132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:07.150952 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:07.151054 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:07.151137 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:07.151752 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:07.152990 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:07.157739 (+ 4749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:07.158420 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:07.158518 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:07.159820 (+ 1302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:07.159834 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:07.159849 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:07.160550 (+ 701us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:07.160619 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:07.160644 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:07.160758 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:07.160874 (+ 116us) server_negotiation.cc:299] Negotiation successful
0809 20:16:07.160965 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 20:16:07.161998 15255 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:16:07.255440 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 15042
I20260809 20:16:07.280900 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 15270
I20260809 20:16:07.287171 15698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:07.281612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57582 (local address 127.14.181.2:43463)
0809 20:16:07.281789 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:07.281793 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:07.281812 (+ 19us) server_negotiation.cc:407] Connection header received
0809 20:16:07.281959 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:07.281963 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:07.282054 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:07.282135 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:07.282508 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:07.283267 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:07.284541 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:07.284927 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:07.285016 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:07.285861 (+ 845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:07.285870 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:07.285882 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:07.286533 (+ 651us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:07.286582 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:07.286603 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:07.286687 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:07.286776 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 20:16:07.286862 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 20:16:07.287813 15467 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:16:07.371305 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 15270
I20260809 20:16:07.392983 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 15480
I20260809 20:16:07.399158 15691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:07.393739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48652 (local address 127.14.181.3:35479)
0809 20:16:07.393912 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:07.393917 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:07.393935 (+ 18us) server_negotiation.cc:407] Connection header received
0809 20:16:07.394011 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:07.394015 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:07.394108 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:07.394187 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:07.394688 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:07.395415 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:07.396561 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:07.396953 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:07.397039 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:07.397886 (+ 847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:07.397895 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:07.397911 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:07.398520 (+ 609us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:07.398568 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:07.398595 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:07.398690 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:07.398778 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 20:16:07.398862 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 20:16:07.399775 15667 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:16:07.485109 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 15480
I20260809 20:16:07.504765 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 14887
I20260809 20:16:07.505707 14994 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:16:07.609431 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 14887
2026-08-09T20:16:07Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (2574 ms)
[----------] 6 tests from EncryptionPolicyTest (21008 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:16:07 dist-test-slave-6zbq krb5kdc[15761](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:16:07 dist-test-slave-6zbq krb5kdc[15761](info): set up 2 sockets
Aug 09 20:16:07 dist-test-slave-6zbq krb5kdc[15761](info): commencing operation
krb5kdc: starting...
W20260809 20:16:08.838918 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.181s user 0.002s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:16:08 dist-test-slave-6zbq krb5kdc[15761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306568, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:16:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:16:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 20:16:09.084635 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35621
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35621
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:16:09.397810 15782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:09.398049 15782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:09.398182 15782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:09.405040 15782 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:16:09.405144 15782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:09.405220 15782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:09.405308 15782 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:16:09.405364 15782 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:16:09.414433 15782 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35621
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35621
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:09.415450 15782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:09.416579 15782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:09.427371 15793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:09.428026 15797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:09.428205 15792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:09.428572 15782 server_base.cc:1034] running on GCE node
I20260809 20:16:09.429255 15782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:09.430490 15782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:09.431687 15782 hybrid_clock.cc:648] HybridClock initialized: now 1786306569431640 us; error 40 us; skew 500 ppm
I20260809 20:16:09.431986 15782 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:16:09 dist-test-slave-6zbq krb5kdc[15761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306569, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:16:09.434829 15782 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 20:16:09.436110 15782 webserver.cc:460] Webserver started at http://127.0.0.1:39385/ using document root <none> and password file <none>
I20260809 20:16:09.436678 15782 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:09.436793 15782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:09.437054 15782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:09.439786 15782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "f76fd80817124a4fad8524f93670cb93"
format_stamp: "Formatted at 2026-08-09 20:16:09 on dist-test-slave-6zbq"
server_key: "6eed38c789fc8402f26b077989733be4"
server_key_iv: "ffdef30aa8e6dc5bc1b431e55b9efd07"
server_key_version: "encryptionkey@0"
I20260809 20:16:09.440510 15782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "f76fd80817124a4fad8524f93670cb93"
format_stamp: "Formatted at 2026-08-09 20:16:09 on dist-test-slave-6zbq"
server_key: "6eed38c789fc8402f26b077989733be4"
server_key_iv: "ffdef30aa8e6dc5bc1b431e55b9efd07"
server_key_version: "encryptionkey@0"
I20260809 20:16:09.445098 15782 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260809 20:16:09.448172 15807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:09.449303 15782 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 20:16:09.449460 15782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "f76fd80817124a4fad8524f93670cb93"
format_stamp: "Formatted at 2026-08-09 20:16:09 on dist-test-slave-6zbq"
server_key: "6eed38c789fc8402f26b077989733be4"
server_key_iv: "ffdef30aa8e6dc5bc1b431e55b9efd07"
server_key_version: "encryptionkey@0"
I20260809 20:16:09.449630 15782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:09.480824 15782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:09.484272 15782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:09.484510 15782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:09.500998 15782 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35621
I20260809 20:16:09.501036 15897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35621 every 8 connection(s)
I20260809 20:16:09.502166 15782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:16:09.505499 15899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:09.505601 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 15782
I20260809 20:16:09.505785 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:16:09.506439 15060 external_mini_cluster.cc:1428] Setting key 44c712eda3d6ae28d8412d53a35911ce
I20260809 20:16:09.517930 15899 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f76fd80817124a4fad8524f93670cb93: Bootstrap starting.
Aug 09 20:16:09 dist-test-slave-6zbq krb5kdc[15761](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306568, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 20:16:09.521396 15899 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f76fd80817124a4fad8524f93670cb93: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:09.522562 15899 log.cc:824] T 00000000000000000000000000000000 P f76fd80817124a4fad8524f93670cb93: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:09.525728 15899 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f76fd80817124a4fad8524f93670cb93: No bootstrap required, opened a new log
I20260809 20:16:09.528949 15903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:09.508093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41893 (local address 127.0.0.1:35621)
0809 20:16:09.508842 (+ 749us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:09.508853 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:09.508892 (+ 39us) server_negotiation.cc:407] Connection header received
0809 20:16:09.510937 (+ 2045us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:09.510958 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:09.511309 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:09.511609 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:09.513320 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:09.514626 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:09.516398 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:09.517000 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:09.517125 (+ 125us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:09.521803 (+ 4678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:09.521811 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:09.521823 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:09.521863 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:09.525063 (+ 3200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:09.525918 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:09.525924 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:09.525929 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:09.526084 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:09.526579 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:09.526582 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:09.526584 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:09.527052 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:09.527272 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:09.527756 (+ 484us) server_negotiation.cc:299] Negotiation successful
0809 20:16:09.528003 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":342,"threads_started":1}
I20260809 20:16:09.532513 15060 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 20:16:09.534008 15899 raft_consensus.cc:348] T 00000000000000000000000000000000 P f76fd80817124a4fad8524f93670cb93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f76fd80817124a4fad8524f93670cb93" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35621 } }
I20260809 20:16:09.534400 15899 raft_consensus.cc:374] T 00000000000000000000000000000000 P f76fd80817124a4fad8524f93670cb93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:09.534489 15899 raft_consensus.cc:729] T 00000000000000000000000000000000 P f76fd80817124a4fad8524f93670cb93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76fd80817124a4fad8524f93670cb93, State: Initialized, Role: FOLLOWER
I20260809 20:16:09.535071 15899 consensus_queue.cc:260] T 00000000000000000000000000000000 P f76fd80817124a4fad8524f93670cb93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f76fd80817124a4fad8524f93670cb93" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35621 } }
I20260809 20:16:09.535370 15899 raft_consensus.cc:388] T 00000000000000000000000000000000 P f76fd80817124a4fad8524f93670cb93 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:16:09.535511 15899 raft_consensus.cc:482] T 00000000000000000000000000000000 P f76fd80817124a4fad8524f93670cb93 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:16:09.535668 15899 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f76fd80817124a4fad8524f93670cb93 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:09.538335 15899 raft_consensus.cc:504] T 00000000000000000000000000000000 P f76fd80817124a4fad8524f93670cb93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f76fd80817124a4fad8524f93670cb93" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35621 } }
I20260809 20:16:09.538882 15899 leader_election.cc:302] T 00000000000000000000000000000000 P f76fd80817124a4fad8524f93670cb93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f76fd80817124a4fad8524f93670cb93; no voters:
I20260809 20:16:09.539417 15899 leader_election.cc:288] T 00000000000000000000000000000000 P f76fd80817124a4fad8524f93670cb93 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:16:09.539567 15914 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f76fd80817124a4fad8524f93670cb93 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:16:09.541451 15899 sys_catalog.cc:564] T 00000000000000000000000000000000 P f76fd80817124a4fad8524f93670cb93 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:16:09.546162 15914 raft_consensus.cc:686] T 00000000000000000000000000000000 P f76fd80817124a4fad8524f93670cb93 [term 1 LEADER]: Becoming Leader. State: Replica: f76fd80817124a4fad8524f93670cb93, State: Running, Role: LEADER
I20260809 20:16:09.546710 15914 consensus_queue.cc:237] T 00000000000000000000000000000000 P f76fd80817124a4fad8524f93670cb93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f76fd80817124a4fad8524f93670cb93" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35621 } }
I20260809 20:16:09.549715 15918 sys_catalog.cc:455] T 00000000000000000000000000000000 P f76fd80817124a4fad8524f93670cb93 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f76fd80817124a4fad8524f93670cb93. Latest consensus state: current_term: 1 leader_uuid: "f76fd80817124a4fad8524f93670cb93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f76fd80817124a4fad8524f93670cb93" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35621 } } }
I20260809 20:16:09.550093 15918 sys_catalog.cc:458] T 00000000000000000000000000000000 P f76fd80817124a4fad8524f93670cb93 [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:09.550525 15916 sys_catalog.cc:455] T 00000000000000000000000000000000 P f76fd80817124a4fad8524f93670cb93 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f76fd80817124a4fad8524f93670cb93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f76fd80817124a4fad8524f93670cb93" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35621 } } }
I20260809 20:16:09.550806 15916 sys_catalog.cc:458] T 00000000000000000000000000000000 P f76fd80817124a4fad8524f93670cb93 [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:09.555301 15903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:09.537782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53637 (local address 127.0.0.1:35621)
0809 20:16:09.537930 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:09.537936 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:09.538443 (+ 507us) server_negotiation.cc:407] Connection header received
0809 20:16:09.538566 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:09.538571 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:09.538636 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:09.538743 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:09.540412 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:09.541530 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:09.543428 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:09.544140 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:09.544271 (+ 131us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:09.547221 (+ 2950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:09.547229 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:09.547233 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:09.547274 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:09.551059 (+ 3785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:09.552084 (+ 1025us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:09.552089 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:09.552093 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:09.552230 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:09.552796 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:09.552801 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:09.552805 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:09.553191 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:09.554540 (+ 1349us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:09.554725 (+ 185us) server_negotiation.cc:299] Negotiation successful
0809 20:16:09.554901 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 20:16:09.559274 15928 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:16:09.563975 15928 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:16:09.571686 15928 catalog_manager.cc:1347] Generated new cluster ID: b4840fd377424e0ea8a573df8615a661
I20260809 20:16:09.571779 15928 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:16:09.586690 15928 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:16:09.587782 15928 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:16:09.601799 15928 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f76fd80817124a4fad8524f93670cb93: Generated new TSK 0
I20260809 20:16:09.602686 15928 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:16:09.615972 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 15782
I20260809 20:16:09.617092 15889 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:16:09.704325 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 15782
W20260809 20:16:09.727680 15758 connection.cc:535] client connection to 127.0.0.1:35621 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35621): Connection reset by peer (error 104)
2026-08-09T20:16:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2089 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:16:09 dist-test-slave-6zbq krb5kdc[15952](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:16:09 dist-test-slave-6zbq krb5kdc[15952](info): set up 2 sockets
Aug 09 20:16:09 dist-test-slave-6zbq krb5kdc[15952](info): commencing operation
krb5kdc: starting...
W20260809 20:16:10.936342 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.190s user 0.000s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:16:11 dist-test-slave-6zbq krb5kdc[15952](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306571, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:16:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:16:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 20:16:11.175380 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41831
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41483
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41831
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:16:11.484596 15970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:11.484853 15970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:11.484988 15970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:11.491781 15970 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:16:11.491889 15970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:11.491967 15970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:11.492053 15970 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:16:11.492121 15970 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:16:11.501524 15970 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41483
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41831
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41831
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:11.502597 15970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:11.503753 15970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:11.514328 15976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:11.514371 15981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:11.514423 15979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:11.515269 15970 server_base.cc:1034] running on GCE node
I20260809 20:16:11.515956 15970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:11.517149 15970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:11.518362 15970 hybrid_clock.cc:648] HybridClock initialized: now 1786306571518297 us; error 41 us; skew 500 ppm
I20260809 20:16:11.518692 15970 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:16:11 dist-test-slave-6zbq krb5kdc[15952](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306571, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:16:11.521564 15970 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 20:16:11.522869 15970 webserver.cc:460] Webserver started at http://127.0.0.1:33223/ using document root <none> and password file <none>
I20260809 20:16:11.523442 15970 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:11.523552 15970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:11.523816 15970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:11.526705 15970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "e6ba9227316247c18d846a7ffd5a88c5"
format_stamp: "Formatted at 2026-08-09 20:16:11 on dist-test-slave-6zbq"
server_key: "0b79ad589115c4d956a9f2cc256d0e78"
server_key_iv: "4bc985a8b14615de407525fcd5018e65"
server_key_version: "encryptionkey@0"
I20260809 20:16:11.527433 15970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "e6ba9227316247c18d846a7ffd5a88c5"
format_stamp: "Formatted at 2026-08-09 20:16:11 on dist-test-slave-6zbq"
server_key: "0b79ad589115c4d956a9f2cc256d0e78"
server_key_iv: "4bc985a8b14615de407525fcd5018e65"
server_key_version: "encryptionkey@0"
I20260809 20:16:11.531934 15970 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 20:16:11.535014 15997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:11.536136 15970 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:16:11.536288 15970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "e6ba9227316247c18d846a7ffd5a88c5"
format_stamp: "Formatted at 2026-08-09 20:16:11 on dist-test-slave-6zbq"
server_key: "0b79ad589115c4d956a9f2cc256d0e78"
server_key_iv: "4bc985a8b14615de407525fcd5018e65"
server_key_version: "encryptionkey@0"
I20260809 20:16:11.536449 15970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:11.556167 15970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:11.560132 15970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:11.560376 15970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:11.576040 15970 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41831
I20260809 20:16:11.576072 16077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41831 every 8 connection(s)
I20260809 20:16:11.577170 15970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:16:11.580476 16078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:11.584594 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 15970
I20260809 20:16:11.584792 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:16:11.585330 15060 external_mini_cluster.cc:1428] Setting key 21538772bb3feef37c83d8e60f472452
I20260809 20:16:11.591051 16078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6ba9227316247c18d846a7ffd5a88c5: Bootstrap starting.
I20260809 20:16:11.593816 16078 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e6ba9227316247c18d846a7ffd5a88c5: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:11.594838 16078 log.cc:824] T 00000000000000000000000000000000 P e6ba9227316247c18d846a7ffd5a88c5: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:11.597523 16078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6ba9227316247c18d846a7ffd5a88c5: No bootstrap required, opened a new log
I20260809 20:16:11.598011 16083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:11.587092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47761 (local address 127.0.0.1:41831)
0809 20:16:11.587865 (+ 773us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:11.587877 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:11.587916 (+ 39us) server_negotiation.cc:407] Connection header received
0809 20:16:11.589856 (+ 1940us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:11.589876 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:11.590204 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:11.590547 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:11.591106 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:11.592420 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:11.593720 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:11.594507 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:11.594669 (+ 162us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:11.595850 (+ 1181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:11.595863 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:11.595880 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:11.596427 (+ 547us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:11.596495 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:11.596519 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:11.596635 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:11.596923 (+ 288us) server_negotiation.cc:299] Negotiation successful
0809 20:16:11.597081 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":366,"threads_started":1}
I20260809 20:16:11.601589 15060 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 20:16:11.605175 16078 raft_consensus.cc:348] T 00000000000000000000000000000000 P e6ba9227316247c18d846a7ffd5a88c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6ba9227316247c18d846a7ffd5a88c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41831 } }
I20260809 20:16:11.605569 16078 raft_consensus.cc:374] T 00000000000000000000000000000000 P e6ba9227316247c18d846a7ffd5a88c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:11.605670 16078 raft_consensus.cc:729] T 00000000000000000000000000000000 P e6ba9227316247c18d846a7ffd5a88c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6ba9227316247c18d846a7ffd5a88c5, State: Initialized, Role: FOLLOWER
I20260809 20:16:11.606365 16078 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6ba9227316247c18d846a7ffd5a88c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6ba9227316247c18d846a7ffd5a88c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41831 } }
I20260809 20:16:11.606649 16078 raft_consensus.cc:388] T 00000000000000000000000000000000 P e6ba9227316247c18d846a7ffd5a88c5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:16:11.606798 16078 raft_consensus.cc:482] T 00000000000000000000000000000000 P e6ba9227316247c18d846a7ffd5a88c5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:16:11.606964 16078 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6ba9227316247c18d846a7ffd5a88c5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:11.609711 16078 raft_consensus.cc:504] T 00000000000000000000000000000000 P e6ba9227316247c18d846a7ffd5a88c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6ba9227316247c18d846a7ffd5a88c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41831 } }
I20260809 20:16:11.610177 16078 leader_election.cc:302] T 00000000000000000000000000000000 P e6ba9227316247c18d846a7ffd5a88c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e6ba9227316247c18d846a7ffd5a88c5; no voters:
I20260809 20:16:11.610811 16078 leader_election.cc:288] T 00000000000000000000000000000000 P e6ba9227316247c18d846a7ffd5a88c5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:16:11.610896 16095 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e6ba9227316247c18d846a7ffd5a88c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:16:11.612032 16095 raft_consensus.cc:686] T 00000000000000000000000000000000 P e6ba9227316247c18d846a7ffd5a88c5 [term 1 LEADER]: Becoming Leader. State: Replica: e6ba9227316247c18d846a7ffd5a88c5, State: Running, Role: LEADER
I20260809 20:16:11.612393 16083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:11.605616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36243 (local address 127.0.0.1:41831)
0809 20:16:11.605793 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:11.605799 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:11.606198 (+ 399us) server_negotiation.cc:407] Connection header received
0809 20:16:11.606398 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:11.606401 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:11.606452 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:11.606523 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:11.607135 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:11.607864 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:11.609705 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:11.610145 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:11.610232 (+ 87us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:11.611488 (+ 1256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:11.611495 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:11.611500 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:11.611518 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:11.611558 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:11.611579 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:11.611680 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:11.612024 (+ 344us) server_negotiation.cc:299] Negotiation successful
0809 20:16:11.612083 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 20:16:11.612560 16095 consensus_queue.cc:237] T 00000000000000000000000000000000 P e6ba9227316247c18d846a7ffd5a88c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6ba9227316247c18d846a7ffd5a88c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41831 } }
I20260809 20:16:11.612887 16078 sys_catalog.cc:564] T 00000000000000000000000000000000 P e6ba9227316247c18d846a7ffd5a88c5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:16:11.618989 16096 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6ba9227316247c18d846a7ffd5a88c5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e6ba9227316247c18d846a7ffd5a88c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6ba9227316247c18d846a7ffd5a88c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41831 } } }
I20260809 20:16:11.619220 16097 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6ba9227316247c18d846a7ffd5a88c5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e6ba9227316247c18d846a7ffd5a88c5. Latest consensus state: current_term: 1 leader_uuid: "e6ba9227316247c18d846a7ffd5a88c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6ba9227316247c18d846a7ffd5a88c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41831 } } }
I20260809 20:16:11.619481 16096 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6ba9227316247c18d846a7ffd5a88c5 [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:11.619510 16097 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6ba9227316247c18d846a7ffd5a88c5 [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:11.620361 16109 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:16:11.624935 16109 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:16:11.636612 16109 catalog_manager.cc:1347] Generated new cluster ID: e480d91acd844a86b9b7249bf36101bc
I20260809 20:16:11.636708 16109 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:16:11.653302 16109 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:16:11.654430 16109 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:16:11.664158 16109 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e6ba9227316247c18d846a7ffd5a88c5: Generated new TSK 0
I20260809 20:16:11.664837 16109 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:16:11.671382 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 15970
W20260809 20:16:11.672436 16070 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:47761
W20260809 20:16:11.673128 15060 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 15970: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 20:16:11.673327 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 15970
W20260809 20:16:11.701818 15948 connection.cc:535] client connection to 127.0.0.1:41831 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41831): Connection reset by peer (error 104)
2026-08-09T20:16:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1974 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:16:11 dist-test-slave-6zbq krb5kdc[16133](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:16:11 dist-test-slave-6zbq krb5kdc[16133](info): set up 2 sockets
Aug 09 20:16:11 dist-test-slave-6zbq krb5kdc[16133](info): commencing operation
krb5kdc: starting...
W20260809 20:16:12.896579 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.176s user 0.000s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:16:13 dist-test-slave-6zbq krb5kdc[16133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306573, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:16:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:16:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 20:16:13.153187 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43947
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43947
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:16:13.468521 16150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:13.468763 16150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:13.468887 16150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:13.475639 16150 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:16:13.475732 16150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:13.475816 16150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:13.475893 16150 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:16:13.475950 16150 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:16:13.485189 16150 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43947
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43947
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:13.486210 16150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:13.487366 16150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:13.497836 16161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:13.497762 16165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:13.497803 16163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:13.498523 16150 server_base.cc:1034] running on GCE node
I20260809 20:16:13.499157 16150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:13.500322 16150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:13.501506 16150 hybrid_clock.cc:648] HybridClock initialized: now 1786306573501463 us; error 37 us; skew 500 ppm
I20260809 20:16:13.501776 16150 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:16:13 dist-test-slave-6zbq krb5kdc[16133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306573, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:16:13.509842 16150 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 20:16:13.511296 16150 webserver.cc:460] Webserver started at http://127.0.0.1:37345/ using document root <none> and password file <none>
I20260809 20:16:13.511864 16150 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:13.511963 16150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:13.512197 16150 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:13.514933 16150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "54eada504a424b0eb54628199e2d2843"
format_stamp: "Formatted at 2026-08-09 20:16:13 on dist-test-slave-6zbq"
server_key: "0a42a92be2083485dff702fe3ad73b18"
server_key_iv: "06b502dfa4d66eee3ee15f83a26d5d3d"
server_key_version: "encryptionkey@0"
I20260809 20:16:13.515614 16150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "54eada504a424b0eb54628199e2d2843"
format_stamp: "Formatted at 2026-08-09 20:16:13 on dist-test-slave-6zbq"
server_key: "0a42a92be2083485dff702fe3ad73b18"
server_key_iv: "06b502dfa4d66eee3ee15f83a26d5d3d"
server_key_version: "encryptionkey@0"
I20260809 20:16:13.520205 16150 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 20:16:13.523399 16176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:13.524533 16150 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:16:13.524675 16150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "54eada504a424b0eb54628199e2d2843"
format_stamp: "Formatted at 2026-08-09 20:16:13 on dist-test-slave-6zbq"
server_key: "0a42a92be2083485dff702fe3ad73b18"
server_key_iv: "06b502dfa4d66eee3ee15f83a26d5d3d"
server_key_version: "encryptionkey@0"
I20260809 20:16:13.524825 16150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:13.529939 16150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:13.533685 16150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:13.533910 16150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:13.550179 16150 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43947
I20260809 20:16:13.550253 16265 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43947 every 8 connection(s)
I20260809 20:16:13.551386 16150 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:16:13.554764 16267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:13.554910 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 16150
I20260809 20:16:13.555054 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:16:13.555440 15060 external_mini_cluster.cc:1428] Setting key 20688301c8221eaff5dd28d410fd1132
I20260809 20:16:13.563074 16271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:13.556946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55179 (local address 127.0.0.1:43947)
0809 20:16:13.557740 (+ 794us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:13.557754 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:13.557812 (+ 58us) server_negotiation.cc:407] Connection header received
0809 20:16:13.559512 (+ 1700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:13.559539 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:13.559945 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:13.560355 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:13.561285 (+ 930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:13.561297 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:13.561313 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:13.561332 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:13.561401 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:13.561432 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:13.561646 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:13.561786 (+ 140us) server_negotiation.cc:299] Negotiation successful
0809 20:16:13.561957 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":321,"threads_started":1}
I20260809 20:16:13.566587 15060 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 20:16:13.568331 16267 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54eada504a424b0eb54628199e2d2843: Bootstrap starting.
I20260809 20:16:13.571158 16267 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 54eada504a424b0eb54628199e2d2843: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:13.572124 16267 log.cc:824] T 00000000000000000000000000000000 P 54eada504a424b0eb54628199e2d2843: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:13.573009 16271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:13.570705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57997 (local address 127.0.0.1:43947)
0809 20:16:13.570873 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:13.570879 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:13.571247 (+ 368us) server_negotiation.cc:407] Connection header received
0809 20:16:13.571405 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:13.571410 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:13.571465 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:13.571553 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:13.572380 (+ 827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:13.572386 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:13.572390 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:13.572406 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:13.572448 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:13.572469 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:13.572594 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:13.572680 (+ 86us) server_negotiation.cc:299] Negotiation successful
0809 20:16:13.572735 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 20:16:13.574791 16267 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54eada504a424b0eb54628199e2d2843: No bootstrap required, opened a new log
I20260809 20:16:13.581544 16267 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54eada504a424b0eb54628199e2d2843 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54eada504a424b0eb54628199e2d2843" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43947 } }
I20260809 20:16:13.581856 16267 raft_consensus.cc:374] T 00000000000000000000000000000000 P 54eada504a424b0eb54628199e2d2843 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:13.581948 16267 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54eada504a424b0eb54628199e2d2843 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54eada504a424b0eb54628199e2d2843, State: Initialized, Role: FOLLOWER
I20260809 20:16:13.582509 16267 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54eada504a424b0eb54628199e2d2843 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54eada504a424b0eb54628199e2d2843" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43947 } }
I20260809 20:16:13.582741 16267 raft_consensus.cc:388] T 00000000000000000000000000000000 P 54eada504a424b0eb54628199e2d2843 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:16:13.582893 16267 raft_consensus.cc:482] T 00000000000000000000000000000000 P 54eada504a424b0eb54628199e2d2843 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:16:13.583079 16267 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54eada504a424b0eb54628199e2d2843 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:13.585054 16267 raft_consensus.cc:504] T 00000000000000000000000000000000 P 54eada504a424b0eb54628199e2d2843 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54eada504a424b0eb54628199e2d2843" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43947 } }
I20260809 20:16:13.585510 16267 leader_election.cc:302] T 00000000000000000000000000000000 P 54eada504a424b0eb54628199e2d2843 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 54eada504a424b0eb54628199e2d2843; no voters:
I20260809 20:16:13.586026 16267 leader_election.cc:288] T 00000000000000000000000000000000 P 54eada504a424b0eb54628199e2d2843 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:16:13.586154 16285 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 54eada504a424b0eb54628199e2d2843 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:16:13.586781 16285 raft_consensus.cc:686] T 00000000000000000000000000000000 P 54eada504a424b0eb54628199e2d2843 [term 1 LEADER]: Becoming Leader. State: Replica: 54eada504a424b0eb54628199e2d2843, State: Running, Role: LEADER
I20260809 20:16:13.587314 16285 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54eada504a424b0eb54628199e2d2843 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54eada504a424b0eb54628199e2d2843" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43947 } }
I20260809 20:16:13.587826 16267 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54eada504a424b0eb54628199e2d2843 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:16:13.589820 16287 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54eada504a424b0eb54628199e2d2843 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54eada504a424b0eb54628199e2d2843. Latest consensus state: current_term: 1 leader_uuid: "54eada504a424b0eb54628199e2d2843" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54eada504a424b0eb54628199e2d2843" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43947 } } }
I20260809 20:16:13.589977 16286 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54eada504a424b0eb54628199e2d2843 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "54eada504a424b0eb54628199e2d2843" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54eada504a424b0eb54628199e2d2843" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43947 } } }
I20260809 20:16:13.590240 16287 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54eada504a424b0eb54628199e2d2843 [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:13.590281 16286 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54eada504a424b0eb54628199e2d2843 [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:13.595394 16293 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:16:13.599670 16293 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:16:13.607378 16293 catalog_manager.cc:1347] Generated new cluster ID: afed0feb8203443d95dc9286a47a68a3
I20260809 20:16:13.607470 16293 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:16:13.624820 16293 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:16:13.625168 16293 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:16:13.635766 16293 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 54eada504a424b0eb54628199e2d2843: Generated new TSK 0
I20260809 20:16:13.636657 16293 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:16:13.650193 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 16150
W20260809 20:16:13.651207 16258 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:55179
W20260809 20:16:13.651872 15060 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 16150: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 20:16:13.651997 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 16150
2026-08-09T20:16:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1971 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:16:13 dist-test-slave-6zbq krb5kdc[16318](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:16:13 dist-test-slave-6zbq krb5kdc[16318](info): set up 2 sockets
Aug 09 20:16:13 dist-test-slave-6zbq krb5kdc[16318](info): commencing operation
krb5kdc: starting...
W20260809 20:16:14.851220 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.004s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:16:15 dist-test-slave-6zbq krb5kdc[16318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306575, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:16:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:16:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 20:16:15.088979 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35661
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35661
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:16:15.401538 16337 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:15.401784 16337 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:15.401919 16337 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:15.408761 16337 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:16:15.408869 16337 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:15.408946 16337 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:15.409024 16337 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:16:15.409086 16337 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:16:15.418262 16337 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35661
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35661
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:15.419402 16337 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:15.420598 16337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:15.431424 16344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:15.431486 16345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:15.431383 16352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:15.432384 16337 server_base.cc:1034] running on GCE node
I20260809 20:16:15.433094 16337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:15.434367 16337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:15.435580 16337 hybrid_clock.cc:648] HybridClock initialized: now 1786306575435519 us; error 54 us; skew 500 ppm
I20260809 20:16:15.435892 16337 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:16:15 dist-test-slave-6zbq krb5kdc[16318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306575, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:16:15.438902 16337 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 20:16:15.440196 16337 webserver.cc:460] Webserver started at http://127.0.0.1:41157/ using document root <none> and password file <none>
I20260809 20:16:15.440793 16337 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:15.440896 16337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:15.441190 16337 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:15.443954 16337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "a79ecc5591794b7a9fb62f21e7b0f95e"
format_stamp: "Formatted at 2026-08-09 20:16:15 on dist-test-slave-6zbq"
server_key: "1349e5c83c3b2a6451d43bbb265e221a"
server_key_iv: "9853c1df6ff2a8765fd555d5f49cf13b"
server_key_version: "encryptionkey@0"
I20260809 20:16:15.444777 16337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "a79ecc5591794b7a9fb62f21e7b0f95e"
format_stamp: "Formatted at 2026-08-09 20:16:15 on dist-test-slave-6zbq"
server_key: "1349e5c83c3b2a6451d43bbb265e221a"
server_key_iv: "9853c1df6ff2a8765fd555d5f49cf13b"
server_key_version: "encryptionkey@0"
I20260809 20:16:15.450033 16337 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 20:16:15.453182 16361 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:15.454332 16337 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:16:15.454520 16337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "a79ecc5591794b7a9fb62f21e7b0f95e"
format_stamp: "Formatted at 2026-08-09 20:16:15 on dist-test-slave-6zbq"
server_key: "1349e5c83c3b2a6451d43bbb265e221a"
server_key_iv: "9853c1df6ff2a8765fd555d5f49cf13b"
server_key_version: "encryptionkey@0"
I20260809 20:16:15.454696 16337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:15.491737 16337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:15.495652 16337 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:15.495900 16337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:15.512866 16337 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35661
I20260809 20:16:15.512913 16447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35661 every 8 connection(s)
I20260809 20:16:15.514058 16337 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:16:15.517431 16450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:15.518731 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 16337
I20260809 20:16:15.518883 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:16:15.519322 15060 external_mini_cluster.cc:1428] Setting key 3963cfe21611004e7bfe11910c740830
I20260809 20:16:15.530735 16450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a79ecc5591794b7a9fb62f21e7b0f95e: Bootstrap starting.
Aug 09 20:16:15 dist-test-slave-6zbq krb5kdc[16318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306575, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 20:16:15.533784 16450 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a79ecc5591794b7a9fb62f21e7b0f95e: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:15.534894 16450 log.cc:824] T 00000000000000000000000000000000 P a79ecc5591794b7a9fb62f21e7b0f95e: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:15.537515 16450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a79ecc5591794b7a9fb62f21e7b0f95e: No bootstrap required, opened a new log
I20260809 20:16:15.540887 16455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:15.520945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51215 (local address 127.0.0.1:35661)
0809 20:16:15.521758 (+ 813us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:15.521772 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:15.521820 (+ 48us) server_negotiation.cc:407] Connection header received
0809 20:16:15.523572 (+ 1752us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:15.523606 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:15.524067 (+ 461us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:15.524539 (+ 472us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:15.525823 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:15.527789 (+ 1966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:15.529007 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:15.529985 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:15.530153 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:15.534221 (+ 4068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:15.534229 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:15.534242 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:15.534279 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:15.537042 (+ 2763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:15.537834 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:15.537839 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:15.537846 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:15.538011 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:15.538449 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:15.538452 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:15.538454 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:15.538919 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:15.539146 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:15.539616 (+ 470us) server_negotiation.cc:299] Negotiation successful
0809 20:16:15.539930 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":331,"threads_started":1}
I20260809 20:16:15.544261 15060 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 20:16:15.545539 16450 raft_consensus.cc:348] T 00000000000000000000000000000000 P a79ecc5591794b7a9fb62f21e7b0f95e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a79ecc5591794b7a9fb62f21e7b0f95e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35661 } }
I20260809 20:16:15.545837 16450 raft_consensus.cc:374] T 00000000000000000000000000000000 P a79ecc5591794b7a9fb62f21e7b0f95e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:15.545928 16450 raft_consensus.cc:729] T 00000000000000000000000000000000 P a79ecc5591794b7a9fb62f21e7b0f95e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a79ecc5591794b7a9fb62f21e7b0f95e, State: Initialized, Role: FOLLOWER
I20260809 20:16:15.546509 16450 consensus_queue.cc:260] T 00000000000000000000000000000000 P a79ecc5591794b7a9fb62f21e7b0f95e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a79ecc5591794b7a9fb62f21e7b0f95e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35661 } }
I20260809 20:16:15.546778 16450 raft_consensus.cc:388] T 00000000000000000000000000000000 P a79ecc5591794b7a9fb62f21e7b0f95e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:16:15.546911 16450 raft_consensus.cc:482] T 00000000000000000000000000000000 P a79ecc5591794b7a9fb62f21e7b0f95e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:16:15.547096 16450 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a79ecc5591794b7a9fb62f21e7b0f95e [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:15.549659 16450 raft_consensus.cc:504] T 00000000000000000000000000000000 P a79ecc5591794b7a9fb62f21e7b0f95e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a79ecc5591794b7a9fb62f21e7b0f95e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35661 } }
I20260809 20:16:15.550218 16450 leader_election.cc:302] T 00000000000000000000000000000000 P a79ecc5591794b7a9fb62f21e7b0f95e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a79ecc5591794b7a9fb62f21e7b0f95e; no voters:
I20260809 20:16:15.550853 16450 leader_election.cc:288] T 00000000000000000000000000000000 P a79ecc5591794b7a9fb62f21e7b0f95e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:16:15.550938 16465 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a79ecc5591794b7a9fb62f21e7b0f95e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:16:15.552790 16450 sys_catalog.cc:564] T 00000000000000000000000000000000 P a79ecc5591794b7a9fb62f21e7b0f95e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:16:15.557735 16465 raft_consensus.cc:686] T 00000000000000000000000000000000 P a79ecc5591794b7a9fb62f21e7b0f95e [term 1 LEADER]: Becoming Leader. State: Replica: a79ecc5591794b7a9fb62f21e7b0f95e, State: Running, Role: LEADER
I20260809 20:16:15.558329 16465 consensus_queue.cc:237] T 00000000000000000000000000000000 P a79ecc5591794b7a9fb62f21e7b0f95e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a79ecc5591794b7a9fb62f21e7b0f95e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35661 } }
I20260809 20:16:15.561306 16466 sys_catalog.cc:455] T 00000000000000000000000000000000 P a79ecc5591794b7a9fb62f21e7b0f95e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a79ecc5591794b7a9fb62f21e7b0f95e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a79ecc5591794b7a9fb62f21e7b0f95e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35661 } } }
I20260809 20:16:15.561453 16467 sys_catalog.cc:455] T 00000000000000000000000000000000 P a79ecc5591794b7a9fb62f21e7b0f95e [sys.catalog]: SysCatalogTable state changed. Reason: New leader a79ecc5591794b7a9fb62f21e7b0f95e. Latest consensus state: current_term: 1 leader_uuid: "a79ecc5591794b7a9fb62f21e7b0f95e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a79ecc5591794b7a9fb62f21e7b0f95e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35661 } } }
I20260809 20:16:15.561748 16466 sys_catalog.cc:458] T 00000000000000000000000000000000 P a79ecc5591794b7a9fb62f21e7b0f95e [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:15.561830 16467 sys_catalog.cc:458] T 00000000000000000000000000000000 P a79ecc5591794b7a9fb62f21e7b0f95e [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:15.565841 16455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:15.548205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53623 (local address 127.0.0.1:35661)
0809 20:16:15.548376 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:15.548386 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:15.548872 (+ 486us) server_negotiation.cc:407] Connection header received
0809 20:16:15.549002 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:15.549005 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:15.549059 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:15.549128 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:15.550909 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:15.552042 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:15.553736 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:15.554519 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:15.555283 (+ 764us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:15.557658 (+ 2375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:15.557665 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:15.557671 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:15.557709 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:15.561773 (+ 4064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:15.562725 (+ 952us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:15.562730 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:15.562734 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:15.562876 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:15.563340 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:15.563345 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:15.563348 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:15.563767 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:15.565114 (+ 1347us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:15.565264 (+ 150us) server_negotiation.cc:299] Negotiation successful
0809 20:16:15.565474 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 20:16:15.568454 16476 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:16:15.572913 16476 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:16:15.580669 16476 catalog_manager.cc:1347] Generated new cluster ID: 701882c757684d04a6f4ab4e51a4ffa3
I20260809 20:16:15.580767 16476 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:16:15.602883 16476 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:16:15.604135 16476 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:16:15.609474 16476 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a79ecc5591794b7a9fb62f21e7b0f95e: Generated new TSK 0
I20260809 20:16:15.610397 16476 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:16:15.623173 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 16337
I20260809 20:16:15.624604 16438 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:16:15.712987 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 16337
2026-08-09T20:16:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2060 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:16:15 dist-test-slave-6zbq krb5kdc[16504](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:16:15 dist-test-slave-6zbq krb5kdc[16504](info): set up 2 sockets
Aug 09 20:16:15 dist-test-slave-6zbq krb5kdc[16504](info): commencing operation
krb5kdc: starting...
W20260809 20:16:16.932264 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.180s user 0.004s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:16:17 dist-test-slave-6zbq krb5kdc[16504](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306577, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:16:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:16:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 20:16:17.178946 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37217
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37217
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:16:17.496416 16523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:17.496687 16523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:17.496824 16523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:17.503729 16523 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:16:17.503844 16523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:17.503919 16523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:17.504004 16523 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:16:17.504065 16523 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:16:17.513612 16523 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37217
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37217
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:17.514737 16523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:17.515928 16523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:17.526777 16537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:17.526906 16530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:17.526880 16532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:17.527362 16523 server_base.cc:1034] running on GCE node
I20260809 20:16:17.528129 16523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:17.529392 16523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:17.530567 16523 hybrid_clock.cc:648] HybridClock initialized: now 1786306577530524 us; error 38 us; skew 500 ppm
I20260809 20:16:17.530871 16523 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:16:17 dist-test-slave-6zbq krb5kdc[16504](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306577, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:16:17.533690 16523 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 20:16:17.535080 16523 webserver.cc:460] Webserver started at http://127.0.0.1:45831/ using document root <none> and password file <none>
I20260809 20:16:17.535722 16523 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:17.535835 16523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:17.536108 16523 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:17.538944 16523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "da864dd5cf68488e8bfffe967139e9ad"
format_stamp: "Formatted at 2026-08-09 20:16:17 on dist-test-slave-6zbq"
server_key: "ce1d48a8098e36ff094077be06a7cafb"
server_key_iv: "930f3ce8035c1d8fe036b5009ce797b2"
server_key_version: "encryptionkey@0"
I20260809 20:16:17.539645 16523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "da864dd5cf68488e8bfffe967139e9ad"
format_stamp: "Formatted at 2026-08-09 20:16:17 on dist-test-slave-6zbq"
server_key: "ce1d48a8098e36ff094077be06a7cafb"
server_key_iv: "930f3ce8035c1d8fe036b5009ce797b2"
server_key_version: "encryptionkey@0"
I20260809 20:16:17.544528 16523 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 20:16:17.547714 16546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:17.548942 16523 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 20:16:17.549093 16523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "da864dd5cf68488e8bfffe967139e9ad"
format_stamp: "Formatted at 2026-08-09 20:16:17 on dist-test-slave-6zbq"
server_key: "ce1d48a8098e36ff094077be06a7cafb"
server_key_iv: "930f3ce8035c1d8fe036b5009ce797b2"
server_key_version: "encryptionkey@0"
I20260809 20:16:17.549269 16523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:17.569376 16523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:17.572770 16523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:17.573006 16523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:17.589919 16523 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37217
I20260809 20:16:17.589956 16631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37217 every 8 connection(s)
I20260809 20:16:17.591118 16523 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:16:17.594518 16632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:17.599438 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 16523
I20260809 20:16:17.599587 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:16:17.600000 15060 external_mini_cluster.cc:1428] Setting key e437628223a41cd5236a5d942c8de0d1
I20260809 20:16:17.604547 16632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da864dd5cf68488e8bfffe967139e9ad: Bootstrap starting.
I20260809 20:16:17.607882 16632 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P da864dd5cf68488e8bfffe967139e9ad: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:17.608956 16632 log.cc:824] T 00000000000000000000000000000000 P da864dd5cf68488e8bfffe967139e9ad: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:17.611749 16632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da864dd5cf68488e8bfffe967139e9ad: No bootstrap required, opened a new log
I20260809 20:16:17.612470 16636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:17.601590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43893 (local address 127.0.0.1:37217)
0809 20:16:17.602373 (+ 783us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:17.602387 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:17.602432 (+ 45us) server_negotiation.cc:407] Connection header received
0809 20:16:17.604098 (+ 1666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:17.604120 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:17.604480 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:17.604805 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:17.605357 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:17.606687 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:17.608428 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:17.609059 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:17.609203 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:17.610390 (+ 1187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:17.610399 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:17.610412 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:17.610920 (+ 508us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:17.610990 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:17.611014 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:17.611094 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:17.611298 (+ 204us) server_negotiation.cc:299] Negotiation successful
0809 20:16:17.611515 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":564,"thread_start_us":372,"threads_started":1}
I20260809 20:16:17.615875 15060 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 20:16:17.619414 16632 raft_consensus.cc:348] T 00000000000000000000000000000000 P da864dd5cf68488e8bfffe967139e9ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da864dd5cf68488e8bfffe967139e9ad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37217 } }
I20260809 20:16:17.619796 16632 raft_consensus.cc:374] T 00000000000000000000000000000000 P da864dd5cf68488e8bfffe967139e9ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:17.619911 16632 raft_consensus.cc:729] T 00000000000000000000000000000000 P da864dd5cf68488e8bfffe967139e9ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da864dd5cf68488e8bfffe967139e9ad, State: Initialized, Role: FOLLOWER
I20260809 20:16:17.620566 16632 consensus_queue.cc:260] T 00000000000000000000000000000000 P da864dd5cf68488e8bfffe967139e9ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da864dd5cf68488e8bfffe967139e9ad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37217 } }
I20260809 20:16:17.620846 16632 raft_consensus.cc:388] T 00000000000000000000000000000000 P da864dd5cf68488e8bfffe967139e9ad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:16:17.620991 16632 raft_consensus.cc:482] T 00000000000000000000000000000000 P da864dd5cf68488e8bfffe967139e9ad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:16:17.621183 16632 raft_consensus.cc:3037] T 00000000000000000000000000000000 P da864dd5cf68488e8bfffe967139e9ad [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:17.624006 16632 raft_consensus.cc:504] T 00000000000000000000000000000000 P da864dd5cf68488e8bfffe967139e9ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da864dd5cf68488e8bfffe967139e9ad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37217 } }
I20260809 20:16:17.624550 16632 leader_election.cc:302] T 00000000000000000000000000000000 P da864dd5cf68488e8bfffe967139e9ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: da864dd5cf68488e8bfffe967139e9ad; no voters:
I20260809 20:16:17.625171 16632 leader_election.cc:288] T 00000000000000000000000000000000 P da864dd5cf68488e8bfffe967139e9ad [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:16:17.625281 16649 raft_consensus.cc:2781] T 00000000000000000000000000000000 P da864dd5cf68488e8bfffe967139e9ad [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:16:17.626701 16636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:17.619941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60867 (local address 127.0.0.1:37217)
0809 20:16:17.620101 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:17.620106 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:17.620408 (+ 302us) server_negotiation.cc:407] Connection header received
0809 20:16:17.620578 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:17.620581 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:17.620631 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:17.620712 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:17.621325 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:17.622011 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:17.623892 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:17.624360 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:17.624448 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:17.625562 (+ 1114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:17.625568 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:17.625572 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:17.625590 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:17.625637 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:17.625660 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:17.625748 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:17.626215 (+ 467us) server_negotiation.cc:299] Negotiation successful
0809 20:16:17.626313 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 20:16:17.626470 16649 raft_consensus.cc:686] T 00000000000000000000000000000000 P da864dd5cf68488e8bfffe967139e9ad [term 1 LEADER]: Becoming Leader. State: Replica: da864dd5cf68488e8bfffe967139e9ad, State: Running, Role: LEADER
I20260809 20:16:17.627338 16632 sys_catalog.cc:564] T 00000000000000000000000000000000 P da864dd5cf68488e8bfffe967139e9ad [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:16:17.627348 16649 consensus_queue.cc:237] T 00000000000000000000000000000000 P da864dd5cf68488e8bfffe967139e9ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da864dd5cf68488e8bfffe967139e9ad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37217 } }
I20260809 20:16:17.629866 16652 sys_catalog.cc:455] T 00000000000000000000000000000000 P da864dd5cf68488e8bfffe967139e9ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader da864dd5cf68488e8bfffe967139e9ad. Latest consensus state: current_term: 1 leader_uuid: "da864dd5cf68488e8bfffe967139e9ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da864dd5cf68488e8bfffe967139e9ad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37217 } } }
I20260809 20:16:17.630250 16652 sys_catalog.cc:458] T 00000000000000000000000000000000 P da864dd5cf68488e8bfffe967139e9ad [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:17.630119 16650 sys_catalog.cc:455] T 00000000000000000000000000000000 P da864dd5cf68488e8bfffe967139e9ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "da864dd5cf68488e8bfffe967139e9ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da864dd5cf68488e8bfffe967139e9ad" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37217 } } }
I20260809 20:16:17.630788 16650 sys_catalog.cc:458] T 00000000000000000000000000000000 P da864dd5cf68488e8bfffe967139e9ad [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:17.641022 16664 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:16:17.645937 16664 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:16:17.654206 16664 catalog_manager.cc:1347] Generated new cluster ID: c9699f9a2f854093ba264bb3ec19f59e
I20260809 20:16:17.654361 16664 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:16:17.678251 16664 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:16:17.679632 16664 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:16:17.687784 16664 catalog_manager.cc:5868] T 00000000000000000000000000000000 P da864dd5cf68488e8bfffe967139e9ad: Generated new TSK 0
I20260809 20:16:17.688493 16664 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:16:17.699811 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 16523
W20260809 20:16:17.700811 16626 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:43893
W20260809 20:16:17.701412 15060 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 16523: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 20:16:17.701562 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 16523
2026-08-09T20:16:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1994 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:16:17 dist-test-slave-6zbq krb5kdc[16693](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:16:17 dist-test-slave-6zbq krb5kdc[16693](info): set up 2 sockets
Aug 09 20:16:17 dist-test-slave-6zbq krb5kdc[16693](info): commencing operation
krb5kdc: starting...
W20260809 20:16:18.903761 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.000s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:16:19 dist-test-slave-6zbq krb5kdc[16693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306579, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:16:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:16:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 20:16:19.150388 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44559
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44559
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:16:19.464166 16715 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:19.464413 16715 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:19.464512 16715 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:19.471463 16715 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:16:19.471560 16715 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:19.471611 16715 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:19.471668 16715 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:16:19.471710 16715 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:16:19.480922 16715 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44559
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:19.481976 16715 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:19.483157 16715 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:19.494130 16736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:19.494223 16731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:19.494243 16733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:19.495119 16715 server_base.cc:1034] running on GCE node
I20260809 20:16:19.495823 16715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:19.497051 16715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:19.498250 16715 hybrid_clock.cc:648] HybridClock initialized: now 1786306579498213 us; error 25 us; skew 500 ppm
I20260809 20:16:19.498582 16715 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:16:19 dist-test-slave-6zbq krb5kdc[16693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306579, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:16:19.504640 16715 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 20:16:19.506166 16715 webserver.cc:460] Webserver started at http://127.0.0.1:43369/ using document root <none> and password file <none>
I20260809 20:16:19.506840 16715 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:19.506994 16715 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:19.507298 16715 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:19.510107 16715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "648b3d2cb379408b92ab5150e2115b04"
format_stamp: "Formatted at 2026-08-09 20:16:19 on dist-test-slave-6zbq"
server_key: "76c2a01073fb1ff1236856e256c92caf"
server_key_iv: "cc415977de3b5b103dc62247813f2cd1"
server_key_version: "encryptionkey@0"
I20260809 20:16:19.510860 16715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "648b3d2cb379408b92ab5150e2115b04"
format_stamp: "Formatted at 2026-08-09 20:16:19 on dist-test-slave-6zbq"
server_key: "76c2a01073fb1ff1236856e256c92caf"
server_key_iv: "cc415977de3b5b103dc62247813f2cd1"
server_key_version: "encryptionkey@0"
I20260809 20:16:19.515581 16715 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260809 20:16:19.518723 16745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:19.519887 16715 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.002s
I20260809 20:16:19.520040 16715 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "648b3d2cb379408b92ab5150e2115b04"
format_stamp: "Formatted at 2026-08-09 20:16:19 on dist-test-slave-6zbq"
server_key: "76c2a01073fb1ff1236856e256c92caf"
server_key_iv: "cc415977de3b5b103dc62247813f2cd1"
server_key_version: "encryptionkey@0"
I20260809 20:16:19.520223 16715 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:19.525502 16715 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:19.529479 16715 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:19.529748 16715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:19.546212 16715 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44559
I20260809 20:16:19.546271 16827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44559 every 8 connection(s)
I20260809 20:16:19.547477 16715 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:16:19.550938 16829 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:19.551978 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 16715
I20260809 20:16:19.552165 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:16:19.552721 15060 external_mini_cluster.cc:1428] Setting key 5ce88a3a59d135db09427cc87ce30685
I20260809 20:16:19.560089 16835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:19.554502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36907 (local address 127.0.0.1:44559)
0809 20:16:19.555288 (+ 786us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:19.555302 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:19.555344 (+ 42us) server_negotiation.cc:407] Connection header received
0809 20:16:19.556942 (+ 1598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:19.556963 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:19.557299 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:19.557605 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:19.558632 (+ 1027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:19.558641 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:19.558654 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:19.558670 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:19.558742 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:19.558771 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:19.558960 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:19.559058 (+ 98us) server_negotiation.cc:299] Negotiation successful
0809 20:16:19.559239 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":351,"threads_started":1}
I20260809 20:16:19.563784 15060 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 20:16:19.564051 16829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 648b3d2cb379408b92ab5150e2115b04: Bootstrap starting.
I20260809 20:16:19.567754 16829 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 648b3d2cb379408b92ab5150e2115b04: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:19.569000 16829 log.cc:824] T 00000000000000000000000000000000 P 648b3d2cb379408b92ab5150e2115b04: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:19.571094 16835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:19.568814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32909 (local address 127.0.0.1:44559)
0809 20:16:19.568950 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:19.568954 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:19.569333 (+ 379us) server_negotiation.cc:407] Connection header received
0809 20:16:19.569513 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:19.569519 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:19.569581 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:19.569694 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:19.570513 (+ 819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:19.570519 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:19.570524 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:19.570540 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:19.570583 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:19.570601 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:19.570734 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:19.570778 (+ 44us) server_negotiation.cc:299] Negotiation successful
0809 20:16:19.570832 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 20:16:19.572130 16829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 648b3d2cb379408b92ab5150e2115b04: No bootstrap required, opened a new log
I20260809 20:16:19.579139 16829 raft_consensus.cc:348] T 00000000000000000000000000000000 P 648b3d2cb379408b92ab5150e2115b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "648b3d2cb379408b92ab5150e2115b04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44559 } }
I20260809 20:16:19.579486 16829 raft_consensus.cc:374] T 00000000000000000000000000000000 P 648b3d2cb379408b92ab5150e2115b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:19.579576 16829 raft_consensus.cc:729] T 00000000000000000000000000000000 P 648b3d2cb379408b92ab5150e2115b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 648b3d2cb379408b92ab5150e2115b04, State: Initialized, Role: FOLLOWER
I20260809 20:16:19.580116 16829 consensus_queue.cc:260] T 00000000000000000000000000000000 P 648b3d2cb379408b92ab5150e2115b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "648b3d2cb379408b92ab5150e2115b04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44559 } }
I20260809 20:16:19.580338 16829 raft_consensus.cc:388] T 00000000000000000000000000000000 P 648b3d2cb379408b92ab5150e2115b04 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:16:19.580466 16829 raft_consensus.cc:482] T 00000000000000000000000000000000 P 648b3d2cb379408b92ab5150e2115b04 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:16:19.580610 16829 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 648b3d2cb379408b92ab5150e2115b04 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:19.582861 16829 raft_consensus.cc:504] T 00000000000000000000000000000000 P 648b3d2cb379408b92ab5150e2115b04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "648b3d2cb379408b92ab5150e2115b04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44559 } }
I20260809 20:16:19.583314 16829 leader_election.cc:302] T 00000000000000000000000000000000 P 648b3d2cb379408b92ab5150e2115b04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 648b3d2cb379408b92ab5150e2115b04; no voters:
I20260809 20:16:19.583827 16829 leader_election.cc:288] T 00000000000000000000000000000000 P 648b3d2cb379408b92ab5150e2115b04 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:16:19.583947 16845 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 648b3d2cb379408b92ab5150e2115b04 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:16:19.584533 16845 raft_consensus.cc:686] T 00000000000000000000000000000000 P 648b3d2cb379408b92ab5150e2115b04 [term 1 LEADER]: Becoming Leader. State: Replica: 648b3d2cb379408b92ab5150e2115b04, State: Running, Role: LEADER
I20260809 20:16:19.585079 16845 consensus_queue.cc:237] T 00000000000000000000000000000000 P 648b3d2cb379408b92ab5150e2115b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "648b3d2cb379408b92ab5150e2115b04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44559 } }
I20260809 20:16:19.585654 16829 sys_catalog.cc:564] T 00000000000000000000000000000000 P 648b3d2cb379408b92ab5150e2115b04 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:16:19.587778 16847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 648b3d2cb379408b92ab5150e2115b04 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "648b3d2cb379408b92ab5150e2115b04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "648b3d2cb379408b92ab5150e2115b04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44559 } } }
I20260809 20:16:19.587826 16848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 648b3d2cb379408b92ab5150e2115b04 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 648b3d2cb379408b92ab5150e2115b04. Latest consensus state: current_term: 1 leader_uuid: "648b3d2cb379408b92ab5150e2115b04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "648b3d2cb379408b92ab5150e2115b04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44559 } } }
I20260809 20:16:19.588255 16847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 648b3d2cb379408b92ab5150e2115b04 [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:19.588269 16848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 648b3d2cb379408b92ab5150e2115b04 [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:19.589152 16855 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:16:19.595922 16855 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:16:19.609560 16855 catalog_manager.cc:1347] Generated new cluster ID: 397405e17361445d9bed682e80fd0b9c
I20260809 20:16:19.609654 16855 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:16:19.661624 16855 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:16:19.662019 16855 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:16:19.670856 16855 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 648b3d2cb379408b92ab5150e2115b04: Generated new TSK 0
I20260809 20:16:19.671540 16855 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:16:19.677666 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 16715
W20260809 20:16:19.678810 16822 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:36907
W20260809 20:16:19.679477 15060 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 16715: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 20:16:19.679629 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 16715
2026-08-09T20:16:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1977 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:16:19 dist-test-slave-6zbq krb5kdc[16874](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:16:19 dist-test-slave-6zbq krb5kdc[16874](info): set up 2 sockets
Aug 09 20:16:19 dist-test-slave-6zbq krb5kdc[16874](info): commencing operation
krb5kdc: starting...
W20260809 20:16:20.911324 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.187s user 0.002s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:16:21 dist-test-slave-6zbq krb5kdc[16874](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306581, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:16:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:16:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 20:16:21.194761 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37927
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37927
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:16:21.517808 16896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:21.518085 16896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:21.518219 16896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:21.525355 16896 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:16:21.525457 16896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:21.525532 16896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:21.525606 16896 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:16:21.525655 16896 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:16:21.535238 16896 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37927
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:21.536499 16896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:21.537762 16896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:21.549001 16903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:21.549041 16907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:21.549381 16902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:21.549773 16896 server_base.cc:1034] running on GCE node
I20260809 20:16:21.550555 16896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:21.551940 16896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:21.553191 16896 hybrid_clock.cc:648] HybridClock initialized: now 1786306581553132 us; error 40 us; skew 500 ppm
I20260809 20:16:21.553547 16896 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:16:21 dist-test-slave-6zbq krb5kdc[16874](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306581, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:16:21.556613 16896 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 20:16:21.558063 16896 webserver.cc:460] Webserver started at http://127.0.0.1:46135/ using document root <none> and password file <none>
I20260809 20:16:21.558826 16896 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:21.558954 16896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:21.559242 16896 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:21.562182 16896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "14c272c6a19d4abeaea3bfc7b5134342"
format_stamp: "Formatted at 2026-08-09 20:16:21 on dist-test-slave-6zbq"
server_key: "7ff8d7fc8feb5e041fc61c1249524cb5"
server_key_iv: "3d5a2a5534775820111347e23a61a9a5"
server_key_version: "encryptionkey@0"
I20260809 20:16:21.562992 16896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "14c272c6a19d4abeaea3bfc7b5134342"
format_stamp: "Formatted at 2026-08-09 20:16:21 on dist-test-slave-6zbq"
server_key: "7ff8d7fc8feb5e041fc61c1249524cb5"
server_key_iv: "3d5a2a5534775820111347e23a61a9a5"
server_key_version: "encryptionkey@0"
I20260809 20:16:21.568010 16896 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 20:16:21.571485 16925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:21.572734 16896 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 20:16:21.572887 16896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "14c272c6a19d4abeaea3bfc7b5134342"
format_stamp: "Formatted at 2026-08-09 20:16:21 on dist-test-slave-6zbq"
server_key: "7ff8d7fc8feb5e041fc61c1249524cb5"
server_key_iv: "3d5a2a5534775820111347e23a61a9a5"
server_key_version: "encryptionkey@0"
I20260809 20:16:21.573061 16896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:21.589676 16896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:21.593441 16896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:21.593695 16896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:21.610549 16896 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37927
I20260809 20:16:21.610579 17007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37927 every 8 connection(s)
I20260809 20:16:21.611780 16896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:16:21.615183 17012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:21.620394 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 16896
I20260809 20:16:21.620565 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:16:21.621117 15060 external_mini_cluster.cc:1428] Setting key 55d2fdd6a5c1742e35ec36386378669f
I20260809 20:16:21.625608 17012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14c272c6a19d4abeaea3bfc7b5134342: Bootstrap starting.
I20260809 20:16:21.628952 17012 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 14c272c6a19d4abeaea3bfc7b5134342: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:21.630151 17012 log.cc:824] T 00000000000000000000000000000000 P 14c272c6a19d4abeaea3bfc7b5134342: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:21.633239 17012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14c272c6a19d4abeaea3bfc7b5134342: No bootstrap required, opened a new log
Aug 09 20:16:21 dist-test-slave-6zbq krb5kdc[16874](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306581, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 20:16:21.641978 17012 raft_consensus.cc:348] T 00000000000000000000000000000000 P 14c272c6a19d4abeaea3bfc7b5134342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14c272c6a19d4abeaea3bfc7b5134342" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37927 } }
I20260809 20:16:21.642447 17012 raft_consensus.cc:374] T 00000000000000000000000000000000 P 14c272c6a19d4abeaea3bfc7b5134342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:21.642554 17012 raft_consensus.cc:729] T 00000000000000000000000000000000 P 14c272c6a19d4abeaea3bfc7b5134342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14c272c6a19d4abeaea3bfc7b5134342, State: Initialized, Role: FOLLOWER
I20260809 20:16:21.643167 17012 consensus_queue.cc:260] T 00000000000000000000000000000000 P 14c272c6a19d4abeaea3bfc7b5134342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14c272c6a19d4abeaea3bfc7b5134342" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37927 } }
I20260809 20:16:21.643422 17012 raft_consensus.cc:388] T 00000000000000000000000000000000 P 14c272c6a19d4abeaea3bfc7b5134342 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:16:21.643553 17012 raft_consensus.cc:482] T 00000000000000000000000000000000 P 14c272c6a19d4abeaea3bfc7b5134342 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:16:21.643714 17012 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 14c272c6a19d4abeaea3bfc7b5134342 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:21.643883 17018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:21.622817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.181:57605 (local address 127.0.0.1:37927)
0809 20:16:21.623603 (+ 786us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:21.623614 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:21.623652 (+ 38us) server_negotiation.cc:407] Connection header received
0809 20:16:21.625240 (+ 1588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:21.625261 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:21.625615 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:21.625929 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:21.627601 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:21.628845 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:21.630655 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:21.631637 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:21.631763 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:21.636542 (+ 4779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:21.636550 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:21.636563 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:21.636601 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:21.639656 (+ 3055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:21.640554 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:21.640561 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:21.640570 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:21.640731 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:21.641188 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:21.641195 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:21.641197 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:21.641681 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:21.641901 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:21.642443 (+ 542us) server_negotiation.cc:299] Negotiation successful
0809 20:16:21.642781 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":352,"threads_started":1}
I20260809 20:16:21.646647 17012 raft_consensus.cc:504] T 00000000000000000000000000000000 P 14c272c6a19d4abeaea3bfc7b5134342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14c272c6a19d4abeaea3bfc7b5134342" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37927 } }
I20260809 20:16:21.647186 17012 leader_election.cc:302] T 00000000000000000000000000000000 P 14c272c6a19d4abeaea3bfc7b5134342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 14c272c6a19d4abeaea3bfc7b5134342; no voters:
I20260809 20:16:21.647781 17012 leader_election.cc:288] T 00000000000000000000000000000000 P 14c272c6a19d4abeaea3bfc7b5134342 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:16:21.647836 15060 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 20:16:21.647881 17021 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 14c272c6a19d4abeaea3bfc7b5134342 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:16:21.650049 17012 sys_catalog.cc:564] T 00000000000000000000000000000000 P 14c272c6a19d4abeaea3bfc7b5134342 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:16:21.650678 17021 raft_consensus.cc:686] T 00000000000000000000000000000000 P 14c272c6a19d4abeaea3bfc7b5134342 [term 1 LEADER]: Becoming Leader. State: Replica: 14c272c6a19d4abeaea3bfc7b5134342, State: Running, Role: LEADER
I20260809 20:16:21.651305 17021 consensus_queue.cc:237] T 00000000000000000000000000000000 P 14c272c6a19d4abeaea3bfc7b5134342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14c272c6a19d4abeaea3bfc7b5134342" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37927 } }
I20260809 20:16:21.653959 17023 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14c272c6a19d4abeaea3bfc7b5134342 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 14c272c6a19d4abeaea3bfc7b5134342. Latest consensus state: current_term: 1 leader_uuid: "14c272c6a19d4abeaea3bfc7b5134342" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14c272c6a19d4abeaea3bfc7b5134342" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37927 } } }
I20260809 20:16:21.654332 17023 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14c272c6a19d4abeaea3bfc7b5134342 [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:21.654879 17022 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14c272c6a19d4abeaea3bfc7b5134342 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "14c272c6a19d4abeaea3bfc7b5134342" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14c272c6a19d4abeaea3bfc7b5134342" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37927 } } }
I20260809 20:16:21.655205 17022 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14c272c6a19d4abeaea3bfc7b5134342 [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:21.662918 17039 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:16:21.668146 17039 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:16:21.684082 17039 catalog_manager.cc:1347] Generated new cluster ID: 5e534eea37704694911cf6e8d27fd9ba
I20260809 20:16:21.684190 17039 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:16:21.687969 17018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:21.665283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.181:54963 (local address 127.0.0.1:37927)
0809 20:16:21.665497 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:21.665503 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:21.671800 (+ 6297us) server_negotiation.cc:407] Connection header received
0809 20:16:21.671982 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:21.671988 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:21.672094 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:21.672221 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:21.674152 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:21.675390 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:21.677305 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:21.678010 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:21.678102 (+ 92us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:21.681573 (+ 3471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:21.681580 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:21.681585 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:21.681632 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:21.684997 (+ 3365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:21.685850 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:21.685853 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:21.685856 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:21.685970 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:21.686378 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:21.686383 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:21.686386 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:21.686819 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:21.687131 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:21.687414 (+ 283us) server_negotiation.cc:299] Negotiation successful
0809 20:16:21.687610 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 20:16:21.698966 17039 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:16:21.700727 17039 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:16:21.716213 17039 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 14c272c6a19d4abeaea3bfc7b5134342: Generated new TSK 0
I20260809 20:16:21.717276 17039 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:16:21.731539 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 16896
I20260809 20:16:21.733235 17002 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:16:21.822536 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 16896
W20260809 20:16:21.846029 16870 connection.cc:535] client connection to 127.0.0.1:37927 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37927): Connection reset by peer (error 104)
2026-08-09T20:16:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2140 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:16:21 dist-test-slave-6zbq krb5kdc[17064](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:16:21 dist-test-slave-6zbq krb5kdc[17064](info): set up 2 sockets
Aug 09 20:16:21 dist-test-slave-6zbq krb5kdc[17064](info): commencing operation
krb5kdc: starting...
W20260809 20:16:23.056417 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.192s user 0.000s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:16:23 dist-test-slave-6zbq krb5kdc[17064](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306583, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:16:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:16:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 20:16:23.301415 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42339
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42339
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:16:23.612524 17085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:23.612787 17085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:23.612922 17085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:23.619755 17085 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:16:23.619859 17085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:23.619936 17085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:23.620019 17085 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:16:23.620080 17085 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:16:23.629139 17085 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42339
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:23.630195 17085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:23.631361 17085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:23.641855 17091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:23.641918 17092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:23.641889 17094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:23.642732 17085 server_base.cc:1034] running on GCE node
I20260809 20:16:23.643407 17085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:23.644564 17085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:23.645766 17085 hybrid_clock.cc:648] HybridClock initialized: now 1786306583645716 us; error 33 us; skew 500 ppm
I20260809 20:16:23.646070 17085 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:16:23 dist-test-slave-6zbq krb5kdc[17064](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306583, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:16:23.648926 17085 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 20:16:23.650169 17085 webserver.cc:460] Webserver started at http://127.0.0.1:41453/ using document root <none> and password file <none>
I20260809 20:16:23.650774 17085 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:23.650873 17085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:23.651098 17085 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:23.653831 17085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "cdce6046752c42e5a113e66da11d88d8"
format_stamp: "Formatted at 2026-08-09 20:16:23 on dist-test-slave-6zbq"
server_key: "22524e4a82d2199b8a46b2f92ce04f8a"
server_key_iv: "8a2d7bef6be877cb71e2a007b4f7d550"
server_key_version: "encryptionkey@0"
I20260809 20:16:23.654523 17085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "cdce6046752c42e5a113e66da11d88d8"
format_stamp: "Formatted at 2026-08-09 20:16:23 on dist-test-slave-6zbq"
server_key: "22524e4a82d2199b8a46b2f92ce04f8a"
server_key_iv: "8a2d7bef6be877cb71e2a007b4f7d550"
server_key_version: "encryptionkey@0"
I20260809 20:16:23.659155 17085 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 20:16:23.662139 17106 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:23.663314 17085 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 20:16:23.663447 17085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "cdce6046752c42e5a113e66da11d88d8"
format_stamp: "Formatted at 2026-08-09 20:16:23 on dist-test-slave-6zbq"
server_key: "22524e4a82d2199b8a46b2f92ce04f8a"
server_key_iv: "8a2d7bef6be877cb71e2a007b4f7d550"
server_key_version: "encryptionkey@0"
I20260809 20:16:23.663591 17085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:23.675594 17085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:23.679406 17085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:23.679610 17085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:23.695858 17085 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42339
I20260809 20:16:23.695894 17194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42339 every 8 connection(s)
I20260809 20:16:23.697081 17085 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:16:23.700388 17198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:23.700712 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 17085
I20260809 20:16:23.700891 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:16:23.701453 15060 external_mini_cluster.cc:1428] Setting key 08786460a8f833b1a06c98d306ca65a0
I20260809 20:16:23.712824 17198 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdce6046752c42e5a113e66da11d88d8: Bootstrap starting.
I20260809 20:16:23.714282 17204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:23.703049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.181:35999 (local address 127.0.0.1:42339)
0809 20:16:23.703786 (+ 737us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:23.703796 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:23.703834 (+ 38us) server_negotiation.cc:407] Connection header received
0809 20:16:23.706068 (+ 2234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:23.706088 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:23.706478 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:23.706788 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:23.707340 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:23.708508 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:23.710297 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:23.710987 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:23.711112 (+ 125us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:23.712278 (+ 1166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:23.712286 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:23.712297 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:23.712765 (+ 468us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:23.712836 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:23.712859 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:23.712997 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:23.713248 (+ 251us) server_negotiation.cc:299] Negotiation successful
0809 20:16:23.713417 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":537,"thread_start_us":343,"threads_started":1}
I20260809 20:16:23.716018 17198 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cdce6046752c42e5a113e66da11d88d8: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:23.717128 17198 log.cc:824] T 00000000000000000000000000000000 P cdce6046752c42e5a113e66da11d88d8: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:23.717892 15060 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 20:16:23.719913 17198 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdce6046752c42e5a113e66da11d88d8: No bootstrap required, opened a new log
I20260809 20:16:23.727715 17198 raft_consensus.cc:348] T 00000000000000000000000000000000 P cdce6046752c42e5a113e66da11d88d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdce6046752c42e5a113e66da11d88d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42339 } }
I20260809 20:16:23.728080 17198 raft_consensus.cc:374] T 00000000000000000000000000000000 P cdce6046752c42e5a113e66da11d88d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:23.728247 17198 raft_consensus.cc:729] T 00000000000000000000000000000000 P cdce6046752c42e5a113e66da11d88d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdce6046752c42e5a113e66da11d88d8, State: Initialized, Role: FOLLOWER
I20260809 20:16:23.728296 17204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:23.722694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.181:54837 (local address 127.0.0.1:42339)
0809 20:16:23.722862 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:23.722871 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:23.723167 (+ 296us) server_negotiation.cc:407] Connection header received
0809 20:16:23.723333 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:23.723337 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:23.723393 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:23.723477 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:23.723978 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:23.724713 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:23.725947 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:23.726435 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:23.726554 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:23.727557 (+ 1003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:23.727562 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:23.727565 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:23.727580 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:23.727626 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:23.727641 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:23.727737 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:23.727915 (+ 178us) server_negotiation.cc:299] Negotiation successful
0809 20:16:23.727963 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 20:16:23.728839 17198 consensus_queue.cc:260] T 00000000000000000000000000000000 P cdce6046752c42e5a113e66da11d88d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdce6046752c42e5a113e66da11d88d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42339 } }
I20260809 20:16:23.729072 17198 raft_consensus.cc:388] T 00000000000000000000000000000000 P cdce6046752c42e5a113e66da11d88d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:16:23.729204 17198 raft_consensus.cc:482] T 00000000000000000000000000000000 P cdce6046752c42e5a113e66da11d88d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:16:23.729358 17198 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cdce6046752c42e5a113e66da11d88d8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:23.731415 17198 raft_consensus.cc:504] T 00000000000000000000000000000000 P cdce6046752c42e5a113e66da11d88d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdce6046752c42e5a113e66da11d88d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42339 } }
I20260809 20:16:23.731801 17198 leader_election.cc:302] T 00000000000000000000000000000000 P cdce6046752c42e5a113e66da11d88d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cdce6046752c42e5a113e66da11d88d8; no voters:
I20260809 20:16:23.732266 17198 leader_election.cc:288] T 00000000000000000000000000000000 P cdce6046752c42e5a113e66da11d88d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:16:23.732380 17213 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cdce6046752c42e5a113e66da11d88d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:16:23.732998 17213 raft_consensus.cc:686] T 00000000000000000000000000000000 P cdce6046752c42e5a113e66da11d88d8 [term 1 LEADER]: Becoming Leader. State: Replica: cdce6046752c42e5a113e66da11d88d8, State: Running, Role: LEADER
I20260809 20:16:23.733474 17213 consensus_queue.cc:237] T 00000000000000000000000000000000 P cdce6046752c42e5a113e66da11d88d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdce6046752c42e5a113e66da11d88d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42339 } }
I20260809 20:16:23.734037 17198 sys_catalog.cc:564] T 00000000000000000000000000000000 P cdce6046752c42e5a113e66da11d88d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:16:23.736102 17215 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdce6046752c42e5a113e66da11d88d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cdce6046752c42e5a113e66da11d88d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdce6046752c42e5a113e66da11d88d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42339 } } }
I20260809 20:16:23.736490 17215 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdce6046752c42e5a113e66da11d88d8 [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:23.736948 17216 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdce6046752c42e5a113e66da11d88d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cdce6046752c42e5a113e66da11d88d8. Latest consensus state: current_term: 1 leader_uuid: "cdce6046752c42e5a113e66da11d88d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdce6046752c42e5a113e66da11d88d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42339 } } }
I20260809 20:16:23.737241 17216 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdce6046752c42e5a113e66da11d88d8 [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:23.737349 17223 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:16:23.745498 17223 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:16:23.756137 17223 catalog_manager.cc:1347] Generated new cluster ID: 783dbad3a7ea4857b222130577547269
I20260809 20:16:23.756234 17223 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:16:23.768471 17223 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:16:23.770166 17223 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:16:23.777134 17223 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cdce6046752c42e5a113e66da11d88d8: Generated new TSK 0
I20260809 20:16:23.777771 17223 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:16:23.784713 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 17085
W20260809 20:16:23.785949 17190 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.181:35999
W20260809 20:16:23.786597 15060 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 17085: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 20:16:23.786720 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 17085
W20260809 20:16:23.812114 17059 connection.cc:535] client connection to 127.0.0.1:42339 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42339): Connection reset by peer (error 104)
2026-08-09T20:16:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1965 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:16:23 dist-test-slave-6zbq krb5kdc[17243](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:16:23 dist-test-slave-6zbq krb5kdc[17243](info): set up 2 sockets
Aug 09 20:16:23 dist-test-slave-6zbq krb5kdc[17243](info): commencing operation
krb5kdc: starting...
W20260809 20:16:25.015817 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.186s user 0.004s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:16:25 dist-test-slave-6zbq krb5kdc[17243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:16:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:16:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 20:16:25.269021 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35399
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35399
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:16:25.593487 17265 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:25.593730 17265 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:25.593863 17265 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:25.600710 17265 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:16:25.600814 17265 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:25.600888 17265 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:25.600970 17265 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:16:25.601032 17265 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:16:25.610450 17265 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35399
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35399
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:25.611519 17265 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:25.612690 17265 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:25.623564 17271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:25.623521 17276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:25.623600 17272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:25.624433 17265 server_base.cc:1034] running on GCE node
I20260809 20:16:25.625077 17265 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:25.626284 17265 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:25.627537 17265 hybrid_clock.cc:648] HybridClock initialized: now 1786306585627490 us; error 34 us; skew 500 ppm
I20260809 20:16:25.627866 17265 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:16:25 dist-test-slave-6zbq krb5kdc[17243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306585, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:16:25.634066 17265 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 20:16:25.635469 17265 webserver.cc:460] Webserver started at http://127.0.0.1:35493/ using document root <none> and password file <none>
I20260809 20:16:25.636019 17265 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:25.636114 17265 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:25.636358 17265 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:25.639117 17265 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "553ad856638544cebc2091d15adab57c"
format_stamp: "Formatted at 2026-08-09 20:16:25 on dist-test-slave-6zbq"
server_key: "87c23f582a7ccbcdc16e624e523996ac"
server_key_iv: "8e41b488a899508165b819a8b12241ab"
server_key_version: "encryptionkey@0"
I20260809 20:16:25.639812 17265 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "553ad856638544cebc2091d15adab57c"
format_stamp: "Formatted at 2026-08-09 20:16:25 on dist-test-slave-6zbq"
server_key: "87c23f582a7ccbcdc16e624e523996ac"
server_key_iv: "8e41b488a899508165b819a8b12241ab"
server_key_version: "encryptionkey@0"
I20260809 20:16:25.644465 17265 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 20:16:25.647595 17286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:25.648759 17265 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 20:16:25.648898 17265 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "553ad856638544cebc2091d15adab57c"
format_stamp: "Formatted at 2026-08-09 20:16:25 on dist-test-slave-6zbq"
server_key: "87c23f582a7ccbcdc16e624e523996ac"
server_key_iv: "8e41b488a899508165b819a8b12241ab"
server_key_version: "encryptionkey@0"
I20260809 20:16:25.649051 17265 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:25.654407 17265 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:25.658169 17265 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:25.658421 17265 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:25.675045 17265 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35399
I20260809 20:16:25.675100 17371 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35399 every 8 connection(s)
I20260809 20:16:25.676263 17265 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:16:25.679597 17372 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:25.681916 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 17265
I20260809 20:16:25.682096 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:16:25.682648 15060 external_mini_cluster.cc:1428] Setting key ade815720056e1e7eb4448647813bc86
I20260809 20:16:25.689713 17381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:25.684314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.181:43165 (local address 127.0.0.1:35399)
0809 20:16:25.685095 (+ 781us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:25.685106 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:25.685147 (+ 41us) server_negotiation.cc:407] Connection header received
0809 20:16:25.686774 (+ 1627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:25.686795 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:25.687085 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:25.687395 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:25.688307 (+ 912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:25.688313 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:25.688324 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:25.688337 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:25.688396 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:25.688423 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:25.688587 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:25.688696 (+ 109us) server_negotiation.cc:299] Negotiation successful
0809 20:16:25.688865 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":570,"thread_start_us":353,"threads_started":1}
I20260809 20:16:25.690806 17372 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 553ad856638544cebc2091d15adab57c: Bootstrap starting.
I20260809 20:16:25.692978 15060 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 20:16:25.693769 17372 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 553ad856638544cebc2091d15adab57c: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:25.694929 17372 log.cc:824] T 00000000000000000000000000000000 P 553ad856638544cebc2091d15adab57c: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:25.697840 17372 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 553ad856638544cebc2091d15adab57c: No bootstrap required, opened a new log
I20260809 20:16:25.699862 17381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:25.697674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.181:60435 (local address 127.0.0.1:35399)
0809 20:16:25.697853 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:25.697858 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:25.698265 (+ 407us) server_negotiation.cc:407] Connection header received
0809 20:16:25.698390 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:25.698395 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:25.698447 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:25.698552 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:25.699290 (+ 738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:25.699295 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:25.699299 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:25.699316 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:25.699355 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:25.699372 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:25.699485 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:25.699532 (+ 47us) server_negotiation.cc:299] Negotiation successful
0809 20:16:25.699586 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 20:16:25.705515 17372 raft_consensus.cc:348] T 00000000000000000000000000000000 P 553ad856638544cebc2091d15adab57c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "553ad856638544cebc2091d15adab57c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35399 } }
I20260809 20:16:25.705819 17372 raft_consensus.cc:374] T 00000000000000000000000000000000 P 553ad856638544cebc2091d15adab57c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:25.705888 17372 raft_consensus.cc:729] T 00000000000000000000000000000000 P 553ad856638544cebc2091d15adab57c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 553ad856638544cebc2091d15adab57c, State: Initialized, Role: FOLLOWER
I20260809 20:16:25.706358 17372 consensus_queue.cc:260] T 00000000000000000000000000000000 P 553ad856638544cebc2091d15adab57c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "553ad856638544cebc2091d15adab57c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35399 } }
I20260809 20:16:25.706635 17372 raft_consensus.cc:388] T 00000000000000000000000000000000 P 553ad856638544cebc2091d15adab57c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:16:25.706763 17372 raft_consensus.cc:482] T 00000000000000000000000000000000 P 553ad856638544cebc2091d15adab57c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:16:25.706915 17372 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 553ad856638544cebc2091d15adab57c [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:25.708868 17372 raft_consensus.cc:504] T 00000000000000000000000000000000 P 553ad856638544cebc2091d15adab57c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "553ad856638544cebc2091d15adab57c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35399 } }
I20260809 20:16:25.709304 17372 leader_election.cc:302] T 00000000000000000000000000000000 P 553ad856638544cebc2091d15adab57c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 553ad856638544cebc2091d15adab57c; no voters:
I20260809 20:16:25.709784 17372 leader_election.cc:288] T 00000000000000000000000000000000 P 553ad856638544cebc2091d15adab57c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:16:25.709888 17393 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 553ad856638544cebc2091d15adab57c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:16:25.710502 17393 raft_consensus.cc:686] T 00000000000000000000000000000000 P 553ad856638544cebc2091d15adab57c [term 1 LEADER]: Becoming Leader. State: Replica: 553ad856638544cebc2091d15adab57c, State: Running, Role: LEADER
I20260809 20:16:25.711022 17393 consensus_queue.cc:237] T 00000000000000000000000000000000 P 553ad856638544cebc2091d15adab57c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "553ad856638544cebc2091d15adab57c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35399 } }
I20260809 20:16:25.711524 17372 sys_catalog.cc:564] T 00000000000000000000000000000000 P 553ad856638544cebc2091d15adab57c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:16:25.713716 17395 sys_catalog.cc:455] T 00000000000000000000000000000000 P 553ad856638544cebc2091d15adab57c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "553ad856638544cebc2091d15adab57c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "553ad856638544cebc2091d15adab57c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35399 } } }
I20260809 20:16:25.713687 17396 sys_catalog.cc:455] T 00000000000000000000000000000000 P 553ad856638544cebc2091d15adab57c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 553ad856638544cebc2091d15adab57c. Latest consensus state: current_term: 1 leader_uuid: "553ad856638544cebc2091d15adab57c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "553ad856638544cebc2091d15adab57c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35399 } } }
I20260809 20:16:25.714169 17395 sys_catalog.cc:458] T 00000000000000000000000000000000 P 553ad856638544cebc2091d15adab57c [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:25.714239 17396 sys_catalog.cc:458] T 00000000000000000000000000000000 P 553ad856638544cebc2091d15adab57c [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:25.718462 17410 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:16:25.722126 17410 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:16:25.729324 17410 catalog_manager.cc:1347] Generated new cluster ID: 8c7b2a1eb7c74fbeb238e0ac7a2fc253
I20260809 20:16:25.729409 17410 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:16:25.740868 17410 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:16:25.741207 17410 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:16:25.749955 17410 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 553ad856638544cebc2091d15adab57c: Generated new TSK 0
I20260809 20:16:25.750798 17410 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:16:25.765172 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 17265
W20260809 20:16:25.766256 17365 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.181:43165
W20260809 20:16:25.766944 15060 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 17265: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 20:16:25.767067 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 17265
2026-08-09T20:16:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1981 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:16:25 dist-test-slave-6zbq krb5kdc[17434](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:16:25 dist-test-slave-6zbq krb5kdc[17434](info): set up 2 sockets
Aug 09 20:16:25 dist-test-slave-6zbq krb5kdc[17434](info): commencing operation
krb5kdc: starting...
W20260809 20:16:26.979501 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.001s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:16:27 dist-test-slave-6zbq krb5kdc[17434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:16:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:16:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 20:16:27.228713 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45009
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45009
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:16:27.545351 17453 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:27.545600 17453 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:27.545735 17453 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:27.552695 17453 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:16:27.552791 17453 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:27.552865 17453 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:27.552942 17453 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:16:27.552999 17453 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:16:27.562469 17453 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45009
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45009
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:27.563570 17453 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:27.564747 17453 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:27.575476 17467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:27.575548 17461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:27.575523 17464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:27.576570 17453 server_base.cc:1034] running on GCE node
I20260809 20:16:27.577230 17453 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:27.578510 17453 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:27.579704 17453 hybrid_clock.cc:648] HybridClock initialized: now 1786306587579657 us; error 40 us; skew 500 ppm
I20260809 20:16:27.579999 17453 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:16:27 dist-test-slave-6zbq krb5kdc[17434](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306587, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:16:27.582818 17453 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 20:16:27.584077 17453 webserver.cc:460] Webserver started at http://127.0.0.1:44673/ using document root <none> and password file <none>
I20260809 20:16:27.584678 17453 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:27.584791 17453 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:27.585053 17453 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:27.587852 17453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "c1947fa441974b899f479e4d21b389f4"
format_stamp: "Formatted at 2026-08-09 20:16:27 on dist-test-slave-6zbq"
server_key: "6d4d347431cab20e567179ea9ad36522"
server_key_iv: "26074570ba33db23a393406180215571"
server_key_version: "encryptionkey@0"
I20260809 20:16:27.588608 17453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "c1947fa441974b899f479e4d21b389f4"
format_stamp: "Formatted at 2026-08-09 20:16:27 on dist-test-slave-6zbq"
server_key: "6d4d347431cab20e567179ea9ad36522"
server_key_iv: "26074570ba33db23a393406180215571"
server_key_version: "encryptionkey@0"
I20260809 20:16:27.593242 17453 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260809 20:16:27.596380 17481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:27.597508 17453 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 20:16:27.597661 17453 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "c1947fa441974b899f479e4d21b389f4"
format_stamp: "Formatted at 2026-08-09 20:16:27 on dist-test-slave-6zbq"
server_key: "6d4d347431cab20e567179ea9ad36522"
server_key_iv: "26074570ba33db23a393406180215571"
server_key_version: "encryptionkey@0"
I20260809 20:16:27.597822 17453 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:27.615365 17453 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:27.618793 17453 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:27.619028 17453 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:27.635365 17453 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45009
I20260809 20:16:27.635402 17562 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45009 every 8 connection(s)
I20260809 20:16:27.636528 17453 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:16:27.638944 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 17453
I20260809 20:16:27.639106 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:16:27.639526 15060 external_mini_cluster.cc:1428] Setting key 47671e5e1be098247c5b53c0b0f94f08
I20260809 20:16:27.639945 17563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:27.653064 17563 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1947fa441974b899f479e4d21b389f4: Bootstrap starting.
Aug 09 20:16:27 dist-test-slave-6zbq krb5kdc[17434](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 20:16:27.656708 17563 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c1947fa441974b899f479e4d21b389f4: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:27.657974 17563 log.cc:824] T 00000000000000000000000000000000 P c1947fa441974b899f479e4d21b389f4: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:27.661028 17563 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1947fa441974b899f479e4d21b389f4: No bootstrap required, opened a new log
I20260809 20:16:27.662905 17567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:27.641124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.181:42643 (local address 127.0.0.1:45009)
0809 20:16:27.641870 (+ 746us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:27.641884 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:27.641930 (+ 46us) server_negotiation.cc:407] Connection header received
0809 20:16:27.644339 (+ 2409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:27.644365 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:27.644828 (+ 463us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:27.645240 (+ 412us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:27.646459 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:27.648398 (+ 1939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:27.649619 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:27.650663 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:27.650852 (+ 189us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:27.654864 (+ 4012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:27.654875 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:27.654893 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:27.654934 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:27.658528 (+ 3594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:27.659404 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:27.659412 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:27.659420 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:27.659611 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:27.659998 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:27.660003 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:27.660006 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:27.660675 (+ 669us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:27.660965 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:27.661357 (+ 392us) server_negotiation.cc:299] Negotiation successful
0809 20:16:27.661681 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":530,"thread_start_us":303,"threads_started":1}
I20260809 20:16:27.666462 15060 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 20:16:27.669307 17563 raft_consensus.cc:348] T 00000000000000000000000000000000 P c1947fa441974b899f479e4d21b389f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1947fa441974b899f479e4d21b389f4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45009 } }
I20260809 20:16:27.669691 17563 raft_consensus.cc:374] T 00000000000000000000000000000000 P c1947fa441974b899f479e4d21b389f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:27.669780 17563 raft_consensus.cc:729] T 00000000000000000000000000000000 P c1947fa441974b899f479e4d21b389f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1947fa441974b899f479e4d21b389f4, State: Initialized, Role: FOLLOWER
I20260809 20:16:27.670377 17563 consensus_queue.cc:260] T 00000000000000000000000000000000 P c1947fa441974b899f479e4d21b389f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1947fa441974b899f479e4d21b389f4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45009 } }
I20260809 20:16:27.670650 17563 raft_consensus.cc:388] T 00000000000000000000000000000000 P c1947fa441974b899f479e4d21b389f4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:16:27.670782 17563 raft_consensus.cc:482] T 00000000000000000000000000000000 P c1947fa441974b899f479e4d21b389f4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:16:27.670939 17563 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c1947fa441974b899f479e4d21b389f4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:27.673121 17563 raft_consensus.cc:504] T 00000000000000000000000000000000 P c1947fa441974b899f479e4d21b389f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1947fa441974b899f479e4d21b389f4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45009 } }
I20260809 20:16:27.673650 17563 leader_election.cc:302] T 00000000000000000000000000000000 P c1947fa441974b899f479e4d21b389f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c1947fa441974b899f479e4d21b389f4; no voters:
I20260809 20:16:27.674216 17563 leader_election.cc:288] T 00000000000000000000000000000000 P c1947fa441974b899f479e4d21b389f4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:16:27.674332 17579 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c1947fa441974b899f479e4d21b389f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:16:27.674933 17579 raft_consensus.cc:686] T 00000000000000000000000000000000 P c1947fa441974b899f479e4d21b389f4 [term 1 LEADER]: Becoming Leader. State: Replica: c1947fa441974b899f479e4d21b389f4, State: Running, Role: LEADER
I20260809 20:16:27.675527 17579 consensus_queue.cc:237] T 00000000000000000000000000000000 P c1947fa441974b899f479e4d21b389f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1947fa441974b899f479e4d21b389f4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45009 } }
I20260809 20:16:27.677090 17563 sys_catalog.cc:564] T 00000000000000000000000000000000 P c1947fa441974b899f479e4d21b389f4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:16:27.678006 17585 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1947fa441974b899f479e4d21b389f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c1947fa441974b899f479e4d21b389f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1947fa441974b899f479e4d21b389f4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45009 } } }
I20260809 20:16:27.678689 17585 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1947fa441974b899f479e4d21b389f4 [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:27.683352 17591 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:16:27.679283 17583 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1947fa441974b899f479e4d21b389f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c1947fa441974b899f479e4d21b389f4. Latest consensus state: current_term: 1 leader_uuid: "c1947fa441974b899f479e4d21b389f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1947fa441974b899f479e4d21b389f4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45009 } } }
I20260809 20:16:27.689634 17567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:27.670430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.181:54653 (local address 127.0.0.1:45009)
0809 20:16:27.670601 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:27.670608 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:27.671085 (+ 477us) server_negotiation.cc:407] Connection header received
0809 20:16:27.671204 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:27.671209 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:27.671277 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:27.671375 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:27.672791 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:27.673833 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:27.675501 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:27.676146 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:27.676265 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:27.678594 (+ 2329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:27.678600 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:27.678605 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:27.678639 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:27.685469 (+ 6830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:27.686480 (+ 1011us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:27.686486 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:27.686490 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:27.686635 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:27.687159 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:27.687165 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:27.687168 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:27.687598 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:27.687880 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:27.689084 (+ 1204us) server_negotiation.cc:299] Negotiation successful
0809 20:16:27.689260 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 20:16:27.689895 17583 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1947fa441974b899f479e4d21b389f4 [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:27.693537 17591 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:16:27.708330 17591 catalog_manager.cc:1347] Generated new cluster ID: 5ad8cdb00c4a47ce88721e0569cc9caa
I20260809 20:16:27.708428 17591 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:16:27.724188 17591 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:16:27.725838 17591 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:16:27.738821 17591 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c1947fa441974b899f479e4d21b389f4: Generated new TSK 0
I20260809 20:16:27.739671 17591 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:16:27.743986 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 17453
I20260809 20:16:27.745524 17557 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:16:27.832167 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 17453
W20260809 20:16:27.856573 17428 connection.cc:535] client connection to 127.0.0.1:45009 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45009): Connection reset by peer (error 104)
2026-08-09T20:16:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2067 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:16:27 dist-test-slave-6zbq krb5kdc[17629](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:16:27 dist-test-slave-6zbq krb5kdc[17629](info): set up 2 sockets
Aug 09 20:16:27 dist-test-slave-6zbq krb5kdc[17629](info): commencing operation
krb5kdc: starting...
W20260809 20:16:29.057523 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.178s user 0.000s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:16:29 dist-test-slave-6zbq krb5kdc[17629](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306589, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:16:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:16:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 20:16:29.288930 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42885
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42885
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:16:29.609256 17652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:29.609510 17652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:29.609608 17652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:29.616608 17652 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:16:29.616709 17652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:29.616757 17652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:29.616823 17652 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:16:29.616868 17652 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:16:29.626125 17652 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42885
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42885
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:29.627238 17652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:29.628391 17652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:29.639372 17663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:29.639358 17664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:29.639408 17666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:29.640110 17652 server_base.cc:1034] running on GCE node
I20260809 20:16:29.640802 17652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:29.642045 17652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:29.643253 17652 hybrid_clock.cc:648] HybridClock initialized: now 1786306589643202 us; error 42 us; skew 500 ppm
I20260809 20:16:29.643581 17652 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:16:29 dist-test-slave-6zbq krb5kdc[17629](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306589, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:16:29.646457 17652 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 20:16:29.647768 17652 webserver.cc:460] Webserver started at http://127.0.0.1:35639/ using document root <none> and password file <none>
I20260809 20:16:29.648353 17652 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:29.648458 17652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:29.648684 17652 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:29.651435 17652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "c20db261efe9468fa5c3bd52a5e28de2"
format_stamp: "Formatted at 2026-08-09 20:16:29 on dist-test-slave-6zbq"
server_key: "fdb379373464820400b9787782236eb5"
server_key_iv: "d537d098117efe7049e2592a8ec35b2c"
server_key_version: "encryptionkey@0"
I20260809 20:16:29.652127 17652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "c20db261efe9468fa5c3bd52a5e28de2"
format_stamp: "Formatted at 2026-08-09 20:16:29 on dist-test-slave-6zbq"
server_key: "fdb379373464820400b9787782236eb5"
server_key_iv: "d537d098117efe7049e2592a8ec35b2c"
server_key_version: "encryptionkey@0"
I20260809 20:16:29.656777 17652 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 20:16:29.659910 17677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:29.661069 17652 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 20:16:29.661234 17652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "c20db261efe9468fa5c3bd52a5e28de2"
format_stamp: "Formatted at 2026-08-09 20:16:29 on dist-test-slave-6zbq"
server_key: "fdb379373464820400b9787782236eb5"
server_key_iv: "d537d098117efe7049e2592a8ec35b2c"
server_key_version: "encryptionkey@0"
I20260809 20:16:29.661391 17652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:29.683604 17652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:29.686983 17652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:29.687191 17652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:29.703426 17652 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42885
I20260809 20:16:29.703466 17755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42885 every 8 connection(s)
I20260809 20:16:29.704550 17652 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:16:29.707875 17757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:29.711298 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 17652
I20260809 20:16:29.711472 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:16:29.712025 15060 external_mini_cluster.cc:1428] Setting key d799531d1e4ea82e2a93525da809449f
I20260809 20:16:29.719553 17757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c20db261efe9468fa5c3bd52a5e28de2: Bootstrap starting.
I20260809 20:16:29.722848 17757 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c20db261efe9468fa5c3bd52a5e28de2: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:29.723924 17757 log.cc:824] T 00000000000000000000000000000000 P c20db261efe9468fa5c3bd52a5e28de2: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:29.724366 17762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:29.713645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.181:58009 (local address 127.0.0.1:42885)
0809 20:16:29.714306 (+ 661us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:29.714316 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:29.714381 (+ 65us) server_negotiation.cc:407] Connection header received
0809 20:16:29.715941 (+ 1560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:29.715961 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:29.716325 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:29.716619 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:29.717196 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:29.718503 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:29.720220 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:29.720852 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:29.720983 (+ 131us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:29.722219 (+ 1236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:29.722226 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:29.722238 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:29.722750 (+ 512us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:29.722829 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:29.722856 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:29.723000 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:29.723257 (+ 257us) server_negotiation.cc:299] Negotiation successful
0809 20:16:29.723415 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":288,"threads_started":1}
I20260809 20:16:29.726676 17757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c20db261efe9468fa5c3bd52a5e28de2: No bootstrap required, opened a new log
I20260809 20:16:29.727825 15060 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 20:16:29.734323 17757 raft_consensus.cc:348] T 00000000000000000000000000000000 P c20db261efe9468fa5c3bd52a5e28de2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c20db261efe9468fa5c3bd52a5e28de2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42885 } }
I20260809 20:16:29.734689 17757 raft_consensus.cc:374] T 00000000000000000000000000000000 P c20db261efe9468fa5c3bd52a5e28de2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:29.734790 17757 raft_consensus.cc:729] T 00000000000000000000000000000000 P c20db261efe9468fa5c3bd52a5e28de2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20db261efe9468fa5c3bd52a5e28de2, State: Initialized, Role: FOLLOWER
I20260809 20:16:29.735332 17757 consensus_queue.cc:260] T 00000000000000000000000000000000 P c20db261efe9468fa5c3bd52a5e28de2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c20db261efe9468fa5c3bd52a5e28de2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42885 } }
I20260809 20:16:29.735592 17757 raft_consensus.cc:388] T 00000000000000000000000000000000 P c20db261efe9468fa5c3bd52a5e28de2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:16:29.735725 17757 raft_consensus.cc:482] T 00000000000000000000000000000000 P c20db261efe9468fa5c3bd52a5e28de2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:16:29.735898 17757 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c20db261efe9468fa5c3bd52a5e28de2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:29.737823 17762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:29.731879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.181:60743 (local address 127.0.0.1:42885)
0809 20:16:29.732029 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:29.732037 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:29.732296 (+ 259us) server_negotiation.cc:407] Connection header received
0809 20:16:29.732413 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:29.732418 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:29.732484 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:29.732594 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:29.733021 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:29.734080 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:29.735462 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:29.736079 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:29.736229 (+ 150us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:29.737141 (+ 912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:29.737148 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:29.737153 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:29.737172 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:29.737237 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:29.737257 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:29.737367 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:29.737461 (+ 94us) server_negotiation.cc:299] Negotiation successful
0809 20:16:29.737513 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 20:16:29.738611 17757 raft_consensus.cc:504] T 00000000000000000000000000000000 P c20db261efe9468fa5c3bd52a5e28de2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c20db261efe9468fa5c3bd52a5e28de2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42885 } }
I20260809 20:16:29.739035 17757 leader_election.cc:302] T 00000000000000000000000000000000 P c20db261efe9468fa5c3bd52a5e28de2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c20db261efe9468fa5c3bd52a5e28de2; no voters:
I20260809 20:16:29.739532 17757 leader_election.cc:288] T 00000000000000000000000000000000 P c20db261efe9468fa5c3bd52a5e28de2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:16:29.739640 17772 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c20db261efe9468fa5c3bd52a5e28de2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:16:29.740310 17772 raft_consensus.cc:686] T 00000000000000000000000000000000 P c20db261efe9468fa5c3bd52a5e28de2 [term 1 LEADER]: Becoming Leader. State: Replica: c20db261efe9468fa5c3bd52a5e28de2, State: Running, Role: LEADER
I20260809 20:16:29.740888 17772 consensus_queue.cc:237] T 00000000000000000000000000000000 P c20db261efe9468fa5c3bd52a5e28de2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c20db261efe9468fa5c3bd52a5e28de2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42885 } }
I20260809 20:16:29.741457 17757 sys_catalog.cc:564] T 00000000000000000000000000000000 P c20db261efe9468fa5c3bd52a5e28de2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:16:29.743691 17774 sys_catalog.cc:455] T 00000000000000000000000000000000 P c20db261efe9468fa5c3bd52a5e28de2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c20db261efe9468fa5c3bd52a5e28de2. Latest consensus state: current_term: 1 leader_uuid: "c20db261efe9468fa5c3bd52a5e28de2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c20db261efe9468fa5c3bd52a5e28de2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42885 } } }
I20260809 20:16:29.743585 17773 sys_catalog.cc:455] T 00000000000000000000000000000000 P c20db261efe9468fa5c3bd52a5e28de2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c20db261efe9468fa5c3bd52a5e28de2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c20db261efe9468fa5c3bd52a5e28de2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42885 } } }
I20260809 20:16:29.744007 17773 sys_catalog.cc:458] T 00000000000000000000000000000000 P c20db261efe9468fa5c3bd52a5e28de2 [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:29.744007 17774 sys_catalog.cc:458] T 00000000000000000000000000000000 P c20db261efe9468fa5c3bd52a5e28de2 [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:29.745568 17783 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:16:29.750388 17783 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:16:29.757375 17783 catalog_manager.cc:1347] Generated new cluster ID: 15726818a39646acb90817f37cbf5840
I20260809 20:16:29.757476 17783 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:16:29.784665 17783 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:16:29.785737 17783 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:16:29.793675 17783 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c20db261efe9468fa5c3bd52a5e28de2: Generated new TSK 0
I20260809 20:16:29.794269 17783 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:16:29.804597 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 17652
W20260809 20:16:29.805615 17749 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.181:58009
W20260809 20:16:29.806246 15060 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 17652: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 20:16:29.806411 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 17652
W20260809 20:16:29.827780 17626 connection.cc:535] client connection to 127.0.0.1:42885 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42885): Connection reset by peer (error 104)
2026-08-09T20:16:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1967 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:16:29 dist-test-slave-6zbq krb5kdc[17804](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:16:29 dist-test-slave-6zbq krb5kdc[17804](info): set up 2 sockets
Aug 09 20:16:29 dist-test-slave-6zbq krb5kdc[17804](info): commencing operation
krb5kdc: starting...
W20260809 20:16:31.034711 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.189s user 0.004s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:16:31 dist-test-slave-6zbq krb5kdc[17804](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306591, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:16:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:16:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 20:16:31.266655 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37221
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37221
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:16:31.579062 17827 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:31.579319 17827 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:31.579412 17827 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:31.586259 17827 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:16:31.586365 17827 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:31.586424 17827 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:31.586481 17827 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:16:31.586524 17827 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:16:31.595649 17827 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37221
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786306256699363-15060-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:31.596684 17827 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:31.597821 17827 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:31.608675 17836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:31.608608 17837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:31.608645 17840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:31.609315 17827 server_base.cc:1034] running on GCE node
I20260809 20:16:31.609997 17827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:31.611248 17827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:31.612438 17827 hybrid_clock.cc:648] HybridClock initialized: now 1786306591612401 us; error 29 us; skew 500 ppm
I20260809 20:16:31.612742 17827 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:16:31 dist-test-slave-6zbq krb5kdc[17804](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306591, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:16:31.615572 17827 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 20:16:31.616859 17827 webserver.cc:460] Webserver started at http://127.0.0.1:42025/ using document root <none> and password file <none>
I20260809 20:16:31.617439 17827 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:31.617547 17827 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:31.617822 17827 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:31.620548 17827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "4ed4dd5166284042989c77df740a4491"
format_stamp: "Formatted at 2026-08-09 20:16:31 on dist-test-slave-6zbq"
server_key: "e80c99f74bd813011ea636e8d0c51e7f"
server_key_iv: "20b40e9da40bb5f3ead0038437028481"
server_key_version: "encryptionkey@0"
I20260809 20:16:31.621251 17827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "4ed4dd5166284042989c77df740a4491"
format_stamp: "Formatted at 2026-08-09 20:16:31 on dist-test-slave-6zbq"
server_key: "e80c99f74bd813011ea636e8d0c51e7f"
server_key_iv: "20b40e9da40bb5f3ead0038437028481"
server_key_version: "encryptionkey@0"
I20260809 20:16:31.625808 17827 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 20:16:31.628880 17852 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:31.630031 17827 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260809 20:16:31.630178 17827 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "4ed4dd5166284042989c77df740a4491"
format_stamp: "Formatted at 2026-08-09 20:16:31 on dist-test-slave-6zbq"
server_key: "e80c99f74bd813011ea636e8d0c51e7f"
server_key_iv: "20b40e9da40bb5f3ead0038437028481"
server_key_version: "encryptionkey@0"
I20260809 20:16:31.630386 17827 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:31.635408 17827 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:31.638898 17827 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:31.639150 17827 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:31.655682 17827 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37221
I20260809 20:16:31.655723 17945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37221 every 8 connection(s)
I20260809 20:16:31.656879 17827 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:16:31.660195 17946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:31.665822 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 17827
I20260809 20:16:31.665975 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:16:31.666400 15060 external_mini_cluster.cc:1428] Setting key c226b3dd61f2392b348c1cc2faef3455
I20260809 20:16:31.669850 17946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ed4dd5166284042989c77df740a4491: Bootstrap starting.
I20260809 20:16:31.672988 17946 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ed4dd5166284042989c77df740a4491: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:31.673388 17952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:31.667952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.181:39361 (local address 127.0.0.1:37221)
0809 20:16:31.668734 (+ 782us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:31.668751 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:31.668789 (+ 38us) server_negotiation.cc:407] Connection header received
0809 20:16:31.670422 (+ 1633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:31.670444 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:31.670727 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:31.671017 (+ 290us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:31.671991 (+ 974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:31.671997 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:31.672008 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:31.672021 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:31.672074 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:31.672092 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:31.672248 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:31.672380 (+ 132us) server_negotiation.cc:299] Negotiation successful
0809 20:16:31.672524 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":355,"threads_started":1}
I20260809 20:16:31.674005 17946 log.cc:824] T 00000000000000000000000000000000 P 4ed4dd5166284042989c77df740a4491: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:31.676563 17946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ed4dd5166284042989c77df740a4491: No bootstrap required, opened a new log
I20260809 20:16:31.676586 15060 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 20:16:31.682703 17952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:31.680568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.181:42667 (local address 127.0.0.1:37221)
0809 20:16:31.680725 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:31.680730 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:31.681006 (+ 276us) server_negotiation.cc:407] Connection header received
0809 20:16:31.681137 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:31.681141 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:31.681206 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:31.681308 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:31.682042 (+ 734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:31.682048 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:31.682053 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:31.682069 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:31.682111 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:31.682128 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:31.682263 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:31.682379 (+ 116us) server_negotiation.cc:299] Negotiation successful
0809 20:16:31.682436 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 20:16:31.684298 17946 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ed4dd5166284042989c77df740a4491 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed4dd5166284042989c77df740a4491" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37221 } }
I20260809 20:16:31.684588 17946 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ed4dd5166284042989c77df740a4491 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:31.684662 17946 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ed4dd5166284042989c77df740a4491 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ed4dd5166284042989c77df740a4491, State: Initialized, Role: FOLLOWER
I20260809 20:16:31.685129 17946 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ed4dd5166284042989c77df740a4491 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed4dd5166284042989c77df740a4491" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37221 } }
I20260809 20:16:31.685343 17946 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ed4dd5166284042989c77df740a4491 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:16:31.685436 17946 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ed4dd5166284042989c77df740a4491 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:16:31.685556 17946 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ed4dd5166284042989c77df740a4491 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:31.687618 17946 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ed4dd5166284042989c77df740a4491 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed4dd5166284042989c77df740a4491" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37221 } }
I20260809 20:16:31.688023 17946 leader_election.cc:302] T 00000000000000000000000000000000 P 4ed4dd5166284042989c77df740a4491 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ed4dd5166284042989c77df740a4491; no voters:
I20260809 20:16:31.688575 17946 leader_election.cc:288] T 00000000000000000000000000000000 P 4ed4dd5166284042989c77df740a4491 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:16:31.688678 17965 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ed4dd5166284042989c77df740a4491 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:16:31.689567 17965 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ed4dd5166284042989c77df740a4491 [term 1 LEADER]: Becoming Leader. State: Replica: 4ed4dd5166284042989c77df740a4491, State: Running, Role: LEADER
I20260809 20:16:31.690024 17965 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ed4dd5166284042989c77df740a4491 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed4dd5166284042989c77df740a4491" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37221 } }
I20260809 20:16:31.690456 17946 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ed4dd5166284042989c77df740a4491 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:16:31.692493 17969 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ed4dd5166284042989c77df740a4491 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ed4dd5166284042989c77df740a4491. Latest consensus state: current_term: 1 leader_uuid: "4ed4dd5166284042989c77df740a4491" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed4dd5166284042989c77df740a4491" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37221 } } }
I20260809 20:16:31.692649 17968 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ed4dd5166284042989c77df740a4491 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ed4dd5166284042989c77df740a4491" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed4dd5166284042989c77df740a4491" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37221 } } }
I20260809 20:16:31.692950 17969 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ed4dd5166284042989c77df740a4491 [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:31.692965 17968 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ed4dd5166284042989c77df740a4491 [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:31.694559 17982 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:16:31.699482 17982 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:16:31.708118 17982 catalog_manager.cc:1347] Generated new cluster ID: be9e597789464ef1ba9c05ac6ab770cc
I20260809 20:16:31.708218 17982 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:16:31.718303 17982 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:16:31.718750 17982 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:16:31.731195 17982 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ed4dd5166284042989c77df740a4491: Generated new TSK 0
I20260809 20:16:31.732034 17982 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:16:31.738168 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 17827
W20260809 20:16:31.739207 17937 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.181:39361
W20260809 20:16:31.739889 15060 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 17827: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 20:16:31.740031 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 17827
2026-08-09T20:16:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1939 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:16:31 dist-test-slave-6zbq krb5kdc[18002](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:16:31 dist-test-slave-6zbq krb5kdc[18002](info): set up 2 sockets
Aug 09 20:16:31 dist-test-slave-6zbq krb5kdc[18002](info): commencing operation
krb5kdc: starting...
W20260809 20:16:32.955441 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.170s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:16:33 dist-test-slave-6zbq krb5kdc[18002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306593, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:16:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:16:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:16:33.197033 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:36915
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:36325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:36915
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:16:33.512785 18024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:33.513025 18024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:33.513162 18024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:33.520141 18024 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:16:33.520241 18024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:33.520314 18024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:33.520397 18024 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:16:33.520453 18024 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:16:33.529650 18024 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:36325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:36915
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:36915
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:33.530730 18024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:33.531904 18024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:33.542814 18035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:33.542945 18036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:33.543071 18038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:33.543622 18024 server_base.cc:1034] running on GCE node
I20260809 20:16:33.544303 18024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:33.545543 18024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:33.546736 18024 hybrid_clock.cc:648] HybridClock initialized: now 1786306593546693 us; error 31 us; skew 500 ppm
I20260809 20:16:33.547060 18024 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:16:33 dist-test-slave-6zbq krb5kdc[18002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306593, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:16:33.549950 18024 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:16:33.551342 18024 webserver.cc:460] Webserver started at http://127.14.181.62:36607/ using document root <none> and password file <none>
I20260809 20:16:33.551963 18024 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:33.552099 18024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:33.552445 18024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:33.555393 18024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "f0a88a0d5bb8432da699918700b63a9d"
format_stamp: "Formatted at 2026-08-09 20:16:33 on dist-test-slave-6zbq"
server_key: "a27a7b88b1533b5425f3f49a3e8005c3"
server_key_iv: "7d856ef795537c4625d951a49f1dfef7"
server_key_version: "encryptionkey@0"
I20260809 20:16:33.556099 18024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "f0a88a0d5bb8432da699918700b63a9d"
format_stamp: "Formatted at 2026-08-09 20:16:33 on dist-test-slave-6zbq"
server_key: "a27a7b88b1533b5425f3f49a3e8005c3"
server_key_iv: "7d856ef795537c4625d951a49f1dfef7"
server_key_version: "encryptionkey@0"
I20260809 20:16:33.560885 18024 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 20:16:33.564056 18048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:33.565236 18024 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 20:16:33.565385 18024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "f0a88a0d5bb8432da699918700b63a9d"
format_stamp: "Formatted at 2026-08-09 20:16:33 on dist-test-slave-6zbq"
server_key: "a27a7b88b1533b5425f3f49a3e8005c3"
server_key_iv: "7d856ef795537c4625d951a49f1dfef7"
server_key_version: "encryptionkey@0"
I20260809 20:16:33.565552 18024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:33.579263 18024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:33.583340 18024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:33.583595 18024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:33.600756 18024 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:36915
I20260809 20:16:33.600790 18136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:36915 every 8 connection(s)
I20260809 20:16:33.602068 18024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:16:33.605666 18137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:33.607081 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 18024
I20260809 20:16:33.607232 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:16:33.607650 15060 external_mini_cluster.cc:1428] Setting key 885051a29b79117e0fd9deb014aa2fe9
I20260809 20:16:33.619462 18137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0a88a0d5bb8432da699918700b63a9d: Bootstrap starting.
Aug 09 20:16:33 dist-test-slave-6zbq krb5kdc[18002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306593, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:16:33.622994 18137 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f0a88a0d5bb8432da699918700b63a9d: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:33.624030 18137 log.cc:824] T 00000000000000000000000000000000 P f0a88a0d5bb8432da699918700b63a9d: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:33.626696 18137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0a88a0d5bb8432da699918700b63a9d: No bootstrap required, opened a new log
I20260809 20:16:33.630631 18148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:33.609397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58317 (local address 127.14.181.62:36915)
0809 20:16:33.610175 (+ 778us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:33.610186 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:33.610229 (+ 43us) server_negotiation.cc:407] Connection header received
0809 20:16:33.611863 (+ 1634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:33.611888 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:33.612252 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:33.612561 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:33.614488 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:33.615978 (+ 1490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:33.617801 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:33.618499 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:33.618624 (+ 125us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:33.623226 (+ 4602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:33.623233 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:33.623246 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:33.623284 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:33.626148 (+ 2864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:33.626918 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:33.626926 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:33.626933 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:33.627157 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:33.627597 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:33.627602 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:33.627605 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:33.628282 (+ 677us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:33.628623 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:33.628964 (+ 341us) server_negotiation.cc:299] Negotiation successful
0809 20:16:33.629319 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":566,"thread_start_us":367,"threads_started":1}
I20260809 20:16:33.634322 15060 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 20:16:33.635670 18137 raft_consensus.cc:348] T 00000000000000000000000000000000 P f0a88a0d5bb8432da699918700b63a9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0a88a0d5bb8432da699918700b63a9d" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 36915 } }
I20260809 20:16:33.636065 18137 raft_consensus.cc:374] T 00000000000000000000000000000000 P f0a88a0d5bb8432da699918700b63a9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:33.636153 18137 raft_consensus.cc:729] T 00000000000000000000000000000000 P f0a88a0d5bb8432da699918700b63a9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0a88a0d5bb8432da699918700b63a9d, State: Initialized, Role: FOLLOWER
I20260809 20:16:33.636739 18137 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0a88a0d5bb8432da699918700b63a9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0a88a0d5bb8432da699918700b63a9d" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 36915 } }
I20260809 20:16:33.637012 18137 raft_consensus.cc:388] T 00000000000000000000000000000000 P f0a88a0d5bb8432da699918700b63a9d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:16:33.637156 18137 raft_consensus.cc:482] T 00000000000000000000000000000000 P f0a88a0d5bb8432da699918700b63a9d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:16:33.637324 18137 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f0a88a0d5bb8432da699918700b63a9d [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:33.640203 18137 raft_consensus.cc:504] T 00000000000000000000000000000000 P f0a88a0d5bb8432da699918700b63a9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0a88a0d5bb8432da699918700b63a9d" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 36915 } }
I20260809 20:16:33.640784 18137 leader_election.cc:302] T 00000000000000000000000000000000 P f0a88a0d5bb8432da699918700b63a9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f0a88a0d5bb8432da699918700b63a9d; no voters:
I20260809 20:16:33.641393 18137 leader_election.cc:288] T 00000000000000000000000000000000 P f0a88a0d5bb8432da699918700b63a9d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:16:33.641463 18159 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f0a88a0d5bb8432da699918700b63a9d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:16:33.642269 18159 raft_consensus.cc:686] T 00000000000000000000000000000000 P f0a88a0d5bb8432da699918700b63a9d [term 1 LEADER]: Becoming Leader. State: Replica: f0a88a0d5bb8432da699918700b63a9d, State: Running, Role: LEADER
I20260809 20:16:33.642899 18159 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0a88a0d5bb8432da699918700b63a9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0a88a0d5bb8432da699918700b63a9d" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 36915 } }
I20260809 20:16:33.643782 18137 sys_catalog.cc:564] T 00000000000000000000000000000000 P f0a88a0d5bb8432da699918700b63a9d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:16:33.645323 18160 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0a88a0d5bb8432da699918700b63a9d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f0a88a0d5bb8432da699918700b63a9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0a88a0d5bb8432da699918700b63a9d" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 36915 } } }
I20260809 20:16:33.645664 18160 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0a88a0d5bb8432da699918700b63a9d [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:33.646947 18161 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0a88a0d5bb8432da699918700b63a9d [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0a88a0d5bb8432da699918700b63a9d. Latest consensus state: current_term: 1 leader_uuid: "f0a88a0d5bb8432da699918700b63a9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0a88a0d5bb8432da699918700b63a9d" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 36915 } } }
I20260809 20:16:33.647388 18161 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0a88a0d5bb8432da699918700b63a9d [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:33.649467 18168 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:16:33.656857 18148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:33.639243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34365 (local address 127.14.181.62:36915)
0809 20:16:33.639428 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:33.639434 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:33.639804 (+ 370us) server_negotiation.cc:407] Connection header received
0809 20:16:33.639931 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:33.639935 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:33.639986 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:33.640058 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:33.641921 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:33.643162 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:33.644846 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:33.645612 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:33.645717 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:33.649066 (+ 3349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:33.649078 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:33.649094 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:33.649138 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:33.652827 (+ 3689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:33.653672 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:33.653678 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:33.653681 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:33.653840 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:33.654290 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:33.654295 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:33.654298 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:33.654742 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:33.655041 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:33.656293 (+ 1252us) server_negotiation.cc:299] Negotiation successful
0809 20:16:33.656489 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 20:16:33.657490 18168 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:16:33.666977 18168 catalog_manager.cc:1347] Generated new cluster ID: 15d68e0a9b994db79f06e5848e4de246
I20260809 20:16:33.667091 18168 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:16:33.681460 18168 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:16:33.683029 18168 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:16:33.691478 18168 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f0a88a0d5bb8432da699918700b63a9d: Generated new TSK 0
I20260809 20:16:33.692263 18168 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:16:33.699806 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 18024
I20260809 20:16:33.701673 18132 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:16:33.787573 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 18024
W20260809 20:16:33.807572 17996 connection.cc:535] client connection to 127.14.181.62:36915 recv error: Network error: failed to read from TLS socket (remote: 127.14.181.62:36915): Connection reset by peer (error 104)
2026-08-09T20:16:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2040 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:16:33 dist-test-slave-6zbq krb5kdc[18201](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:16:33 dist-test-slave-6zbq krb5kdc[18201](info): set up 2 sockets
Aug 09 20:16:33 dist-test-slave-6zbq krb5kdc[18201](info): commencing operation
krb5kdc: starting...
W20260809 20:16:34.989210 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.007s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:16:35 dist-test-slave-6zbq krb5kdc[18201](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306595, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:16:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:16:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:16:35.219470 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:34509
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:39145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:34509
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:16:35.529273 18221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:35.529529 18221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:35.529660 18221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:35.536628 18221 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:16:35.536738 18221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:35.536810 18221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:35.536895 18221 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:16:35.536948 18221 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:16:35.546134 18221 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:39145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:34509
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:34509
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:35.547222 18221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:35.548382 18221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:35.558868 18228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:35.558900 18229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:35.559360 18232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:35.559693 18221 server_base.cc:1034] running on GCE node
I20260809 20:16:35.560359 18221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:35.561568 18221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:35.562752 18221 hybrid_clock.cc:648] HybridClock initialized: now 1786306595562708 us; error 34 us; skew 500 ppm
I20260809 20:16:35.563051 18221 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:16:35 dist-test-slave-6zbq krb5kdc[18201](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306595, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:16:35.565862 18221 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:16:35.567131 18221 webserver.cc:460] Webserver started at http://127.14.181.62:34017/ using document root <none> and password file <none>
I20260809 20:16:35.567714 18221 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:35.567828 18221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:35.568089 18221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:35.570858 18221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "80ea808bbf90440c9e95997d9d034067"
format_stamp: "Formatted at 2026-08-09 20:16:35 on dist-test-slave-6zbq"
server_key: "f64c0e60cf33612a19bc628832bb77ed"
server_key_iv: "2a501661ae5f2f3e2978ce1c305ff6ee"
server_key_version: "encryptionkey@0"
I20260809 20:16:35.571555 18221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "80ea808bbf90440c9e95997d9d034067"
format_stamp: "Formatted at 2026-08-09 20:16:35 on dist-test-slave-6zbq"
server_key: "f64c0e60cf33612a19bc628832bb77ed"
server_key_iv: "2a501661ae5f2f3e2978ce1c305ff6ee"
server_key_version: "encryptionkey@0"
I20260809 20:16:35.576040 18221 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 20:16:35.579084 18240 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:35.580191 18221 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:16:35.580351 18221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "80ea808bbf90440c9e95997d9d034067"
format_stamp: "Formatted at 2026-08-09 20:16:35 on dist-test-slave-6zbq"
server_key: "f64c0e60cf33612a19bc628832bb77ed"
server_key_iv: "2a501661ae5f2f3e2978ce1c305ff6ee"
server_key_version: "encryptionkey@0"
I20260809 20:16:35.580520 18221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:35.593142 18221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:35.596961 18221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:35.597193 18221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:35.613603 18221 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:34509
I20260809 20:16:35.613637 18322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:34509 every 8 connection(s)
I20260809 20:16:35.614758 18221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:16:35.618046 18325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:35.619702 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 18221
I20260809 20:16:35.619863 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:16:35.620275 15060 external_mini_cluster.cc:1428] Setting key dc66244ae5194b00339648a218915dc7
I20260809 20:16:35.631469 18325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80ea808bbf90440c9e95997d9d034067: Bootstrap starting.
I20260809 20:16:35.633354 18328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:35.621839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46729 (local address 127.14.181.62:34509)
0809 20:16:35.622638 (+ 799us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:35.622660 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:35.622709 (+ 49us) server_negotiation.cc:407] Connection header received
0809 20:16:35.624302 (+ 1593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:35.624331 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:35.624816 (+ 485us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:35.625217 (+ 401us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:35.625639 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:35.627462 (+ 1823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:35.628704 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:35.629726 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:35.629879 (+ 153us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:35.630882 (+ 1003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:35.630893 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:35.630908 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:35.631544 (+ 636us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:35.631633 (+ 89us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:35.631673 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:35.631827 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:35.632034 (+ 207us) server_negotiation.cc:299] Negotiation successful
0809 20:16:35.632178 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":315,"threads_started":1}
I20260809 20:16:35.634775 18325 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 80ea808bbf90440c9e95997d9d034067: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:35.635784 18325 log.cc:824] T 00000000000000000000000000000000 P 80ea808bbf90440c9e95997d9d034067: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:35.636716 15060 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 20:16:35.638198 18325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80ea808bbf90440c9e95997d9d034067: No bootstrap required, opened a new log
I20260809 20:16:35.646791 18328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:35.640641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53559 (local address 127.14.181.62:34509)
0809 20:16:35.640798 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:35.640803 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:35.641269 (+ 466us) server_negotiation.cc:407] Connection header received
0809 20:16:35.641405 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:35.641410 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:35.641482 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:35.641583 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:35.642012 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:35.643172 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:35.644404 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:35.645059 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:35.645195 (+ 136us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:35.646083 (+ 888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:35.646090 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:35.646094 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:35.646112 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:35.646170 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:35.646192 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:35.646331 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:35.646458 (+ 127us) server_negotiation.cc:299] Negotiation successful
0809 20:16:35.646503 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 20:16:35.646709 18325 raft_consensus.cc:348] T 00000000000000000000000000000000 P 80ea808bbf90440c9e95997d9d034067 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80ea808bbf90440c9e95997d9d034067" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 34509 } }
I20260809 20:16:35.647107 18325 raft_consensus.cc:374] T 00000000000000000000000000000000 P 80ea808bbf90440c9e95997d9d034067 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:35.647195 18325 raft_consensus.cc:729] T 00000000000000000000000000000000 P 80ea808bbf90440c9e95997d9d034067 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80ea808bbf90440c9e95997d9d034067, State: Initialized, Role: FOLLOWER
I20260809 20:16:35.647778 18325 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80ea808bbf90440c9e95997d9d034067 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80ea808bbf90440c9e95997d9d034067" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 34509 } }
I20260809 20:16:35.648061 18325 raft_consensus.cc:388] T 00000000000000000000000000000000 P 80ea808bbf90440c9e95997d9d034067 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:16:35.648206 18325 raft_consensus.cc:482] T 00000000000000000000000000000000 P 80ea808bbf90440c9e95997d9d034067 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:16:35.648345 18325 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 80ea808bbf90440c9e95997d9d034067 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:35.650261 18325 raft_consensus.cc:504] T 00000000000000000000000000000000 P 80ea808bbf90440c9e95997d9d034067 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80ea808bbf90440c9e95997d9d034067" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 34509 } }
I20260809 20:16:35.650764 18325 leader_election.cc:302] T 00000000000000000000000000000000 P 80ea808bbf90440c9e95997d9d034067 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 80ea808bbf90440c9e95997d9d034067; no voters:
I20260809 20:16:35.651363 18325 leader_election.cc:288] T 00000000000000000000000000000000 P 80ea808bbf90440c9e95997d9d034067 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:16:35.651422 18335 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 80ea808bbf90440c9e95997d9d034067 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:16:35.652038 18335 raft_consensus.cc:686] T 00000000000000000000000000000000 P 80ea808bbf90440c9e95997d9d034067 [term 1 LEADER]: Becoming Leader. State: Replica: 80ea808bbf90440c9e95997d9d034067, State: Running, Role: LEADER
I20260809 20:16:35.652503 18335 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80ea808bbf90440c9e95997d9d034067 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80ea808bbf90440c9e95997d9d034067" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 34509 } }
I20260809 20:16:35.653100 18325 sys_catalog.cc:564] T 00000000000000000000000000000000 P 80ea808bbf90440c9e95997d9d034067 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:16:35.654933 18336 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80ea808bbf90440c9e95997d9d034067 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "80ea808bbf90440c9e95997d9d034067" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80ea808bbf90440c9e95997d9d034067" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 34509 } } }
I20260809 20:16:35.655222 18336 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80ea808bbf90440c9e95997d9d034067 [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:35.656018 18337 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80ea808bbf90440c9e95997d9d034067 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80ea808bbf90440c9e95997d9d034067. Latest consensus state: current_term: 1 leader_uuid: "80ea808bbf90440c9e95997d9d034067" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80ea808bbf90440c9e95997d9d034067" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 34509 } } }
I20260809 20:16:35.656361 18337 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80ea808bbf90440c9e95997d9d034067 [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:35.659564 18343 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:16:35.664328 18343 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:16:35.672299 18343 catalog_manager.cc:1347] Generated new cluster ID: 00f1b3263684494ca1ede5fe035fe68e
I20260809 20:16:35.672384 18343 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:16:35.695098 18343 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:16:35.696745 18343 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:16:35.707948 18343 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 80ea808bbf90440c9e95997d9d034067: Generated new TSK 0
I20260809 20:16:35.708653 18343 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:16:35.720968 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 18221
W20260809 20:16:35.722654 18315 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:46729
W20260809 20:16:35.723353 15060 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 18221: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 20:16:35.723481 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 18221
W20260809 20:16:35.745723 18196 connection.cc:535] client connection to 127.14.181.62:34509 recv error: Network error: failed to read from TLS socket (remote: 127.14.181.62:34509): Connection reset by peer (error 104)
2026-08-09T20:16:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1938 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:16:35 dist-test-slave-6zbq krb5kdc[18369](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:16:35 dist-test-slave-6zbq krb5kdc[18369](info): set up 2 sockets
Aug 09 20:16:35 dist-test-slave-6zbq krb5kdc[18369](info): commencing operation
krb5kdc: starting...
W20260809 20:16:36.950322 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.186s user 0.000s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:16:37 dist-test-slave-6zbq krb5kdc[18369](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:16:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:16:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:16:37.205519 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:37299
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:32965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:37299
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:16:37.527558 18390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:37.527810 18390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:37.527945 18390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:37.535665 18390 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:16:37.535789 18390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:37.535861 18390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:37.535944 18390 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:16:37.536003 18390 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:16:37.545392 18390 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:32965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:37299
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:37299
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:37.546523 18390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:37.547726 18390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:37.558491 18399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:37.558531 18405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:37.558568 18402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:37.559270 18390 server_base.cc:1034] running on GCE node
I20260809 20:16:37.559926 18390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:37.561126 18390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:37.562319 18390 hybrid_clock.cc:648] HybridClock initialized: now 1786306597562274 us; error 39 us; skew 500 ppm
I20260809 20:16:37.562650 18390 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:16:37 dist-test-slave-6zbq krb5kdc[18369](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306597, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:16:37.565364 18390 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:16:37.566639 18390 webserver.cc:460] Webserver started at http://127.14.181.62:38277/ using document root <none> and password file <none>
I20260809 20:16:37.567220 18390 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:37.567334 18390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:37.567603 18390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:37.570303 18390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "fa139ca42c1a400fb15ce0be6180d547"
format_stamp: "Formatted at 2026-08-09 20:16:37 on dist-test-slave-6zbq"
server_key: "bf38a5ab3b54b31ff92fdb418bb9f5e8"
server_key_iv: "739ea659e296103f92ff49ac39437f1c"
server_key_version: "encryptionkey@0"
I20260809 20:16:37.571045 18390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "fa139ca42c1a400fb15ce0be6180d547"
format_stamp: "Formatted at 2026-08-09 20:16:37 on dist-test-slave-6zbq"
server_key: "bf38a5ab3b54b31ff92fdb418bb9f5e8"
server_key_iv: "739ea659e296103f92ff49ac39437f1c"
server_key_version: "encryptionkey@0"
I20260809 20:16:37.575559 18390 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260809 20:16:37.578629 18417 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:37.579756 18390 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 20:16:37.579917 18390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "fa139ca42c1a400fb15ce0be6180d547"
format_stamp: "Formatted at 2026-08-09 20:16:37 on dist-test-slave-6zbq"
server_key: "bf38a5ab3b54b31ff92fdb418bb9f5e8"
server_key_iv: "739ea659e296103f92ff49ac39437f1c"
server_key_version: "encryptionkey@0"
I20260809 20:16:37.580078 18390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:37.585158 18390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:37.588615 18390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:37.588881 18390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:37.605122 18390 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:37299
I20260809 20:16:37.605173 18494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:37299 every 8 connection(s)
I20260809 20:16:37.606317 18390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:16:37.609673 18495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:37.610635 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 18390
I20260809 20:16:37.610782 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:16:37.611186 15060 external_mini_cluster.cc:1428] Setting key 95128f81117e9935d305f16ba193dfc2
I20260809 20:16:37.618148 18499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:37.612741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37045 (local address 127.14.181.62:37299)
0809 20:16:37.613455 (+ 714us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:37.613466 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:37.613511 (+ 45us) server_negotiation.cc:407] Connection header received
0809 20:16:37.615233 (+ 1722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:37.615254 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:37.615554 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:37.615861 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:37.616828 (+ 967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:37.616834 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:37.616847 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:37.616861 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:37.616917 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:37.616939 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:37.617086 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:37.617190 (+ 104us) server_negotiation.cc:299] Negotiation successful
0809 20:16:37.617329 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":508,"thread_start_us":315,"threads_started":1}
I20260809 20:16:37.621618 15060 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 20:16:37.622023 18495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa139ca42c1a400fb15ce0be6180d547: Bootstrap starting.
I20260809 20:16:37.624771 18495 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa139ca42c1a400fb15ce0be6180d547: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:37.625747 18495 log.cc:824] T 00000000000000000000000000000000 P fa139ca42c1a400fb15ce0be6180d547: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:37.627946 18499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:37.625748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46083 (local address 127.14.181.62:37299)
0809 20:16:37.625919 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:37.625923 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:37.626232 (+ 309us) server_negotiation.cc:407] Connection header received
0809 20:16:37.626455 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:37.626464 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:37.626520 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:37.626615 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:37.627379 (+ 764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:37.627384 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:37.627389 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:37.627407 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:37.627449 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:37.627469 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:37.627579 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:37.627621 (+ 42us) server_negotiation.cc:299] Negotiation successful
0809 20:16:37.627669 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 20:16:37.628685 18495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa139ca42c1a400fb15ce0be6180d547: No bootstrap required, opened a new log
I20260809 20:16:37.635341 18495 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa139ca42c1a400fb15ce0be6180d547 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa139ca42c1a400fb15ce0be6180d547" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 37299 } }
I20260809 20:16:37.635636 18495 raft_consensus.cc:374] T 00000000000000000000000000000000 P fa139ca42c1a400fb15ce0be6180d547 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:37.635730 18495 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa139ca42c1a400fb15ce0be6180d547 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa139ca42c1a400fb15ce0be6180d547, State: Initialized, Role: FOLLOWER
I20260809 20:16:37.636199 18495 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa139ca42c1a400fb15ce0be6180d547 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa139ca42c1a400fb15ce0be6180d547" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 37299 } }
I20260809 20:16:37.636409 18495 raft_consensus.cc:388] T 00000000000000000000000000000000 P fa139ca42c1a400fb15ce0be6180d547 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:16:37.636533 18495 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa139ca42c1a400fb15ce0be6180d547 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:16:37.636662 18495 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa139ca42c1a400fb15ce0be6180d547 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:37.638635 18495 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa139ca42c1a400fb15ce0be6180d547 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa139ca42c1a400fb15ce0be6180d547" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 37299 } }
I20260809 20:16:37.639052 18495 leader_election.cc:302] T 00000000000000000000000000000000 P fa139ca42c1a400fb15ce0be6180d547 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa139ca42c1a400fb15ce0be6180d547; no voters:
I20260809 20:16:37.639544 18495 leader_election.cc:288] T 00000000000000000000000000000000 P fa139ca42c1a400fb15ce0be6180d547 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:16:37.639657 18517 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa139ca42c1a400fb15ce0be6180d547 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:16:37.640245 18517 raft_consensus.cc:686] T 00000000000000000000000000000000 P fa139ca42c1a400fb15ce0be6180d547 [term 1 LEADER]: Becoming Leader. State: Replica: fa139ca42c1a400fb15ce0be6180d547, State: Running, Role: LEADER
I20260809 20:16:37.640867 18517 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa139ca42c1a400fb15ce0be6180d547 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa139ca42c1a400fb15ce0be6180d547" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 37299 } }
I20260809 20:16:37.641355 18495 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa139ca42c1a400fb15ce0be6180d547 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:16:37.643669 18521 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa139ca42c1a400fb15ce0be6180d547 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fa139ca42c1a400fb15ce0be6180d547" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa139ca42c1a400fb15ce0be6180d547" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 37299 } } }
I20260809 20:16:37.643635 18522 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa139ca42c1a400fb15ce0be6180d547 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa139ca42c1a400fb15ce0be6180d547. Latest consensus state: current_term: 1 leader_uuid: "fa139ca42c1a400fb15ce0be6180d547" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa139ca42c1a400fb15ce0be6180d547" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 37299 } } }
I20260809 20:16:37.644145 18521 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa139ca42c1a400fb15ce0be6180d547 [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:37.644150 18522 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa139ca42c1a400fb15ce0be6180d547 [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:37.645617 18534 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:16:37.653381 18534 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:16:37.661425 18534 catalog_manager.cc:1347] Generated new cluster ID: b74ad086c7f842fbbfcb6413f15bc21b
I20260809 20:16:37.661525 18534 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:16:37.671826 18534 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:16:37.672173 18534 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:16:37.681967 18534 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fa139ca42c1a400fb15ce0be6180d547: Generated new TSK 0
I20260809 20:16:37.682663 18534 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:16:37.689911 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 18390
W20260809 20:16:37.691401 18489 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:37045
W20260809 20:16:37.692066 15060 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 18390: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 20:16:37.692188 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 18390
2026-08-09T20:16:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1968 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:16:37 dist-test-slave-6zbq krb5kdc[18551](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:16:37 dist-test-slave-6zbq krb5kdc[18551](info): set up 2 sockets
Aug 09 20:16:37 dist-test-slave-6zbq krb5kdc[18551](info): commencing operation
krb5kdc: starting...
W20260809 20:16:38.903940 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.004s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:16:39 dist-test-slave-6zbq krb5kdc[18551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306599, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:16:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:16:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:16:39.147008 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:46093
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:35547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:46093
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:16:39.453502 18575 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:39.453742 18575 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:39.453832 18575 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:39.460551 18575 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:16:39.460644 18575 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:39.460695 18575 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:39.460752 18575 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:16:39.460795 18575 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:16:39.469709 18575 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:35547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:46093
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:46093
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:39.470657 18575 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:39.471731 18575 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:39.481853 18582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:39.481930 18583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:39.481905 18588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:39.482829 18575 server_base.cc:1034] running on GCE node
I20260809 20:16:39.483443 18575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:39.484572 18575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:39.485762 18575 hybrid_clock.cc:648] HybridClock initialized: now 1786306599485724 us; error 34 us; skew 500 ppm
I20260809 20:16:39.486061 18575 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:16:39 dist-test-slave-6zbq krb5kdc[18551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306599, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:16:39.488821 18575 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:16:39.490067 18575 webserver.cc:460] Webserver started at http://127.14.181.62:41725/ using document root <none> and password file <none>
I20260809 20:16:39.490680 18575 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:39.490800 18575 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:39.491053 18575 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:39.493621 18575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "90c5ccd883044d11bf2c732a0cb6b7e2"
format_stamp: "Formatted at 2026-08-09 20:16:39 on dist-test-slave-6zbq"
server_key: "806201206e1e1a4b0297abc93c8c19e2"
server_key_iv: "1ccb39f920fec58a79ef0ec3e460ac2f"
server_key_version: "encryptionkey@0"
I20260809 20:16:39.494308 18575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "90c5ccd883044d11bf2c732a0cb6b7e2"
format_stamp: "Formatted at 2026-08-09 20:16:39 on dist-test-slave-6zbq"
server_key: "806201206e1e1a4b0297abc93c8c19e2"
server_key_iv: "1ccb39f920fec58a79ef0ec3e460ac2f"
server_key_version: "encryptionkey@0"
I20260809 20:16:39.498802 18575 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 20:16:39.501806 18597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:39.502986 18575 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:16:39.503136 18575 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "90c5ccd883044d11bf2c732a0cb6b7e2"
format_stamp: "Formatted at 2026-08-09 20:16:39 on dist-test-slave-6zbq"
server_key: "806201206e1e1a4b0297abc93c8c19e2"
server_key_iv: "1ccb39f920fec58a79ef0ec3e460ac2f"
server_key_version: "encryptionkey@0"
I20260809 20:16:39.503297 18575 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:39.536103 18575 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:39.539495 18575 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:39.539719 18575 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:39.555866 18575 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:46093
I20260809 20:16:39.555917 18683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:46093 every 8 connection(s)
I20260809 20:16:39.557025 18575 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:16:39.560511 18688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:39.565644 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 18575
I20260809 20:16:39.565816 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:16:39.566365 15060 external_mini_cluster.cc:1428] Setting key aa482b0a4434306128bd81e316a633c8
I20260809 20:16:39.570667 18688 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90c5ccd883044d11bf2c732a0cb6b7e2: Bootstrap starting.
I20260809 20:16:39.573874 18688 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90c5ccd883044d11bf2c732a0cb6b7e2: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:39.574822 18688 log.cc:824] T 00000000000000000000000000000000 P 90c5ccd883044d11bf2c732a0cb6b7e2: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:39.577189 18688 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90c5ccd883044d11bf2c732a0cb6b7e2: No bootstrap required, opened a new log
Aug 09 20:16:39 dist-test-slave-6zbq krb5kdc[18551](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306599, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:16:39.586130 18688 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90c5ccd883044d11bf2c732a0cb6b7e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90c5ccd883044d11bf2c732a0cb6b7e2" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 46093 } }
I20260809 20:16:39.586549 18688 raft_consensus.cc:374] T 00000000000000000000000000000000 P 90c5ccd883044d11bf2c732a0cb6b7e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:39.586653 18688 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90c5ccd883044d11bf2c732a0cb6b7e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c5ccd883044d11bf2c732a0cb6b7e2, State: Initialized, Role: FOLLOWER
I20260809 20:16:39.587252 18688 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90c5ccd883044d11bf2c732a0cb6b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90c5ccd883044d11bf2c732a0cb6b7e2" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 46093 } }
I20260809 20:16:39.587536 18688 raft_consensus.cc:388] T 00000000000000000000000000000000 P 90c5ccd883044d11bf2c732a0cb6b7e2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:16:39.587586 18692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:39.567946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34391 (local address 127.14.181.62:46093)
0809 20:16:39.568703 (+ 757us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:39.568713 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:39.568754 (+ 41us) server_negotiation.cc:407] Connection header received
0809 20:16:39.570372 (+ 1618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:39.570398 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:39.570723 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:39.571039 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:39.572723 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:39.573910 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:39.575211 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:39.575872 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:39.576025 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:39.579741 (+ 3716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:39.579751 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:39.579769 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:39.579814 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:39.583561 (+ 3747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:39.584188 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:39.584196 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:39.584208 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:39.584408 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:39.584719 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:39.584724 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:39.584728 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:39.585384 (+ 656us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:39.585656 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:39.585966 (+ 310us) server_negotiation.cc:299] Negotiation successful
0809 20:16:39.586384 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":362,"threads_started":1}
I20260809 20:16:39.587688 18688 raft_consensus.cc:482] T 00000000000000000000000000000000 P 90c5ccd883044d11bf2c732a0cb6b7e2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:16:39.587903 18688 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90c5ccd883044d11bf2c732a0cb6b7e2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:39.590611 18688 raft_consensus.cc:504] T 00000000000000000000000000000000 P 90c5ccd883044d11bf2c732a0cb6b7e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90c5ccd883044d11bf2c732a0cb6b7e2" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 46093 } }
I20260809 20:16:39.591106 15060 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 20:16:39.591137 18688 leader_election.cc:302] T 00000000000000000000000000000000 P 90c5ccd883044d11bf2c732a0cb6b7e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 90c5ccd883044d11bf2c732a0cb6b7e2; no voters:
I20260809 20:16:39.591688 18688 leader_election.cc:288] T 00000000000000000000000000000000 P 90c5ccd883044d11bf2c732a0cb6b7e2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:16:39.591763 18697 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 90c5ccd883044d11bf2c732a0cb6b7e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:16:39.592836 18697 raft_consensus.cc:686] T 00000000000000000000000000000000 P 90c5ccd883044d11bf2c732a0cb6b7e2 [term 1 LEADER]: Becoming Leader. State: Replica: 90c5ccd883044d11bf2c732a0cb6b7e2, State: Running, Role: LEADER
I20260809 20:16:39.593312 18697 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90c5ccd883044d11bf2c732a0cb6b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90c5ccd883044d11bf2c732a0cb6b7e2" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 46093 } }
I20260809 20:16:39.593541 18688 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90c5ccd883044d11bf2c732a0cb6b7e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:16:39.599655 18698 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90c5ccd883044d11bf2c732a0cb6b7e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "90c5ccd883044d11bf2c732a0cb6b7e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90c5ccd883044d11bf2c732a0cb6b7e2" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 46093 } } }
I20260809 20:16:39.599851 18699 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90c5ccd883044d11bf2c732a0cb6b7e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90c5ccd883044d11bf2c732a0cb6b7e2. Latest consensus state: current_term: 1 leader_uuid: "90c5ccd883044d11bf2c732a0cb6b7e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90c5ccd883044d11bf2c732a0cb6b7e2" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 46093 } } }
I20260809 20:16:39.600176 18699 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90c5ccd883044d11bf2c732a0cb6b7e2 [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:39.600070 18698 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90c5ccd883044d11bf2c732a0cb6b7e2 [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:39.601250 18719 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:16:39.618284 18719 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:16:39.620651 18692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:39.600588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60249 (local address 127.14.181.62:46093)
0809 20:16:39.600738 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:39.600744 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:39.604398 (+ 3654us) server_negotiation.cc:407] Connection header received
0809 20:16:39.604585 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:39.604591 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:39.604664 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:39.604728 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:39.606908 (+ 2180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:39.608031 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:39.609915 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:39.610635 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:39.610726 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:39.613858 (+ 3132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:39.613864 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:39.613869 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:39.613901 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:39.617400 (+ 3499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:39.618220 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:39.618225 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:39.618229 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:39.618394 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:39.618823 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:39.618828 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:39.618835 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:39.619293 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:39.619519 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:39.620071 (+ 552us) server_negotiation.cc:299] Negotiation successful
0809 20:16:39.620294 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 20:16:39.628106 18719 catalog_manager.cc:1347] Generated new cluster ID: eff4011b7bb943c28b2f33c1b8f5a1ea
I20260809 20:16:39.628212 18719 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:16:39.646435 18719 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:16:39.647621 18719 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:16:39.659010 18719 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 90c5ccd883044d11bf2c732a0cb6b7e2: Generated new TSK 0
I20260809 20:16:39.659718 18719 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:16:39.668357 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 18575
I20260809 20:16:39.669445 18675 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:16:39.755697 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 18575
2026-08-09T20:16:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2061 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:16:39 dist-test-slave-6zbq krb5kdc[18742](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:16:39 dist-test-slave-6zbq krb5kdc[18742](info): set up 2 sockets
Aug 09 20:16:39 dist-test-slave-6zbq krb5kdc[18742](info): commencing operation
krb5kdc: starting...
W20260809 20:16:40.973455 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.179s user 0.002s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:16:41 dist-test-slave-6zbq krb5kdc[18742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306601, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:16:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:16:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:16:41.222112 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:42233
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:33911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:42233
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:16:41.533083 18763 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:41.533376 18763 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:41.533492 18763 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:41.540875 18763 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:16:41.540989 18763 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:41.541075 18763 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:41.541330 18763 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:16:41.541405 18763 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:16:41.552266 18763 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:33911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:42233
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:42233
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:41.553318 18763 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:41.554497 18763 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:41.565151 18772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:41.565084 18778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:41.565128 18773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:41.565848 18763 server_base.cc:1034] running on GCE node
I20260809 20:16:41.566570 18763 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:41.567763 18763 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:41.568956 18763 hybrid_clock.cc:648] HybridClock initialized: now 1786306601568914 us; error 34 us; skew 500 ppm
I20260809 20:16:41.569265 18763 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:16:41 dist-test-slave-6zbq krb5kdc[18742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306601, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:16:41.572158 18763 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:16:41.573401 18763 webserver.cc:460] Webserver started at http://127.14.181.62:46277/ using document root <none> and password file <none>
I20260809 20:16:41.573959 18763 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:41.574057 18763 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:41.574288 18763 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:41.576948 18763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "569dcf3660364778bdb65e51b76b72aa"
format_stamp: "Formatted at 2026-08-09 20:16:41 on dist-test-slave-6zbq"
server_key: "42291ffa796874531a45967c4ceede0d"
server_key_iv: "39ee2ed2de209ab092f28b2ea5f7eddf"
server_key_version: "encryptionkey@0"
I20260809 20:16:41.577595 18763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "569dcf3660364778bdb65e51b76b72aa"
format_stamp: "Formatted at 2026-08-09 20:16:41 on dist-test-slave-6zbq"
server_key: "42291ffa796874531a45967c4ceede0d"
server_key_iv: "39ee2ed2de209ab092f28b2ea5f7eddf"
server_key_version: "encryptionkey@0"
I20260809 20:16:41.582180 18763 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 20:16:41.585453 18790 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:41.586619 18763 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260809 20:16:41.586759 18763 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "569dcf3660364778bdb65e51b76b72aa"
format_stamp: "Formatted at 2026-08-09 20:16:41 on dist-test-slave-6zbq"
server_key: "42291ffa796874531a45967c4ceede0d"
server_key_iv: "39ee2ed2de209ab092f28b2ea5f7eddf"
server_key_version: "encryptionkey@0"
I20260809 20:16:41.586910 18763 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:41.617360 18763 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:41.621230 18763 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:41.621440 18763 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:41.637956 18763 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:42233
I20260809 20:16:41.637985 18873 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:42233 every 8 connection(s)
I20260809 20:16:41.639127 18763 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:16:41.641515 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 18763
I20260809 20:16:41.641667 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:16:41.642067 15060 external_mini_cluster.cc:1428] Setting key 680335d053425e79306fbc5666c4f427
I20260809 20:16:41.642606 18874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:41.654058 18878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:41.643611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60891 (local address 127.14.181.62:42233)
0809 20:16:41.644310 (+ 699us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:41.644321 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:41.644357 (+ 36us) server_negotiation.cc:407] Connection header received
0809 20:16:41.645760 (+ 1403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:41.645780 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:41.646122 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:41.646466 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:41.646973 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:41.648254 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:41.650036 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:41.650689 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:41.650818 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:41.652012 (+ 1194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:41.652020 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:41.652031 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:41.652520 (+ 489us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:41.652595 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:41.652625 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:41.652723 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:41.652947 (+ 224us) server_negotiation.cc:299] Negotiation successful
0809 20:16:41.653171 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":315,"threads_started":1}
I20260809 20:16:41.655251 18874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 569dcf3660364778bdb65e51b76b72aa: Bootstrap starting.
I20260809 20:16:41.657232 15060 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 20:16:41.658310 18874 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 569dcf3660364778bdb65e51b76b72aa: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:41.659459 18874 log.cc:824] T 00000000000000000000000000000000 P 569dcf3660364778bdb65e51b76b72aa: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:41.662381 18874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 569dcf3660364778bdb65e51b76b72aa: No bootstrap required, opened a new log
I20260809 20:16:41.668157 18878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:41.662163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53619 (local address 127.14.181.62:42233)
0809 20:16:41.662328 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:41.662333 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:41.662740 (+ 407us) server_negotiation.cc:407] Connection header received
0809 20:16:41.662870 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:41.662875 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:41.662948 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:41.663051 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:41.663507 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:41.664562 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:41.665751 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:41.666426 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:41.666542 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:41.667454 (+ 912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:41.667461 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:41.667466 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:41.667485 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:41.667528 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:41.667551 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:41.667653 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:41.667762 (+ 109us) server_negotiation.cc:299] Negotiation successful
0809 20:16:41.667848 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 20:16:41.671034 18874 raft_consensus.cc:348] T 00000000000000000000000000000000 P 569dcf3660364778bdb65e51b76b72aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "569dcf3660364778bdb65e51b76b72aa" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42233 } }
I20260809 20:16:41.671335 18874 raft_consensus.cc:374] T 00000000000000000000000000000000 P 569dcf3660364778bdb65e51b76b72aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:41.671406 18874 raft_consensus.cc:729] T 00000000000000000000000000000000 P 569dcf3660364778bdb65e51b76b72aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 569dcf3660364778bdb65e51b76b72aa, State: Initialized, Role: FOLLOWER
I20260809 20:16:41.671914 18874 consensus_queue.cc:260] T 00000000000000000000000000000000 P 569dcf3660364778bdb65e51b76b72aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "569dcf3660364778bdb65e51b76b72aa" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42233 } }
I20260809 20:16:41.672187 18874 raft_consensus.cc:388] T 00000000000000000000000000000000 P 569dcf3660364778bdb65e51b76b72aa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:16:41.672328 18874 raft_consensus.cc:482] T 00000000000000000000000000000000 P 569dcf3660364778bdb65e51b76b72aa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:16:41.672502 18874 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 569dcf3660364778bdb65e51b76b72aa [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:41.674468 18874 raft_consensus.cc:504] T 00000000000000000000000000000000 P 569dcf3660364778bdb65e51b76b72aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "569dcf3660364778bdb65e51b76b72aa" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42233 } }
I20260809 20:16:41.674882 18874 leader_election.cc:302] T 00000000000000000000000000000000 P 569dcf3660364778bdb65e51b76b72aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 569dcf3660364778bdb65e51b76b72aa; no voters:
I20260809 20:16:41.675467 18874 leader_election.cc:288] T 00000000000000000000000000000000 P 569dcf3660364778bdb65e51b76b72aa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:16:41.675585 18889 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 569dcf3660364778bdb65e51b76b72aa [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:16:41.676155 18889 raft_consensus.cc:686] T 00000000000000000000000000000000 P 569dcf3660364778bdb65e51b76b72aa [term 1 LEADER]: Becoming Leader. State: Replica: 569dcf3660364778bdb65e51b76b72aa, State: Running, Role: LEADER
I20260809 20:16:41.676697 18889 consensus_queue.cc:237] T 00000000000000000000000000000000 P 569dcf3660364778bdb65e51b76b72aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "569dcf3660364778bdb65e51b76b72aa" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42233 } }
I20260809 20:16:41.677440 18874 sys_catalog.cc:564] T 00000000000000000000000000000000 P 569dcf3660364778bdb65e51b76b72aa [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:16:41.679253 18892 sys_catalog.cc:455] T 00000000000000000000000000000000 P 569dcf3660364778bdb65e51b76b72aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 569dcf3660364778bdb65e51b76b72aa. Latest consensus state: current_term: 1 leader_uuid: "569dcf3660364778bdb65e51b76b72aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "569dcf3660364778bdb65e51b76b72aa" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42233 } } }
I20260809 20:16:41.679666 18892 sys_catalog.cc:458] T 00000000000000000000000000000000 P 569dcf3660364778bdb65e51b76b72aa [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:41.679705 18890 sys_catalog.cc:455] T 00000000000000000000000000000000 P 569dcf3660364778bdb65e51b76b72aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "569dcf3660364778bdb65e51b76b72aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "569dcf3660364778bdb65e51b76b72aa" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 42233 } } }
I20260809 20:16:41.680112 18890 sys_catalog.cc:458] T 00000000000000000000000000000000 P 569dcf3660364778bdb65e51b76b72aa [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:41.682174 18902 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:16:41.686671 18902 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:16:41.695043 18902 catalog_manager.cc:1347] Generated new cluster ID: 063ddadb6d094566a93ccd71e6d3f932
I20260809 20:16:41.695138 18902 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:16:41.702234 18902 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:16:41.703369 18902 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:16:41.714443 18902 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 569dcf3660364778bdb65e51b76b72aa: Generated new TSK 0
I20260809 20:16:41.715265 18902 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:16:41.730377 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 18763
W20260809 20:16:41.731369 18862 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:60891
W20260809 20:16:41.732008 15060 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 18763: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 20:16:41.732139 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 18763
2026-08-09T20:16:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1977 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:16:41 dist-test-slave-6zbq krb5kdc[18920](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:16:41 dist-test-slave-6zbq krb5kdc[18920](info): set up 2 sockets
Aug 09 20:16:41 dist-test-slave-6zbq krb5kdc[18920](info): commencing operation
krb5kdc: starting...
W20260809 20:16:42.948371 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.005s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:16:43 dist-test-slave-6zbq krb5kdc[18920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306603, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:16:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:16:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:16:43.186542 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:45469
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:37613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:45469
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:16:43.500772 18938 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:43.501034 18938 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:43.501187 18938 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:43.507933 18938 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:16:43.508041 18938 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:43.508129 18938 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:43.508211 18938 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:16:43.508271 18938 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:16:43.517359 18938 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:37613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:45469
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:45469
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:43.518462 18938 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:43.519641 18938 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:43.530665 18950 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:43.530581 18956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:43.530630 18951 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:43.531265 18938 server_base.cc:1034] running on GCE node
I20260809 20:16:43.531992 18938 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:43.533200 18938 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:43.534417 18938 hybrid_clock.cc:648] HybridClock initialized: now 1786306603534365 us; error 34 us; skew 500 ppm
I20260809 20:16:43.534864 18938 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:16:43 dist-test-slave-6zbq krb5kdc[18920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306603, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:16:43.538463 18938 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:16:43.539783 18938 webserver.cc:460] Webserver started at http://127.14.181.62:33143/ using document root <none> and password file <none>
I20260809 20:16:43.540374 18938 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:43.540486 18938 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:43.540776 18938 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:43.543622 18938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "2619a4b4603d46cab59ff3e553318515"
format_stamp: "Formatted at 2026-08-09 20:16:43 on dist-test-slave-6zbq"
server_key: "1cd6acef96d01bcbcbdd0a8a75b0c9b2"
server_key_iv: "6a3dcc44d8dccd6d6b9c2f0635081d8f"
server_key_version: "encryptionkey@0"
I20260809 20:16:43.544348 18938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "2619a4b4603d46cab59ff3e553318515"
format_stamp: "Formatted at 2026-08-09 20:16:43 on dist-test-slave-6zbq"
server_key: "1cd6acef96d01bcbcbdd0a8a75b0c9b2"
server_key_iv: "6a3dcc44d8dccd6d6b9c2f0635081d8f"
server_key_version: "encryptionkey@0"
I20260809 20:16:43.549059 18938 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 20:16:43.552203 18973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:43.553339 18938 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260809 20:16:43.553493 18938 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "2619a4b4603d46cab59ff3e553318515"
format_stamp: "Formatted at 2026-08-09 20:16:43 on dist-test-slave-6zbq"
server_key: "1cd6acef96d01bcbcbdd0a8a75b0c9b2"
server_key_iv: "6a3dcc44d8dccd6d6b9c2f0635081d8f"
server_key_version: "encryptionkey@0"
I20260809 20:16:43.553668 18938 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:43.558975 18938 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:43.562460 18938 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:43.562723 18938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:43.578969 18938 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:45469
I20260809 20:16:43.579030 19061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:45469 every 8 connection(s)
I20260809 20:16:43.580150 18938 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:16:43.583496 19062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:43.586292 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 18938
I20260809 20:16:43.586462 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:16:43.586860 15060 external_mini_cluster.cc:1428] Setting key 36fc86c5bcfa31e1e1f720a05f9ae398
I20260809 20:16:43.593743 19065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:43.588379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38907 (local address 127.14.181.62:45469)
0809 20:16:43.589095 (+ 716us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:43.589105 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:43.589143 (+ 38us) server_negotiation.cc:407] Connection header received
0809 20:16:43.590781 (+ 1638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:43.590802 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:43.591122 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:43.591416 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:43.592381 (+ 965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:43.592388 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:43.592400 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:43.592423 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:43.592480 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:43.592500 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:43.592685 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:43.592775 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 20:16:43.592917 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":535,"thread_start_us":333,"threads_started":1}
I20260809 20:16:43.594575 19062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2619a4b4603d46cab59ff3e553318515: Bootstrap starting.
I20260809 20:16:43.597116 15060 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 20:16:43.597626 19062 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2619a4b4603d46cab59ff3e553318515: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:43.598593 19062 log.cc:824] T 00000000000000000000000000000000 P 2619a4b4603d46cab59ff3e553318515: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:43.601490 19062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2619a4b4603d46cab59ff3e553318515: No bootstrap required, opened a new log
I20260809 20:16:43.603428 19065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:43.601308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47963 (local address 127.14.181.62:45469)
0809 20:16:43.601456 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:43.601461 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:43.601775 (+ 314us) server_negotiation.cc:407] Connection header received
0809 20:16:43.601915 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:43.601921 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:43.601973 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:43.602081 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:43.602826 (+ 745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:43.602832 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:43.602836 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 20:16:43.602853 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:43.602897 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 20:16:43.602916 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:43.603037 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:43.603095 (+ 58us) server_negotiation.cc:299] Negotiation successful
0809 20:16:43.603146 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 20:16:43.608944 19062 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2619a4b4603d46cab59ff3e553318515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2619a4b4603d46cab59ff3e553318515" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 45469 } }
I20260809 20:16:43.609239 19062 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2619a4b4603d46cab59ff3e553318515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 20:16:43.609308 19062 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2619a4b4603d46cab59ff3e553318515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2619a4b4603d46cab59ff3e553318515, State: Initialized, Role: FOLLOWER
I20260809 20:16:43.609833 19062 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2619a4b4603d46cab59ff3e553318515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2619a4b4603d46cab59ff3e553318515" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 45469 } }
I20260809 20:16:43.610153 19062 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2619a4b4603d46cab59ff3e553318515 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 20:16:43.610352 19062 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2619a4b4603d46cab59ff3e553318515 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 20:16:43.610561 19062 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2619a4b4603d46cab59ff3e553318515 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:43.612543 19062 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2619a4b4603d46cab59ff3e553318515 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2619a4b4603d46cab59ff3e553318515" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 45469 } }
I20260809 20:16:43.612967 19062 leader_election.cc:302] T 00000000000000000000000000000000 P 2619a4b4603d46cab59ff3e553318515 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2619a4b4603d46cab59ff3e553318515; no voters:
I20260809 20:16:43.613481 19062 leader_election.cc:288] T 00000000000000000000000000000000 P 2619a4b4603d46cab59ff3e553318515 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 20:16:43.613592 19078 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2619a4b4603d46cab59ff3e553318515 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:16:43.614517 19078 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2619a4b4603d46cab59ff3e553318515 [term 1 LEADER]: Becoming Leader. State: Replica: 2619a4b4603d46cab59ff3e553318515, State: Running, Role: LEADER
I20260809 20:16:43.614995 19078 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2619a4b4603d46cab59ff3e553318515 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2619a4b4603d46cab59ff3e553318515" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 45469 } }
I20260809 20:16:43.615453 19062 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2619a4b4603d46cab59ff3e553318515 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:16:43.617493 19080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2619a4b4603d46cab59ff3e553318515 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2619a4b4603d46cab59ff3e553318515" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2619a4b4603d46cab59ff3e553318515" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 45469 } } }
I20260809 20:16:43.617902 19080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2619a4b4603d46cab59ff3e553318515 [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:43.620951 19081 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2619a4b4603d46cab59ff3e553318515 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2619a4b4603d46cab59ff3e553318515. Latest consensus state: current_term: 1 leader_uuid: "2619a4b4603d46cab59ff3e553318515" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2619a4b4603d46cab59ff3e553318515" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 45469 } } }
I20260809 20:16:43.621272 19081 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2619a4b4603d46cab59ff3e553318515 [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:43.625411 19094 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:16:43.629321 19094 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:16:43.637041 19094 catalog_manager.cc:1347] Generated new cluster ID: 82321e9bffeb47bdb84f4002a44c701c
I20260809 20:16:43.637128 19094 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:16:43.675580 19094 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:16:43.675974 19094 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:16:43.684707 19094 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2619a4b4603d46cab59ff3e553318515: Generated new TSK 0
I20260809 20:16:43.685434 19094 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:16:43.702219 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 18938
W20260809 20:16:43.703255 19055 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:38907
W20260809 20:16:43.704012 15060 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 18938: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 20:16:43.704144 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 18938
2026-08-09T20:16:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1972 ms)
[----------] 18 tests from AuthTokenIssuingTest (36088 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:16:43 dist-test-slave-6zbq krb5kdc[19115](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:16:43 dist-test-slave-6zbq krb5kdc[19115](info): set up 2 sockets
Aug 09 20:16:43 dist-test-slave-6zbq krb5kdc[19115](info): commencing operation
krb5kdc: starting...
W20260809 20:16:44.918421 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.173s user 0.007s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:16:45 dist-test-slave-6zbq krb5kdc[19115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306605, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:16:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:16:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:16:45.174979 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:33071
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:38287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:33071,127.14.181.61:33437,127.14.181.60:36029
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:16:45.485566 19131 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 20:16:45.485885 19131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:45.485980 19131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:45.486091 19131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:45.493007 19131 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:16:45.493091 19131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:45.493178 19131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:45.493243 19131 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:16:45.493326 19131 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:16:45.503393 19131 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:38287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:33071,127.14.181.61:33437,127.14.181.60:36029
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:33071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:45.504487 19131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:45.505697 19131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:45.516666 19143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:45.516644 19147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:45.516709 19144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:45.517671 19131 server_base.cc:1034] running on GCE node
I20260809 20:16:45.518318 19131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:45.519529 19131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:45.520747 19131 hybrid_clock.cc:648] HybridClock initialized: now 1786306605520692 us; error 33 us; skew 500 ppm
I20260809 20:16:45.521031 19131 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:16:45 dist-test-slave-6zbq krb5kdc[19115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306605, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:16:45.523955 19131 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:16:45.525250 19131 webserver.cc:460] Webserver started at http://127.14.181.62:39001/ using document root <none> and password file <none>
I20260809 20:16:45.525859 19131 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:45.525960 19131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:45.526268 19131 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:45.528975 19131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "63115d6a976c47bd837fd242b3c4ab8b"
format_stamp: "Formatted at 2026-08-09 20:16:45 on dist-test-slave-6zbq"
server_key: "0273416643778c6220ca6ba6b6c4a215"
server_key_iv: "6b00295b386ab02b7509573f87571508"
server_key_version: "encryptionkey@0"
I20260809 20:16:45.529708 19131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "63115d6a976c47bd837fd242b3c4ab8b"
format_stamp: "Formatted at 2026-08-09 20:16:45 on dist-test-slave-6zbq"
server_key: "0273416643778c6220ca6ba6b6c4a215"
server_key_iv: "6b00295b386ab02b7509573f87571508"
server_key_version: "encryptionkey@0"
I20260809 20:16:45.534292 19131 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260809 20:16:45.537407 19157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:45.538681 19131 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:16:45.538820 19131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "63115d6a976c47bd837fd242b3c4ab8b"
format_stamp: "Formatted at 2026-08-09 20:16:45 on dist-test-slave-6zbq"
server_key: "0273416643778c6220ca6ba6b6c4a215"
server_key_iv: "6b00295b386ab02b7509573f87571508"
server_key_version: "encryptionkey@0"
I20260809 20:16:45.539001 19131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:45.556762 19131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:45.560326 19131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:45.560541 19131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:45.576987 19131 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:33071
I20260809 20:16:45.577016 19237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:33071 every 8 connection(s)
I20260809 20:16:45.578117 19131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:16:45.581400 19238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:45.584367 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 19131
I20260809 20:16:45.584575 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:16:45.585352 15060 external_mini_cluster.cc:1428] Setting key 28596b4c695da6480ae0418c9cee883f
I20260809 20:16:45.589012 19238 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33071 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 20:16:45 dist-test-slave-6zbq krb5kdc[19115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306605, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:16:45.610663 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:45.592139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:33071 (local address 127.0.0.1:38602)
0809 20:16:45.592853 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:45.592905 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:45.594897 (+ 1992us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:45.595745 (+ 848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:45.595750 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:45.596262 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:16:45.596583 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:45.596599 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:45.598555 (+ 1956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:45.598559 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:45.599585 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:45.599597 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:45.600442 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:45.600450 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:45.600695 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:45.601270 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:16:45.601293 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:16:45.603553 (+ 2260us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:16:45.607174 (+ 3621us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:45.607184 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:45.607193 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:45.607569 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:45.608011 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:45.608014 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:45.608017 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:45.608162 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:45.608997 (+ 835us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:16:45.609006 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:16:45.609172 (+ 166us) client_negotiation.cc:769] Sending connection context
0809 20:16:45.609370 (+ 198us) client_negotiation.cc:240] Negotiation successful
0809 20:16:45.609709 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"mutex_wait_us":55,"thread_start_us":293,"threads_started":1}
I20260809 20:16:45.610728 19244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:45.593285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38602 (local address 127.14.181.62:33071)
0809 20:16:45.593933 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:45.593940 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:45.593993 (+ 53us) server_negotiation.cc:407] Connection header received
0809 20:16:45.595251 (+ 1258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:45.595266 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:45.595532 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:45.595726 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:45.596791 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:45.598415 (+ 1624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:45.599717 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:45.600232 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:45.600408 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:45.603787 (+ 3379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:45.603797 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:45.603810 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:45.603843 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:45.607030 (+ 3187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:45.607709 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:45.607717 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:45.607720 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:45.607903 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:45.608262 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:45.608267 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:45.608271 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:45.608892 (+ 621us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:45.609084 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:45.609524 (+ 440us) server_negotiation.cc:299] Negotiation successful
0809 20:16:45.609855 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":86,"server-negotiator.queue_time_us":448,"thread_start_us":295,"threads_started":1}
I20260809 20:16:45.613576 19238 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.61" port: 33437 } has no permanent_uuid. Determining permanent_uuid...
I20260809 20:16:45.614645 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:45.614291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:33437 (local address 127.0.0.1:58492)
0809 20:16:45.614451 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:45.614548 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:33437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260809 20:16:45.614964 19162 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.181.61:33437: connect: Connection refused (error 111)
I20260809 20:16:45.616436 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:45.616109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:33437 (local address 127.0.0.1:58500)
0809 20:16:45.616252 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:45.616325 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:33437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 20:16:45.616628 19238 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.61:33437: Network error: Client connection negotiation failed: client connection to 127.14.181.61:33437: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.14.181.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.61.keytab.
Entry for principal kudu/127.14.181.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.61.keytab.
I20260809 20:16:45.649017 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.61:33437
--webserver_interface=127.14.181.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.61.keytab
--principal=kudu/127.14.181.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:38287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:33071,127.14.181.61:33437,127.14.181.60:36029
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 20:16:45.665899 19238 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.61" port: 33437 } attempt: 1
I20260809 20:16:45.666944 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:45.666547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:33437 (local address 127.0.0.1:58504)
0809 20:16:45.666713 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:45.666827 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:33437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 20:16:45.667827 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:45.667502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:33437 (local address 127.0.0.1:58510)
0809 20:16:45.667637 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:45.667702 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:33437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 20:16:45.667990 19238 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.61:33437: Network error: Client connection negotiation failed: client connection to 127.14.181.61:33437: connect: Connection refused (error 111)
I20260809 20:16:45.736195 19238 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.61" port: 33437 } attempt: 2
I20260809 20:16:45.737283 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:45.736824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:33437 (local address 127.0.0.1:50554)
0809 20:16:45.737054 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:45.737140 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:33437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260809 20:16:45.738212 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:45.737857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:33437 (local address 127.0.0.1:50560)
0809 20:16:45.737992 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:45.738073 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:33437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 20:16:45.738670 19238 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.61:33437: Network error: Client connection negotiation failed: client connection to 127.14.181.61:33437: connect: Connection refused (error 111)
I20260809 20:16:45.829901 19238 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.61" port: 33437 } attempt: 3
I20260809 20:16:45.831090 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:45.830673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:33437 (local address 127.0.0.1:50566)
0809 20:16:45.830867 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:45.830960 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:33437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260809 20:16:45.832054 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:45.831689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:33437 (local address 127.0.0.1:50578)
0809 20:16:45.831844 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:45.831920 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:33437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 20:16:45.832239 19238 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.61:33437: Network error: Client connection negotiation failed: client connection to 127.14.181.61:33437: connect: Connection refused (error 111)
W20260809 20:16:45.956025 19251 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 20:16:45.956336 19251 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:45.956429 19251 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:45.956540 19251 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:45.963387 19251 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:16:45.963482 19251 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:45.963569 19251 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:45.963632 19251 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:16:45.963716 19251 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:16:45.972873 19251 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:38287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:33071,127.14.181.61:33437,127.14.181.60:36029
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.61.keytab
--principal=kudu/127.14.181.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.61:33437
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.14.181.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:45.973963 19251 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:45.975173 19251 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 20:16:45.975463 19238 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.61" port: 33437 } attempt: 4
I20260809 20:16:45.976511 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:45.976011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:33437 (local address 127.0.0.1:50582)
0809 20:16:45.976297 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:45.976382 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:33437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140}
I20260809 20:16:45.977417 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:45.977073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:33437 (local address 127.0.0.1:50584)
0809 20:16:45.977214 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:45.977299 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:33437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 20:16:45.977581 19238 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.61:33437: Network error: Client connection negotiation failed: client connection to 127.14.181.61:33437: connect: Connection refused (error 111)
W20260809 20:16:45.985834 19262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:45.985916 19263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:45.985926 19266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:45.986786 19251 server_base.cc:1034] running on GCE node
I20260809 20:16:45.987434 19251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:45.988626 19251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:45.989833 19251 hybrid_clock.cc:648] HybridClock initialized: now 1786306605989776 us; error 31 us; skew 500 ppm
I20260809 20:16:45.990134 19251 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:16:45 dist-test-slave-6zbq krb5kdc[19115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306605, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:16:45.995872 19251 init.cc:377] Logged in from keytab as kudu/127.14.181.61@KRBTEST.COM (short username kudu)
I20260809 20:16:45.997218 19251 webserver.cc:460] Webserver started at http://127.14.181.61:37337/ using document root <none> and password file <none>
I20260809 20:16:45.997815 19251 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:45.997896 19251 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:45.998149 19251 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:46.000921 19251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-1/data/instance:
uuid: "c14efa47dbdb4da5b7057f341befc89f"
format_stamp: "Formatted at 2026-08-09 20:16:45 on dist-test-slave-6zbq"
server_key: "b8caf1b32430af608ec72624a28efe71"
server_key_iv: "11b11f14a55bed770de49fc10184b369"
server_key_version: "encryptionkey@0"
I20260809 20:16:46.001658 19251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-1/wal/instance:
uuid: "c14efa47dbdb4da5b7057f341befc89f"
format_stamp: "Formatted at 2026-08-09 20:16:45 on dist-test-slave-6zbq"
server_key: "b8caf1b32430af608ec72624a28efe71"
server_key_iv: "11b11f14a55bed770de49fc10184b369"
server_key_version: "encryptionkey@0"
I20260809 20:16:46.006240 19251 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.006s
I20260809 20:16:46.009356 19278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:46.010593 19251 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:16:46.010742 19251 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-1/wal
uuid: "c14efa47dbdb4da5b7057f341befc89f"
format_stamp: "Formatted at 2026-08-09 20:16:45 on dist-test-slave-6zbq"
server_key: "b8caf1b32430af608ec72624a28efe71"
server_key_iv: "11b11f14a55bed770de49fc10184b369"
server_key_version: "encryptionkey@0"
I20260809 20:16:46.010923 19251 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:46.046057 19251 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:46.049885 19251 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:46.050117 19251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:46.066630 19251 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.61:33437
I20260809 20:16:46.066637 19353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.61:33437 every 8 connection(s)
I20260809 20:16:46.067795 19251 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-1/data/info.pb
I20260809 20:16:46.070187 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 19251
I20260809 20:16:46.070405 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-1/wal/instance
I20260809 20:16:46.070943 15060 external_mini_cluster.cc:1428] Setting key 92e0db990e1a854aa4ed0c0e88a4d45b
I20260809 20:16:46.071638 19354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:46.079638 19354 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33071 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 20:16:46 dist-test-slave-6zbq krb5kdc[19115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306605, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.61@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:16:46.099895 19244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.082575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51816 (local address 127.14.181.62:33071)
0809 20:16:46.082787 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:46.082794 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:46.083841 (+ 1047us) server_negotiation.cc:407] Connection header received
0809 20:16:46.085607 (+ 1766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:46.085613 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:46.085697 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:46.085806 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:46.087549 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.088211 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.090179 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.090605 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.090695 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:46.094442 (+ 3747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:46.094447 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:46.094451 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:46.094482 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:46.096945 (+ 2463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:46.097745 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:46.097748 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:46.097751 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:46.097869 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:46.098267 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:46.098270 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:46.098272 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:46.098626 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:46.098738 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:46.099491 (+ 753us) server_negotiation.cc:299] Negotiation successful
0809 20:16:46.099665 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 20:16:46.101199 19357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.082927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:33071 (local address 127.0.0.1:51816)
0809 20:16:46.083676 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:46.083719 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:46.085350 (+ 1631us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:46.086032 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:46.086042 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:46.086719 (+ 677us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:16:46.087400 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:46.087424 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.088367 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.088372 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:46.090059 (+ 1687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:46.090073 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.090810 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.090816 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:46.091066 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:46.091711 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:16:46.091744 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:16:46.094193 (+ 2449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:16:46.097081 (+ 2888us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:46.097089 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:46.097103 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:46.097655 (+ 552us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:46.097957 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:46.097961 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:46.097964 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:46.098173 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:46.098746 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:16:46.098753 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:16:46.099133 (+ 380us) client_negotiation.cc:769] Sending connection context
0809 20:16:46.099444 (+ 311us) client_negotiation.cc:240] Negotiation successful
0809 20:16:46.099922 (+ 478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":320,"threads_started":1}
WARNING: no policy specified for kudu/127.14.181.60@KRBTEST.COM; defaulting to no policy
I20260809 20:16:46.102872 19354 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.61" port: 33437 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.60@KRBTEST.COM" created.
Aug 09 20:16:46 dist-test-slave-6zbq krb5kdc[19115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306605, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.61@KRBTEST.COM for kudu/127.14.181.61@KRBTEST.COM
I20260809 20:16:46.116142 19357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.103549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:33437 (local address 127.0.0.1:50598)
0809 20:16:46.103701 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:46.103719 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:46.103822 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:46.104718 (+ 896us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:46.104723 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:46.105109 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:16:46.105254 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:46.105264 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.106618 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.106624 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:46.107423 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:46.107434 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.108163 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.108169 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:46.108333 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:46.108820 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:16:46.108836 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:16:46.110816 (+ 1980us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:16:46.113737 (+ 2921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:46.113742 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:46.113746 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:46.114110 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:46.114493 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:46.114498 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:46.114502 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:46.114622 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:46.115246 (+ 624us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:16:46.115250 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:16:46.115381 (+ 131us) client_negotiation.cc:769] Sending connection context
0809 20:16:46.115515 (+ 134us) client_negotiation.cc:240] Negotiation successful
0809 20:16:46.115774 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260809 20:16:46.116268 19360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.103794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50598 (local address 127.14.181.61:33437)
0809 20:16:46.104361 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:46.104367 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:46.104390 (+ 23us) server_negotiation.cc:407] Connection header received
0809 20:16:46.104430 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:46.104435 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:46.104581 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:46.104705 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:46.105405 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.106496 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.107549 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.108036 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.108142 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:46.110998 (+ 2856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:46.111009 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:46.111019 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:46.111051 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:46.113624 (+ 2573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:46.114222 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:46.114228 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:46.114230 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:46.114376 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:46.114719 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:46.114724 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:46.114728 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:46.115130 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:46.115318 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:46.115637 (+ 319us) server_negotiation.cc:299] Negotiation successful
0809 20:16:46.115879 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":426,"thread_start_us":304,"threads_started":1}
I20260809 20:16:46.118470 19354 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } has no permanent_uuid. Determining permanent_uuid...
I20260809 20:16:46.119529 19357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.119130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:36029 (local address 127.0.0.1:40598)
0809 20:16:46.119277 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:46.119398 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:36029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260809 20:16:46.119810 19280 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.181.60:36029: connect: Connection refused (error 111)
I20260809 20:16:46.121237 19357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.120915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:36029 (local address 127.0.0.1:40610)
0809 20:16:46.121065 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:46.121145 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:36029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 20:16:46.121438 19354 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.60:36029: Network error: Client connection negotiation failed: client connection to 127.14.181.60:36029: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.60.keytab.
Entry for principal kudu/127.14.181.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.60.keytab.
I20260809 20:16:46.135648 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.60:36029
--webserver_interface=127.14.181.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.60.keytab
--principal=kudu/127.14.181.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:38287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:33071,127.14.181.61:33437,127.14.181.60:36029
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 20:16:46.170701 19354 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } attempt: 1
I20260809 20:16:46.171778 19357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.171355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:36029 (local address 127.0.0.1:40626)
0809 20:16:46.171531 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:46.171629 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:36029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 20:16:46.172676 19357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.172373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:36029 (local address 127.0.0.1:40632)
0809 20:16:46.172505 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:46.172576 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:36029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 20:16:46.172863 19354 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.60:36029: Network error: Client connection negotiation failed: client connection to 127.14.181.60:36029: connect: Connection refused (error 111)
I20260809 20:16:46.241050 19354 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } attempt: 2
I20260809 20:16:46.242144 19357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.241729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:36029 (local address 127.0.0.1:40638)
0809 20:16:46.241904 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:46.241993 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:36029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 20:16:46.243117 19357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.242798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:36029 (local address 127.0.0.1:40642)
0809 20:16:46.242920 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:46.242987 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:36029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 20:16:46.243316 19354 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.60:36029: Network error: Client connection negotiation failed: client connection to 127.14.181.60:36029: connect: Connection refused (error 111)
I20260809 20:16:46.276824 19238 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.61" port: 33437 } attempt: 5
Aug 09 20:16:46 dist-test-slave-6zbq krb5kdc[19115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306605, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for kudu/127.14.181.61@KRBTEST.COM
I20260809 20:16:46.289671 19360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.277600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50602 (local address 127.14.181.61:33437)
0809 20:16:46.277818 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:46.277824 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:46.277845 (+ 21us) server_negotiation.cc:407] Connection header received
0809 20:16:46.278085 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:46.278091 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:46.278171 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:46.278260 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:46.279097 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.279812 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.280980 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.281415 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.281526 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:46.284753 (+ 3227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:46.284757 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:46.284761 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:46.284792 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:46.287269 (+ 2477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:46.287870 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:46.287876 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:46.287879 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:46.287997 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:46.288348 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:46.288353 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:46.288357 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:46.288635 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:46.288766 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:46.289148 (+ 382us) server_negotiation.cc:299] Negotiation successful
0809 20:16:46.289351 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 20:16:46.289676 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.277493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:33437 (local address 127.0.0.1:50602)
0809 20:16:46.277684 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:46.277705 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:46.277855 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:46.278319 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:46.278324 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:46.278746 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:16:46.278938 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:46.278947 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.279948 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.279953 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:46.280827 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:46.280839 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.281558 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.281564 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:46.281769 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:46.282368 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:16:46.282393 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:16:46.284571 (+ 2178us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:16:46.287394 (+ 2823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:46.287400 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:46.287404 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:46.287761 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:46.288108 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:46.288113 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:46.288117 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:46.288248 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:46.288750 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:16:46.288755 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:16:46.288901 (+ 146us) client_negotiation.cc:769] Sending connection context
0809 20:16:46.289017 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 20:16:46.289315 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 20:16:46.290805 19238 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } has no permanent_uuid. Determining permanent_uuid...
I20260809 20:16:46.291821 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.291461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:36029 (local address 127.0.0.1:40652)
0809 20:16:46.291617 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:46.291688 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:36029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260809 20:16:46.292758 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.292466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:36029 (local address 127.0.0.1:40656)
0809 20:16:46.292579 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:46.292658 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:36029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 20:16:46.292982 19238 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.60:36029: Network error: Client connection negotiation failed: client connection to 127.14.181.60:36029: connect: Connection refused (error 111)
I20260809 20:16:46.334509 19354 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } attempt: 3
I20260809 20:16:46.335572 19357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.335108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:36029 (local address 127.0.0.1:40672)
0809 20:16:46.335326 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:46.335414 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:36029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260809 20:16:46.336836 19357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.336359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:36029 (local address 127.0.0.1:40684)
0809 20:16:46.336608 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:46.336702 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:36029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158}
W20260809 20:16:46.337059 19354 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.60:36029: Network error: Client connection negotiation failed: client connection to 127.14.181.60:36029: connect: Connection refused (error 111)
I20260809 20:16:46.344156 19238 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } attempt: 1
I20260809 20:16:46.345037 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.344673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:36029 (local address 127.0.0.1:40696)
0809 20:16:46.344820 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:46.344895 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:36029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 20:16:46.346007 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.345621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:36029 (local address 127.0.0.1:40698)
0809 20:16:46.345784 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:46.345872 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:36029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 20:16:46.346243 19238 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.60:36029: Network error: Client connection negotiation failed: client connection to 127.14.181.60:36029: connect: Connection refused (error 111)
I20260809 20:16:46.414458 19238 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } attempt: 2
I20260809 20:16:46.415624 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.415057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:36029 (local address 127.0.0.1:40700)
0809 20:16:46.415296 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:46.415407 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:36029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260809 20:16:46.416579 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.416248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:36029 (local address 127.0.0.1:40706)
0809 20:16:46.416401 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:46.416472 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:36029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 20:16:46.416790 19238 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.60:36029: Network error: Client connection negotiation failed: client connection to 127.14.181.60:36029: connect: Connection refused (error 111)
W20260809 20:16:46.449071 19366 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 20:16:46.449340 19366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:46.449433 19366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:46.449535 19366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:46.456362 19366 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:16:46.456432 19366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:46.456501 19366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:46.456564 19366 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:16:46.456645 19366 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:16:46.465749 19366 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:38287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:33071,127.14.181.61:33437,127.14.181.60:36029
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.60.keytab
--principal=kudu/127.14.181.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.60:36029
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.14.181.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:46.466856 19366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:46.468003 19366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:46.478488 19381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:46.478564 19379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:46.478777 19378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:46.479219 19366 server_base.cc:1034] running on GCE node
I20260809 20:16:46.479864 19366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:46.480249 19354 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } attempt: 4
I20260809 20:16:46.481302 19366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:46.481352 19357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.480804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:36029 (local address 127.0.0.1:40720)
0809 20:16:46.481032 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:46.481152 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:36029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260809 20:16:46.482245 19357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.481930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:36029 (local address 127.0.0.1:40726)
0809 20:16:46.482073 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:46.482146 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:36029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 20:16:46.482473 19354 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.60:36029: Network error: Client connection negotiation failed: client connection to 127.14.181.60:36029: connect: Connection refused (error 111)
I20260809 20:16:46.482523 19366 hybrid_clock.cc:648] HybridClock initialized: now 1786306606482425 us; error 76 us; skew 500 ppm
I20260809 20:16:46.482815 19366 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:16:46 dist-test-slave-6zbq krb5kdc[19115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306606, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:16:46.485622 19366 init.cc:377] Logged in from keytab as kudu/127.14.181.60@KRBTEST.COM (short username kudu)
I20260809 20:16:46.486909 19366 webserver.cc:460] Webserver started at http://127.14.181.60:33225/ using document root <none> and password file <none>
I20260809 20:16:46.487493 19366 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:46.487573 19366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:46.487823 19366 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:46.490614 19366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-2/data/instance:
uuid: "c2ea179176e14cc5a07df39abb0119e6"
format_stamp: "Formatted at 2026-08-09 20:16:46 on dist-test-slave-6zbq"
server_key: "e4918ae3a398bc248c790155214818ae"
server_key_iv: "519a01c6bf603f181766368fa741683a"
server_key_version: "encryptionkey@0"
I20260809 20:16:46.491314 19366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-2/wal/instance:
uuid: "c2ea179176e14cc5a07df39abb0119e6"
format_stamp: "Formatted at 2026-08-09 20:16:46 on dist-test-slave-6zbq"
server_key: "e4918ae3a398bc248c790155214818ae"
server_key_iv: "519a01c6bf603f181766368fa741683a"
server_key_version: "encryptionkey@0"
I20260809 20:16:46.495782 19366 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 20:16:46.498826 19393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:46.499994 19366 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:16:46.500147 19366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-2/wal
uuid: "c2ea179176e14cc5a07df39abb0119e6"
format_stamp: "Formatted at 2026-08-09 20:16:46 on dist-test-slave-6zbq"
server_key: "e4918ae3a398bc248c790155214818ae"
server_key_iv: "519a01c6bf603f181766368fa741683a"
server_key_version: "encryptionkey@0"
I20260809 20:16:46.500319 19366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:46.522965 19238 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } attempt: 3
I20260809 20:16:46.523919 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.523515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:36029 (local address 127.0.0.1:40728)
0809 20:16:46.523679 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:46.523769 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:36029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 20:16:46.524840 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.524482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:36029 (local address 127.0.0.1:40742)
0809 20:16:46.524658 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:46.524730 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:36029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
W20260809 20:16:46.525012 19238 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.60:36029: Network error: Client connection negotiation failed: client connection to 127.14.181.60:36029: connect: Connection refused (error 111)
I20260809 20:16:46.536023 19366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:46.539808 19366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:46.540048 19366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:46.557916 19366 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.60:36029
I20260809 20:16:46.557935 19483 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.60:36029 every 8 connection(s)
I20260809 20:16:46.559264 19366 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-2/data/info.pb
I20260809 20:16:46.560573 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 19366
I20260809 20:16:46.560756 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786306256699363-15060-0/minicluster-data/master-2/wal/instance
I20260809 20:16:46.561312 15060 external_mini_cluster.cc:1428] Setting key cebba0c989b2960ea6532b7f0b623284
I20260809 20:16:46.563803 19484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:46.571635 19484 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33071 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 20:16:46 dist-test-slave-6zbq krb5kdc[19115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306605, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.60@KRBTEST.COM
Aug 09 20:16:46 dist-test-slave-6zbq krb5kdc[19115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306606, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.60@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:16:46.584524 19488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.563135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40744 (local address 127.14.181.60:36029)
0809 20:16:46.563886 (+ 751us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:46.563900 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:46.563948 (+ 48us) server_negotiation.cc:407] Connection header received
0809 20:16:46.565509 (+ 1561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:46.565531 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:46.565879 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:46.566220 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:46.567927 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.569204 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.571030 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.571973 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.572174 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:46.576482 (+ 4308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:46.576493 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:46.576505 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:46.576552 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:46.579978 (+ 3426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:46.580762 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:46.580770 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:46.580779 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:46.580976 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:46.581441 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:46.581446 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:46.581449 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:46.582094 (+ 645us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:46.582466 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:46.582878 (+ 412us) server_negotiation.cc:299] Negotiation successful
0809 20:16:46.583302 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":544,"thread_start_us":313,"threads_started":1}
I20260809 20:16:46.590107 19490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.574600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:33071 (local address 127.0.0.1:51820)
0809 20:16:46.575359 (+ 759us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:46.575396 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:46.575537 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:46.575943 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:46.575950 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:46.576686 (+ 736us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:16:46.577067 (+ 381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:46.577080 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.578835 (+ 1755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.578840 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:46.580354 (+ 1514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:46.580365 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.581300 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.581308 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:46.581480 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:46.582014 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:16:46.582031 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:16:46.584265 (+ 2234us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:16:46.587741 (+ 3476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:46.587753 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:46.587759 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:46.588104 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:46.588495 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:46.588499 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:46.588501 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:46.588624 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:46.589118 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:16:46.589125 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:16:46.589264 (+ 139us) client_negotiation.cc:769] Sending connection context
0809 20:16:46.589409 (+ 145us) client_negotiation.cc:240] Negotiation successful
0809 20:16:46.589693 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":450,"threads_started":1}
I20260809 20:16:46.590135 19244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.574734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51820 (local address 127.14.181.62:33071)
0809 20:16:46.574917 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:46.574921 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:46.575486 (+ 565us) server_negotiation.cc:407] Connection header received
0809 20:16:46.575691 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:46.575696 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:46.575776 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:46.575856 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:46.577538 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.578663 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.580481 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.581135 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.581239 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:46.584447 (+ 3208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:46.584452 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:46.584455 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:46.584485 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:46.587548 (+ 3063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:46.588226 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:46.588232 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:46.588236 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:46.588393 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:46.588724 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:46.588730 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:46.588733 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:46.588989 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:46.589118 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:46.589547 (+ 429us) server_negotiation.cc:299] Negotiation successful
0809 20:16:46.589745 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 20:16:46.591650 19484 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.61" port: 33437 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 20:16:46 dist-test-slave-6zbq krb5kdc[19115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306605, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
Aug 09 20:16:46 dist-test-slave-6zbq krb5kdc[19115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306606, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.60@KRBTEST.COM for kudu/127.14.181.61@KRBTEST.COM
I20260809 20:16:46.601996 19492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.587417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51826 (local address 127.14.181.62:33071)
0809 20:16:46.587939 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:46.587943 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:46.587961 (+ 18us) server_negotiation.cc:407] Connection header received
0809 20:16:46.587997 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:46.588001 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:46.588049 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:46.588135 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:46.589298 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.590115 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.591541 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.591973 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.592066 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:46.596621 (+ 4555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:46.596625 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:46.596628 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:46.596656 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:46.599417 (+ 2761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:46.600028 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:46.600033 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:46.600037 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:46.600171 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:46.600545 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:46.600550 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:46.600553 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:46.600907 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:46.601171 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:46.601409 (+ 238us) server_negotiation.cc:299] Negotiation successful
0809 20:16:46.601621 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":254,"threads_started":1}
I20260809 20:16:46.605913 19490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.592383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:33437 (local address 127.0.0.1:50614)
0809 20:16:46.592525 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:46.592544 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:46.592642 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:46.592958 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:46.592961 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:46.593271 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:16:46.593397 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:46.593404 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.594714 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.594719 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:46.595831 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:46.595843 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.596728 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.596734 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:46.596891 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:46.597318 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:16:46.597333 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:16:46.599523 (+ 2190us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:16:46.603247 (+ 3724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:46.603252 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:46.603256 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:46.603715 (+ 459us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:46.604196 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:46.604201 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:46.604216 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:46.604382 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:46.605024 (+ 642us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:16:46.605029 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:16:46.605217 (+ 188us) client_negotiation.cc:769] Sending connection context
0809 20:16:46.605352 (+ 135us) client_negotiation.cc:240] Negotiation successful
0809 20:16:46.605608 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260809 20:16:46.606555 19360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.592335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50614 (local address 127.14.181.61:33437)
0809 20:16:46.592492 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:46.592498 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:46.592626 (+ 128us) server_negotiation.cc:407] Connection header received
0809 20:16:46.592745 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:46.592751 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:46.592840 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:46.592947 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:46.593537 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.594590 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.595969 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.596583 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.596695 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:46.599683 (+ 2988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:46.599688 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:46.599691 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:46.599725 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:46.603132 (+ 3407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:46.603855 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:46.603861 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:46.603865 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:46.604044 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:46.604503 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:46.604508 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:46.604512 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:46.604895 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:46.605031 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:46.605505 (+ 474us) server_negotiation.cc:299] Negotiation successful
0809 20:16:46.605824 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 20:16:46.607466 19484 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 20:16:46 dist-test-slave-6zbq krb5kdc[19115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306606, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.60@KRBTEST.COM for kudu/127.14.181.60@KRBTEST.COM
Aug 09 20:16:46 dist-test-slave-6zbq krb5kdc[19115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306605, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.61@KRBTEST.COM
I20260809 20:16:46.620839 19490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.608318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:36029 (local address 127.0.0.1:40758)
0809 20:16:46.608526 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:46.608542 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:46.608641 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:46.608940 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:46.608945 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:46.609371 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:16:46.609536 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:46.609547 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.610953 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.610958 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:46.612226 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:46.612242 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.613234 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.613238 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:46.613369 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:46.613888 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:16:46.613909 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:16:46.615884 (+ 1975us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:16:46.618752 (+ 2868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:46.618758 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:46.618762 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:46.619080 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:46.619396 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:46.619401 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:46.619405 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:46.619521 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:46.619960 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:16:46.619964 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:16:46.620095 (+ 131us) client_negotiation.cc:769] Sending connection context
0809 20:16:46.620206 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 20:16:46.620474 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120}
I20260809 20:16:46.621136 19488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.608302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40758 (local address 127.14.181.60:36029)
0809 20:16:46.608470 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:46.608475 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:46.608596 (+ 121us) server_negotiation.cc:407] Connection header received
0809 20:16:46.608736 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:46.608740 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:46.608806 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:46.608899 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:46.609696 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.610821 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.612363 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.612961 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.613052 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:46.616047 (+ 2995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:46.616051 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:46.616054 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:46.616081 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:46.618635 (+ 2554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:46.619178 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:46.619183 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:46.619186 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:46.619299 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:46.619612 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:46.619617 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:46.619620 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:46.619857 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:46.619975 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:46.620305 (+ 330us) server_negotiation.cc:299] Negotiation successful
0809 20:16:46.620641 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":115,"server-negotiator.queue_time_us":56}
I20260809 20:16:46.622870 19360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.603571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50624 (local address 127.14.181.61:33437)
0809 20:16:46.607175 (+ 3604us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:46.607180 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:46.607195 (+ 15us) server_negotiation.cc:407] Connection header received
0809 20:16:46.607236 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:46.607241 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:46.607303 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:46.607388 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:46.610385 (+ 2997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.611374 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.613079 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.613489 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.613579 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:46.618092 (+ 4513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:46.618097 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:46.618100 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:46.618128 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:46.620488 (+ 2360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:46.621119 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:46.621125 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:46.621128 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:46.621289 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:46.621634 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:46.621639 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:46.621643 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:46.621901 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:46.622136 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:46.622468 (+ 332us) server_negotiation.cc:299] Negotiation successful
0809 20:16:46.622617 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3510,"thread_start_us":4089,"threads_started":1}
I20260809 20:16:46.626276 19484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2ea179176e14cc5a07df39abb0119e6: Bootstrap starting.
I20260809 20:16:46.627272 15060 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 20:16:46.629335 19484 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c2ea179176e14cc5a07df39abb0119e6: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:46.630333 19484 log.cc:824] T 00000000000000000000000000000000 P c2ea179176e14cc5a07df39abb0119e6: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:46.629752 19196 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "63115d6a976c47bd837fd242b3c4ab8b"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51826
I20260809 20:16:46.632790 19484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c2ea179176e14cc5a07df39abb0119e6: No bootstrap required, opened a new log
I20260809 20:16:46.639503 19484 raft_consensus.cc:348] T 00000000000000000000000000000000 P c2ea179176e14cc5a07df39abb0119e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63115d6a976c47bd837fd242b3c4ab8b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33071 } } peers { permanent_uuid: "c14efa47dbdb4da5b7057f341befc89f" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 33437 } } peers { permanent_uuid: "c2ea179176e14cc5a07df39abb0119e6" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } }
I20260809 20:16:46.639789 19484 raft_consensus.cc:729] T 00000000000000000000000000000000 P c2ea179176e14cc5a07df39abb0119e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2ea179176e14cc5a07df39abb0119e6, State: Initialized, Role: FOLLOWER
I20260809 20:16:46.640179 19484 consensus_queue.cc:260] T 00000000000000000000000000000000 P c2ea179176e14cc5a07df39abb0119e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63115d6a976c47bd837fd242b3c4ab8b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33071 } } peers { permanent_uuid: "c14efa47dbdb4da5b7057f341befc89f" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 33437 } } peers { permanent_uuid: "c2ea179176e14cc5a07df39abb0119e6" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } }
I20260809 20:16:46.641036 19496 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2ea179176e14cc5a07df39abb0119e6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63115d6a976c47bd837fd242b3c4ab8b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33071 } } peers { permanent_uuid: "c14efa47dbdb4da5b7057f341befc89f" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 33437 } } peers { permanent_uuid: "c2ea179176e14cc5a07df39abb0119e6" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } } }
I20260809 20:16:46.641434 19496 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2ea179176e14cc5a07df39abb0119e6 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 20:16:46.641820 19484 sys_catalog.cc:564] T 00000000000000000000000000000000 P c2ea179176e14cc5a07df39abb0119e6 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 20:16:46.650116 19513 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c2ea179176e14cc5a07df39abb0119e6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 20:16:46.650229 19513 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 20:16:46.648675 19366 master_runner.cc:186] Error getting master registration for 127.14.181.62:33071: OK, instance_id { permanent_uuid: "63115d6a976c47bd837fd242b3c4ab8b" instance_seqno: 1786306605572360 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 20:16:46.659145 19366 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 20:16:46.702196 19238 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } attempt: 4
Aug 09 20:16:46 dist-test-slave-6zbq krb5kdc[19115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306605, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for kudu/127.14.181.60@KRBTEST.COM
I20260809 20:16:46.718108 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.702815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:36029 (local address 127.0.0.1:40766)
0809 20:16:46.703025 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:46.703047 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:46.703168 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:46.703515 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:46.703520 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:46.704034 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:16:46.704255 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:46.704267 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.705658 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.705664 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:46.707156 (+ 1492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:46.707174 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.708138 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.708145 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:46.708348 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:46.708998 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:16:46.709021 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:16:46.711604 (+ 2583us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:16:46.715466 (+ 3862us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:46.715471 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:46.715475 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:46.715971 (+ 496us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:46.716348 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:46.716353 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:46.716357 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:46.716507 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:46.717164 (+ 657us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:16:46.717169 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:16:46.717326 (+ 157us) client_negotiation.cc:769] Sending connection context
0809 20:16:46.717464 (+ 138us) client_negotiation.cc:240] Negotiation successful
0809 20:16:46.717730 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260809 20:16:46.718132 19488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.702878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40766 (local address 127.14.181.60:36029)
0809 20:16:46.703083 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:46.703087 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:46.703108 (+ 21us) server_negotiation.cc:407] Connection header received
0809 20:16:46.703305 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:46.703310 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:46.703385 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:46.703474 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:46.704397 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.705527 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.707303 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.707988 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.708109 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:46.711779 (+ 3670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:46.711787 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:46.711792 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:46.711834 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:46.715329 (+ 3495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:46.716087 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:46.716093 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:46.716097 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:46.716246 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:46.716612 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:46.716617 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:46.716620 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:46.717041 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:46.717199 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:46.717574 (+ 375us) server_negotiation.cc:299] Negotiation successful
0809 20:16:46.717781 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 20:16:46.723762 19238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63115d6a976c47bd837fd242b3c4ab8b: Bootstrap starting.
I20260809 20:16:46.727535 19238 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 63115d6a976c47bd837fd242b3c4ab8b: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:46.728773 19238 log.cc:824] T 00000000000000000000000000000000 P 63115d6a976c47bd837fd242b3c4ab8b: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:46.731611 19238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63115d6a976c47bd837fd242b3c4ab8b: No bootstrap required, opened a new log
I20260809 20:16:46.736521 19238 raft_consensus.cc:348] T 00000000000000000000000000000000 P 63115d6a976c47bd837fd242b3c4ab8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63115d6a976c47bd837fd242b3c4ab8b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33071 } } peers { permanent_uuid: "c14efa47dbdb4da5b7057f341befc89f" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 33437 } } peers { permanent_uuid: "c2ea179176e14cc5a07df39abb0119e6" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } }
I20260809 20:16:46.736946 19238 raft_consensus.cc:729] T 00000000000000000000000000000000 P 63115d6a976c47bd837fd242b3c4ab8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63115d6a976c47bd837fd242b3c4ab8b, State: Initialized, Role: FOLLOWER
I20260809 20:16:46.737368 19238 consensus_queue.cc:260] T 00000000000000000000000000000000 P 63115d6a976c47bd837fd242b3c4ab8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63115d6a976c47bd837fd242b3c4ab8b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33071 } } peers { permanent_uuid: "c14efa47dbdb4da5b7057f341befc89f" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 33437 } } peers { permanent_uuid: "c2ea179176e14cc5a07df39abb0119e6" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } }
I20260809 20:16:46.738163 19516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63115d6a976c47bd837fd242b3c4ab8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63115d6a976c47bd837fd242b3c4ab8b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33071 } } peers { permanent_uuid: "c14efa47dbdb4da5b7057f341befc89f" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 33437 } } peers { permanent_uuid: "c2ea179176e14cc5a07df39abb0119e6" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } } }
I20260809 20:16:46.738569 19516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63115d6a976c47bd837fd242b3c4ab8b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 20:16:46.739322 19238 sys_catalog.cc:564] T 00000000000000000000000000000000 P 63115d6a976c47bd837fd242b3c4ab8b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:16:46.739429 19196 raft_consensus.cc:482] T 00000000000000000000000000000000 P 63115d6a976c47bd837fd242b3c4ab8b [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 20:16:46.739632 19196 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 63115d6a976c47bd837fd242b3c4ab8b [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:46.742949 19196 raft_consensus.cc:504] T 00000000000000000000000000000000 P 63115d6a976c47bd837fd242b3c4ab8b [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63115d6a976c47bd837fd242b3c4ab8b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33071 } } peers { permanent_uuid: "c14efa47dbdb4da5b7057f341befc89f" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 33437 } } peers { permanent_uuid: "c2ea179176e14cc5a07df39abb0119e6" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } }
I20260809 20:16:46.744521 19196 leader_election.cc:288] T 00000000000000000000000000000000 P 63115d6a976c47bd837fd242b3c4ab8b [CANDIDATE]: Term 1 election: Requested vote from peers c14efa47dbdb4da5b7057f341befc89f (127.14.181.61:33437), c2ea179176e14cc5a07df39abb0119e6 (127.14.181.60:36029)
I20260809 20:16:46.745154 19441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "63115d6a976c47bd837fd242b3c4ab8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c2ea179176e14cc5a07df39abb0119e6"
I20260809 20:16:46.745639 19441 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c2ea179176e14cc5a07df39abb0119e6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:46.749104 19441 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c2ea179176e14cc5a07df39abb0119e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63115d6a976c47bd837fd242b3c4ab8b in term 1.
I20260809 20:16:46.749742 19159 leader_election.cc:302] T 00000000000000000000000000000000 P 63115d6a976c47bd837fd242b3c4ab8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63115d6a976c47bd837fd242b3c4ab8b, c2ea179176e14cc5a07df39abb0119e6; no voters:
I20260809 20:16:46.750149 19516 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 63115d6a976c47bd837fd242b3c4ab8b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:16:46.758652 19516 raft_consensus.cc:686] T 00000000000000000000000000000000 P 63115d6a976c47bd837fd242b3c4ab8b [term 1 LEADER]: Becoming Leader. State: Replica: 63115d6a976c47bd837fd242b3c4ab8b, State: Running, Role: LEADER
I20260809 20:16:46.759534 19516 consensus_queue.cc:237] T 00000000000000000000000000000000 P 63115d6a976c47bd837fd242b3c4ab8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63115d6a976c47bd837fd242b3c4ab8b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33071 } } peers { permanent_uuid: "c14efa47dbdb4da5b7057f341befc89f" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 33437 } } peers { permanent_uuid: "c2ea179176e14cc5a07df39abb0119e6" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } }
I20260809 20:16:46.770362 19531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63115d6a976c47bd837fd242b3c4ab8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 63115d6a976c47bd837fd242b3c4ab8b. Latest consensus state: current_term: 1 leader_uuid: "63115d6a976c47bd837fd242b3c4ab8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63115d6a976c47bd837fd242b3c4ab8b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33071 } } peers { permanent_uuid: "c14efa47dbdb4da5b7057f341befc89f" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 33437 } } peers { permanent_uuid: "c2ea179176e14cc5a07df39abb0119e6" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } } }
I20260809 20:16:46.770776 19531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63115d6a976c47bd837fd242b3c4ab8b [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:46.772233 19540 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:16:46.783866 19354 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } attempt: 5
I20260809 20:16:46.787616 19540 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260809 20:16:46.793560 19404 tablet.cc:2369] T 00000000000000000000000000000000 P c2ea179176e14cc5a07df39abb0119e6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:16:46.806996 19492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.776745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51830 (local address 127.14.181.62:33071)
0809 20:16:46.776909 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:46.776915 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:46.779136 (+ 2221us) server_negotiation.cc:407] Connection header received
0809 20:16:46.779598 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:46.779603 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:46.779677 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:46.779755 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:46.781979 (+ 2224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.783007 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.784978 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.785664 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.785760 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:46.789487 (+ 3727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:46.789495 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:46.789500 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:46.789542 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:46.800109 (+ 10567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:46.804472 (+ 4363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:46.804477 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:46.804481 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:46.804645 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:46.805151 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:46.805157 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:46.805160 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:46.805521 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:46.805748 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:46.806323 (+ 575us) server_negotiation.cc:299] Negotiation successful
0809 20:16:46.806607 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 20:16:46.808022 19488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.771155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40772 (local address 127.14.181.60:36029)
0809 20:16:46.771499 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:46.771505 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:46.778376 (+ 6871us) server_negotiation.cc:407] Connection header received
0809 20:16:46.778727 (+ 351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:46.778733 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:46.778813 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:46.778890 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:46.783265 (+ 4375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.784245 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.787299 (+ 3054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.787926 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.788026 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:46.794982 (+ 6956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:46.794991 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:46.794997 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:46.795042 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:46.803082 (+ 8040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:46.804732 (+ 1650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:46.804738 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:46.804742 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:46.804908 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:46.805585 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:46.805591 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:46.805595 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:46.805937 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:46.806180 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:46.807040 (+ 860us) server_negotiation.cc:299] Negotiation successful
0809 20:16:46.807429 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233}
W20260809 20:16:46.812927 19168 tablet.cc:2369] T 00000000000000000000000000000000 P 63115d6a976c47bd837fd242b3c4ab8b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:16:46.818665 19360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.770981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50638 (local address 127.14.181.61:33437)
0809 20:16:46.771362 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:46.771369 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:46.777154 (+ 5785us) server_negotiation.cc:407] Connection header received
0809 20:16:46.782165 (+ 5011us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:46.782171 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:46.782304 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:46.782415 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:46.795232 (+ 12817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.796275 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.799064 (+ 2789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.799732 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.799830 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:46.809860 (+ 10030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:46.809867 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:46.809872 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:46.809911 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:46.814981 (+ 5070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:46.815854 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:46.815860 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:46.815863 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:46.816031 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:46.816489 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:46.816495 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:46.816499 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:46.816853 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:46.817055 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:46.818071 (+ 1016us) server_negotiation.cc:299] Negotiation successful
0809 20:16:46.818298 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243}
I20260809 20:16:46.823252 19441 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c2ea179176e14cc5a07df39abb0119e6 [term 1 FOLLOWER]: Refusing update from remote peer 63115d6a976c47bd837fd242b3c4ab8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
Aug 09 20:16:46 dist-test-slave-6zbq krb5kdc[19115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306605, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.61@KRBTEST.COM for kudu/127.14.181.60@KRBTEST.COM
I20260809 20:16:46.824462 19531 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 63115d6a976c47bd837fd242b3c4ab8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2ea179176e14cc5a07df39abb0119e6" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:16:46.831000 19550 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 20:16:46.833882 19357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.784415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:36029 (local address 127.0.0.1:40788)
0809 20:16:46.784799 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:46.784819 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:46.784916 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:46.796091 (+ 11175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:46.796097 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:46.796604 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:16:46.796794 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:46.796807 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.811863 (+ 15056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.811870 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:46.813282 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:46.813300 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.821236 (+ 7936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.821243 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:46.821460 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:46.822011 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:16:46.822033 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:16:46.826304 (+ 4271us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:16:46.831235 (+ 4931us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:46.831239 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:46.831242 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:46.831712 (+ 470us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:46.832147 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:46.832152 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:46.832155 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:46.832323 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:46.832957 (+ 634us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:16:46.832962 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:16:46.833113 (+ 151us) client_negotiation.cc:769] Sending connection context
0809 20:16:46.833263 (+ 150us) client_negotiation.cc:240] Negotiation successful
0809 20:16:46.833536 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256}
I20260809 20:16:46.835183 19547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:46.785104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40788 (local address 127.14.181.60:36029)
0809 20:16:46.795750 (+ 10646us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:46.795756 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:46.795782 (+ 26us) server_negotiation.cc:407] Connection header received
0809 20:16:46.795829 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:46.795834 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:46.795903 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:46.796941 (+ 1038us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:46.797202 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.811452 (+ 14250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.820347 (+ 8895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:46.821031 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:46.826522 (+ 5491us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:46.826780 (+ 258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:46.826787 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:46.826793 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:46.826824 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:46.830547 (+ 3723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:46.831869 (+ 1322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:46.831874 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:46.831877 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:46.832013 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:46.832470 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:46.832474 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:46.832477 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:46.832815 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:46.834473 (+ 1658us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:46.834604 (+ 131us) server_negotiation.cc:299] Negotiation successful
0809 20:16:46.834810 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10481,"thread_start_us":10265,"threads_started":1}
I20260809 20:16:46.840926 19354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c14efa47dbdb4da5b7057f341befc89f: Bootstrap starting.
I20260809 20:16:46.845461 19354 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c14efa47dbdb4da5b7057f341befc89f: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:46.846949 19354 log.cc:824] T 00000000000000000000000000000000 P c14efa47dbdb4da5b7057f341befc89f: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:46.835069 19131 master_runner.cc:186] Error getting master registration for 127.14.181.61:33437: OK, instance_id { permanent_uuid: "c14efa47dbdb4da5b7057f341befc89f" instance_seqno: 1786306606061784 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 20:16:46.851768 19131 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 20:16:46.853724 19496 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2ea179176e14cc5a07df39abb0119e6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 63115d6a976c47bd837fd242b3c4ab8b. Latest consensus state: current_term: 1 leader_uuid: "63115d6a976c47bd837fd242b3c4ab8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63115d6a976c47bd837fd242b3c4ab8b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33071 } } peers { permanent_uuid: "c14efa47dbdb4da5b7057f341befc89f" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 33437 } } peers { permanent_uuid: "c2ea179176e14cc5a07df39abb0119e6" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } } }
I20260809 20:16:46.854002 19496 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2ea179176e14cc5a07df39abb0119e6 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 20:16:46.854965 19551 mvcc.cc:205] Tried to move back new op lower bound from 7316711861525667840 to 7316711861295325184. Current Snapshot: MvccSnapshot[applied={T|T < 7316711861525667840}]
I20260809 20:16:46.855644 19531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63115d6a976c47bd837fd242b3c4ab8b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "63115d6a976c47bd837fd242b3c4ab8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63115d6a976c47bd837fd242b3c4ab8b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33071 } } peers { permanent_uuid: "c14efa47dbdb4da5b7057f341befc89f" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 33437 } } peers { permanent_uuid: "c2ea179176e14cc5a07df39abb0119e6" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } } }
I20260809 20:16:46.855908 19531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63115d6a976c47bd837fd242b3c4ab8b [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:46.859148 19540 catalog_manager.cc:1347] Generated new cluster ID: 798b73498ca54b779b5ab53b252da858
I20260809 20:16:46.859251 19540 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:16:46.859709 19354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c14efa47dbdb4da5b7057f341befc89f: No bootstrap required, opened a new log
I20260809 20:16:46.871519 19552 mvcc.cc:205] Tried to move back new op lower bound from 7316711861525667840 to 7316711861295325184. Current Snapshot: MvccSnapshot[applied={T|T < 7316711861525667840}]
I20260809 20:16:46.873338 19496 sys_catalog.cc:455] T 00000000000000000000000000000000 P c2ea179176e14cc5a07df39abb0119e6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "63115d6a976c47bd837fd242b3c4ab8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63115d6a976c47bd837fd242b3c4ab8b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33071 } } peers { permanent_uuid: "c14efa47dbdb4da5b7057f341befc89f" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 33437 } } peers { permanent_uuid: "c2ea179176e14cc5a07df39abb0119e6" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } } }
I20260809 20:16:46.873608 19496 sys_catalog.cc:458] T 00000000000000000000000000000000 P c2ea179176e14cc5a07df39abb0119e6 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 20:16:46.879165 19354 raft_consensus.cc:348] T 00000000000000000000000000000000 P c14efa47dbdb4da5b7057f341befc89f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63115d6a976c47bd837fd242b3c4ab8b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33071 } } peers { permanent_uuid: "c14efa47dbdb4da5b7057f341befc89f" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 33437 } } peers { permanent_uuid: "c2ea179176e14cc5a07df39abb0119e6" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } }
I20260809 20:16:46.879540 19354 raft_consensus.cc:729] T 00000000000000000000000000000000 P c14efa47dbdb4da5b7057f341befc89f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c14efa47dbdb4da5b7057f341befc89f, State: Initialized, Role: FOLLOWER
I20260809 20:16:46.880015 19354 consensus_queue.cc:260] T 00000000000000000000000000000000 P c14efa47dbdb4da5b7057f341befc89f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63115d6a976c47bd837fd242b3c4ab8b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33071 } } peers { permanent_uuid: "c14efa47dbdb4da5b7057f341befc89f" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 33437 } } peers { permanent_uuid: "c2ea179176e14cc5a07df39abb0119e6" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } }
I20260809 20:16:46.885852 19540 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:16:46.890882 19559 sys_catalog.cc:455] T 00000000000000000000000000000000 P c14efa47dbdb4da5b7057f341befc89f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63115d6a976c47bd837fd242b3c4ab8b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33071 } } peers { permanent_uuid: "c14efa47dbdb4da5b7057f341befc89f" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 33437 } } peers { permanent_uuid: "c2ea179176e14cc5a07df39abb0119e6" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } } }
I20260809 20:16:46.891311 19559 sys_catalog.cc:458] T 00000000000000000000000000000000 P c14efa47dbdb4da5b7057f341befc89f [sys.catalog]: This master's current role is: FOLLOWER
I20260809 20:16:46.892153 19354 sys_catalog.cc:564] T 00000000000000000000000000000000 P c14efa47dbdb4da5b7057f341befc89f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:16:46.892243 19312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "63115d6a976c47bd837fd242b3c4ab8b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c14efa47dbdb4da5b7057f341befc89f"
I20260809 20:16:46.892562 19311 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c14efa47dbdb4da5b7057f341befc89f [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:46.896325 19311 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c14efa47dbdb4da5b7057f341befc89f [term 1 FOLLOWER]: Refusing update from remote peer 63115d6a976c47bd837fd242b3c4ab8b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:16:46.897938 19516 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 63115d6a976c47bd837fd242b3c4ab8b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c14efa47dbdb4da5b7057f341befc89f" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 33437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:16:46.899597 19312 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c14efa47dbdb4da5b7057f341befc89f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63115d6a976c47bd837fd242b3c4ab8b in term 1.
I20260809 20:16:46.900559 19540 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:16:46.924086 19540 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 63115d6a976c47bd837fd242b3c4ab8b: Generated new TSK 0
I20260809 20:16:46.925112 19540 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:16:46.930155 19559 sys_catalog.cc:455] T 00000000000000000000000000000000 P c14efa47dbdb4da5b7057f341befc89f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 63115d6a976c47bd837fd242b3c4ab8b. Latest consensus state: current_term: 1 leader_uuid: "63115d6a976c47bd837fd242b3c4ab8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63115d6a976c47bd837fd242b3c4ab8b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33071 } } peers { permanent_uuid: "c14efa47dbdb4da5b7057f341befc89f" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 33437 } } peers { permanent_uuid: "c2ea179176e14cc5a07df39abb0119e6" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } } }
I20260809 20:16:46.930501 19559 sys_catalog.cc:458] T 00000000000000000000000000000000 P c14efa47dbdb4da5b7057f341befc89f [sys.catalog]: This master's current role is: FOLLOWER
I20260809 20:16:46.930415 19516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63115d6a976c47bd837fd242b3c4ab8b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "63115d6a976c47bd837fd242b3c4ab8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63115d6a976c47bd837fd242b3c4ab8b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33071 } } peers { permanent_uuid: "c14efa47dbdb4da5b7057f341befc89f" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 33437 } } peers { permanent_uuid: "c2ea179176e14cc5a07df39abb0119e6" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } } }
I20260809 20:16:46.930666 19516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63115d6a976c47bd837fd242b3c4ab8b [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:46.931016 19569 sys_catalog.cc:455] T 00000000000000000000000000000000 P c14efa47dbdb4da5b7057f341befc89f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "63115d6a976c47bd837fd242b3c4ab8b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63115d6a976c47bd837fd242b3c4ab8b" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 33071 } } peers { permanent_uuid: "c14efa47dbdb4da5b7057f341befc89f" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 33437 } } peers { permanent_uuid: "c2ea179176e14cc5a07df39abb0119e6" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 36029 } } }
I20260809 20:16:46.931437 19569 sys_catalog.cc:458] T 00000000000000000000000000000000 P c14efa47dbdb4da5b7057f341befc89f [sys.catalog]: This master's current role is: FOLLOWER
I20260809 20:16:46.938138 19562 mvcc.cc:205] Tried to move back new op lower bound from 7316711861781409792 to 7316711861295325184. Current Snapshot: MvccSnapshot[applied={T|T < 7316711861781409792 or (T in {7316711861781409792})}]
I20260809 20:16:46.986887 19597 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260809 20:16:47.030234 19492 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:16:47.016528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51846 (local address 127.14.181.62:33071)
0809 20:16:47.016754 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:47.016761 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:47.027961 (+ 11200us) server_negotiation.cc:407] Connection header received
0809 20:16:47.028478 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:47.028486 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:47.028581 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:47.028659 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:47.029940 (+ 1281us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51846: BlockingRecv error: recv got EOF from 127.0.0.1:51846 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260809 20:16:47.032516 19547 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:16:47.023380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40792 (local address 127.14.181.60:36029)
0809 20:16:47.023553 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:47.023558 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:47.030866 (+ 7308us) server_negotiation.cc:407] Connection header received
0809 20:16:47.031105 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:47.031110 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:47.031224 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:47.031311 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:47.032292 (+ 981us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40792: BlockingRecv error: recv got EOF from 127.0.0.1:40792 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260809 20:16:47.036100 19360 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:16:47.016951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50648 (local address 127.14.181.61:33437)
0809 20:16:47.017149 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:47.017155 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:47.026987 (+ 9832us) server_negotiation.cc:407] Connection header received
0809 20:16:47.034614 (+ 7627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:47.034621 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:47.034709 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:47.034805 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:47.035886 (+ 1081us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50648: BlockingRecv error: recv got EOF from 127.0.0.1:50648 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260809 20:16:47.057744 19360 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:16:47.055580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50660 (local address 127.14.181.61:33437)
0809 20:16:47.055757 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:47.055762 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:47.056227 (+ 465us) server_negotiation.cc:407] Connection header received
0809 20:16:47.056437 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:47.056443 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:47.056575 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:47.056693 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:47.057485 (+ 792us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50660: BlockingRecv error: recv got EOF from 127.0.0.1:50660 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260809 20:16:47.076308 19360 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:16:47.063157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50664 (local address 127.14.181.61:33437)
0809 20:16:47.063324 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:47.063329 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:47.074888 (+ 11559us) server_negotiation.cc:407] Connection header received
0809 20:16:47.075042 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:47.075048 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:47.075130 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:47.075225 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:47.076114 (+ 889us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50664: BlockingRecv error: recv got EOF from 127.0.0.1:50664 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260809 20:16:47.104184 19360 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:16:47.099924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50670 (local address 127.14.181.61:33437)
0809 20:16:47.100087 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:47.100092 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:47.102863 (+ 2771us) server_negotiation.cc:407] Connection header received
0809 20:16:47.103036 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:47.103042 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:47.103131 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:47.103258 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:47.103971 (+ 713us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50670: BlockingRecv error: recv got EOF from 127.0.0.1:50670 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260809 20:16:47.113641 19360 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:16:47.111586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50686 (local address 127.14.181.61:33437)
0809 20:16:47.111793 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:47.111798 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:47.112299 (+ 501us) server_negotiation.cc:407] Connection header received
0809 20:16:47.112468 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:47.112473 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:47.112544 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:47.112633 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:47.113419 (+ 786us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50686: BlockingRecv error: recv got EOF from 127.0.0.1:50686 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
W20260809 20:16:47.126722 19360 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:16:47.124867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50700 (local address 127.14.181.61:33437)
0809 20:16:47.125004 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:47.125009 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:47.125448 (+ 439us) server_negotiation.cc:407] Connection header received
0809 20:16:47.125601 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:47.125607 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:47.125685 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:47.125783 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:47.126527 (+ 744us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50700: BlockingRecv error: recv got EOF from 127.0.0.1:50700 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260809 20:16:47.154271 19360 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:16:47.152205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50710 (local address 127.14.181.61:33437)
0809 20:16:47.152404 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:47.152410 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:47.152907 (+ 497us) server_negotiation.cc:407] Connection header received
0809 20:16:47.153082 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:47.153087 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:47.153181 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:47.153291 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:47.154039 (+ 748us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50710: BlockingRecv error: recv got EOF from 127.0.0.1:50710 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260809 20:16:47.191217 19360 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:16:47.189274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50716 (local address 127.14.181.61:33437)
0809 20:16:47.189434 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:47.189441 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:47.189837 (+ 396us) server_negotiation.cc:407] Connection header received
0809 20:16:47.190020 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:47.190025 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:47.190098 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:47.190181 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:47.190935 (+ 754us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50716: BlockingRecv error: recv got EOF from 127.0.0.1:50716 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260809 20:16:47.260130 19360 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:16:47.258274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50722 (local address 127.14.181.61:33437)
0809 20:16:47.258485 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:47.258491 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:47.258815 (+ 324us) server_negotiation.cc:407] Connection header received
0809 20:16:47.258973 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:47.258979 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:47.259078 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:47.259198 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:47.259913 (+ 715us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50722: BlockingRecv error: recv got EOF from 127.0.0.1:50722 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
W20260809 20:16:47.392980 19360 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:16:47.391091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50724 (local address 127.14.181.61:33437)
0809 20:16:47.391324 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:47.391331 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:47.391605 (+ 274us) server_negotiation.cc:407] Connection header received
0809 20:16:47.391797 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:47.391803 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:47.391887 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:47.391978 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:47.392727 (+ 749us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50724: BlockingRecv error: recv got EOF from 127.0.0.1:50724 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 20:16:47.652226 19513 catalog_manager.cc:1259] Loaded cluster ID: 798b73498ca54b779b5ab53b252da858
I20260809 20:16:47.652331 19513 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c2ea179176e14cc5a07df39abb0119e6: loading cluster ID for follower catalog manager: success
I20260809 20:16:47.655018 19513 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c2ea179176e14cc5a07df39abb0119e6: acquiring CA information for follower catalog manager: success
W20260809 20:16:47.655895 19360 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:16:47.654046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50726 (local address 127.14.181.61:33437)
0809 20:16:47.654252 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:47.654258 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:47.654516 (+ 258us) server_negotiation.cc:407] Connection header received
0809 20:16:47.654736 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:47.654740 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:47.654812 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:47.654898 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:47.655689 (+ 791us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50726: BlockingRecv error: recv got EOF from 127.0.0.1:50726 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 20:16:47.657024 19513 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c2ea179176e14cc5a07df39abb0119e6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 20:16:47.991963 19597 catalog_manager.cc:1259] Loaded cluster ID: 798b73498ca54b779b5ab53b252da858
I20260809 20:16:47.992087 19597 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c14efa47dbdb4da5b7057f341befc89f: loading cluster ID for follower catalog manager: success
I20260809 20:16:47.995802 19597 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c14efa47dbdb4da5b7057f341befc89f: acquiring CA information for follower catalog manager: success
I20260809 20:16:47.998162 19597 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c14efa47dbdb4da5b7057f341befc89f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 20:16:48.183125 19707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:48.176153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50742 (local address 127.14.181.61:33437)
0809 20:16:48.176750 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:48.176757 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:48.177100 (+ 343us) server_negotiation.cc:407] Connection header received
0809 20:16:48.177322 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:48.177326 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:48.177450 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:48.177563 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:16:48.178084 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:48.178954 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:48.180872 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:48.181329 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:48.181416 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:48.181933 (+ 517us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:16:48.182494 (+ 561us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:16:48.182607 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:48.182732 (+ 125us) server_negotiation.cc:299] Negotiation successful
0809 20:16:48.182805 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":452,"thread_start_us":281,"threads_started":1}
I20260809 20:16:48.204166 19718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:48.189234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40802 (local address 127.14.181.60:36029)
0809 20:16:48.198685 (+ 9451us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:48.198689 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:48.198705 (+ 16us) server_negotiation.cc:407] Connection header received
0809 20:16:48.198794 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:48.198798 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:48.198935 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:48.199063 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:16:48.199483 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:48.200197 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:48.201967 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:48.202402 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:48.202492 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:48.203056 (+ 564us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:16:48.203505 (+ 449us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:16:48.203610 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:48.203760 (+ 150us) server_negotiation.cc:299] Negotiation successful
0809 20:16:48.203857 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9354,"thread_start_us":9257,"threads_started":1}
I20260809 20:16:48.229664 19707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:48.210900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50758 (local address 127.14.181.61:33437)
0809 20:16:48.211091 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:48.211097 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:48.223398 (+ 12301us) server_negotiation.cc:407] Connection header received
0809 20:16:48.223563 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:48.223569 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:48.223651 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:48.223737 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:16:48.224355 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:48.225444 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:48.227557 (+ 2113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:48.228197 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:48.228290 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:48.228892 (+ 602us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:16:48.229016 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:16:48.229074 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:48.229291 (+ 217us) server_negotiation.cc:299] Negotiation successful
0809 20:16:48.229364 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 20:16:48.230240 19718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:48.210631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40814 (local address 127.14.181.60:36029)
0809 20:16:48.210763 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:48.210769 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:48.224001 (+ 13232us) server_negotiation.cc:407] Connection header received
0809 20:16:48.224248 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:48.224253 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:48.224356 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:48.224413 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:16:48.225111 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:48.226070 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:48.228294 (+ 2224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:48.228860 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:48.228942 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:48.229523 (+ 581us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:16:48.229646 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:16:48.229708 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:48.229919 (+ 211us) server_negotiation.cc:299] Negotiation successful
0809 20:16:48.229991 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 20:16:48.236157 19725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:48.210507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51854 (local address 127.14.181.62:33071)
0809 20:16:48.223034 (+ 12527us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:48.223040 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:48.230940 (+ 7900us) server_negotiation.cc:407] Connection header received
0809 20:16:48.231061 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:48.231066 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:48.231273 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:48.231444 (+ 171us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:16:48.231995 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:48.232696 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:48.234308 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:48.234756 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:48.234866 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:48.235307 (+ 441us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:16:48.235597 (+ 290us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:16:48.235687 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:48.235827 (+ 140us) server_negotiation.cc:299] Negotiation successful
0809 20:16:48.235909 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12410,"thread_start_us":12308,"threads_started":1}
I20260809 20:16:48.240723 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 19131
I20260809 20:16:48.241900 19232 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:16:48.348488 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 19131
I20260809 20:16:48.373557 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 19251
I20260809 20:16:48.374655 19347 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:16:48.476169 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 19251
I20260809 20:16:48.496673 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 19366
I20260809 20:16:48.497709 19477 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:16:48.603348 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 19366
2026-08-09T20:16:48Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (4903 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 20:16:48 dist-test-slave-6zbq krb5kdc[19743](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 20:16:48 dist-test-slave-6zbq krb5kdc[19743](info): set up 2 sockets
Aug 09 20:16:48 dist-test-slave-6zbq krb5kdc[19743](info): commencing operation
krb5kdc: starting...
W20260809 20:16:49.814293 15060 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.000s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/krb5kdc/test-user.keytab.
Aug 09 20:16:49 dist-test-slave-6zbq krb5kdc[19743](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306609, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T20:16:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T20:16:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.14.181.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
Entry for principal kudu/127.14.181.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab.
I20260809 20:16:50.078172 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:39945
--webserver_interface=127.14.181.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:42393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:39945,127.14.181.61:40179,127.14.181.60:41385
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 20:16:50.395695 19769 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 20:16:50.396003 19769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:50.396107 19769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:50.396230 19769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:50.403151 19769 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:16:50.403235 19769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:50.403316 19769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:50.403381 19769 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:16:50.403465 19769 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:16:50.412635 19769 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:42393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:39945,127.14.181.61:40179,127.14.181.60:41385
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.62.keytab
--principal=kudu/127.14.181.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.62:39945
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.181.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:50.413761 19769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:50.414989 19769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:50.425804 19781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:50.425760 19783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:50.425958 19780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:50.426836 19769 server_base.cc:1034] running on GCE node
I20260809 20:16:50.427455 19769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:50.428617 19769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:50.429829 19769 hybrid_clock.cc:648] HybridClock initialized: now 1786306610429774 us; error 23 us; skew 500 ppm
I20260809 20:16:50.430096 19769 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:16:50 dist-test-slave-6zbq krb5kdc[19743](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306610, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:16:50.433015 19769 init.cc:377] Logged in from keytab as kudu/127.14.181.62@KRBTEST.COM (short username kudu)
I20260809 20:16:50.434269 19769 webserver.cc:460] Webserver started at http://127.14.181.62:41693/ using document root <none> and password file <none>
I20260809 20:16:50.434875 19769 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:50.434958 19769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:50.435204 19769 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:50.437875 19769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-0/data/instance:
uuid: "3e70598fd6a04d199f9dcd29c06d77dc"
format_stamp: "Formatted at 2026-08-09 20:16:50 on dist-test-slave-6zbq"
server_key: "7f0ec702fed5a796e6616ef0fd8d87f5"
server_key_iv: "1273341d906ab44c64fcbd4136c16e4d"
server_key_version: "encryptionkey@0"
I20260809 20:16:50.438625 19769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-0/wal/instance:
uuid: "3e70598fd6a04d199f9dcd29c06d77dc"
format_stamp: "Formatted at 2026-08-09 20:16:50 on dist-test-slave-6zbq"
server_key: "7f0ec702fed5a796e6616ef0fd8d87f5"
server_key_iv: "1273341d906ab44c64fcbd4136c16e4d"
server_key_version: "encryptionkey@0"
I20260809 20:16:50.443300 19769 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 20:16:50.446300 19796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:50.447479 19769 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260809 20:16:50.447615 19769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-0/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-0/wal
uuid: "3e70598fd6a04d199f9dcd29c06d77dc"
format_stamp: "Formatted at 2026-08-09 20:16:50 on dist-test-slave-6zbq"
server_key: "7f0ec702fed5a796e6616ef0fd8d87f5"
server_key_iv: "1273341d906ab44c64fcbd4136c16e4d"
server_key_version: "encryptionkey@0"
I20260809 20:16:50.447788 19769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:50.471535 19769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:50.475579 19769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:50.475796 19769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:50.492456 19769 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.62:39945
I20260809 20:16:50.492482 19878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.62:39945 every 8 connection(s)
I20260809 20:16:50.493625 19769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-0/data/info.pb
I20260809 20:16:50.497094 19879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:50.502439 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 19769
I20260809 20:16:50.502605 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-0/wal/instance
I20260809 20:16:50.503055 15060 external_mini_cluster.cc:1428] Setting key 5524ed28d4ff8dbccc4b44dad7a7addf
I20260809 20:16:50.503675 19879 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39945 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 20:16:50 dist-test-slave-6zbq krb5kdc[19743](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306610, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:16:50.525225 19884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:50.506560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39945 (local address 127.0.0.1:59126)
0809 20:16:50.507369 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:50.507421 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:50.509582 (+ 2161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:50.510392 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:50.510399 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:50.511071 (+ 672us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:16:50.511511 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:50.511536 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:50.513037 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:50.513042 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:50.514538 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:50.514553 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:50.515418 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:50.515426 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:50.515582 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:50.516165 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:16:50.516194 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:16:50.518173 (+ 1979us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:16:50.521722 (+ 3549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:50.521732 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:50.521741 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:50.522088 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:50.522552 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:50.522555 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:50.522558 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:50.522726 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:50.523613 (+ 887us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:16:50.523618 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:16:50.523793 (+ 175us) client_negotiation.cc:769] Sending connection context
0809 20:16:50.523974 (+ 181us) client_negotiation.cc:240] Negotiation successful
0809 20:16:50.524304 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":331,"threads_started":1}
I20260809 20:16:50.525290 19885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:50.506560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59126 (local address 127.14.181.62:39945)
0809 20:16:50.508173 (+ 1613us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:50.508179 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:50.508220 (+ 41us) server_negotiation.cc:407] Connection header received
0809 20:16:50.509924 (+ 1704us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:50.509929 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:50.510143 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:50.510297 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:50.511717 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:50.512888 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:50.514658 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:50.515189 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:50.515308 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:50.518428 (+ 3120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:50.518439 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:50.518452 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:50.518492 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:50.521594 (+ 3102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:50.522231 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:50.522239 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:50.522242 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:50.522457 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:50.522842 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:50.522847 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:50.522850 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:50.523491 (+ 641us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:50.523664 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:50.524153 (+ 489us) server_negotiation.cc:299] Negotiation successful
0809 20:16:50.524503 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":1428,"spinlock_wait_cycles":33024,"thread_start_us":1206,"threads_started":1}
I20260809 20:16:50.527886 19879 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.61" port: 40179 } has no permanent_uuid. Determining permanent_uuid...
I20260809 20:16:50.528802 19884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:50.528451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:40179 (local address 127.0.0.1:59662)
0809 20:16:50.528604 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:50.528700 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:40179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 20:16:50.529016 19798 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.181.61:40179: connect: Connection refused (error 111)
I20260809 20:16:50.530472 19884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:50.530075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:40179 (local address 127.0.0.1:59664)
0809 20:16:50.530212 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:50.530299 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:40179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 20:16:50.530671 19879 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.61:40179: Network error: Client connection negotiation failed: client connection to 127.14.181.61:40179: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.14.181.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.61.keytab.
Entry for principal kudu/127.14.181.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.61.keytab.
I20260809 20:16:50.565014 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.61:40179
--webserver_interface=127.14.181.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.61.keytab
--principal=kudu/127.14.181.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:42393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:39945,127.14.181.61:40179,127.14.181.60:41385
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 20:16:50.579939 19879 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.61" port: 40179 } attempt: 1
I20260809 20:16:50.580957 19884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:50.580536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:40179 (local address 127.0.0.1:59670)
0809 20:16:50.580721 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:50.580824 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:40179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260809 20:16:50.581956 19884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:50.581634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:40179 (local address 127.0.0.1:59684)
0809 20:16:50.581760 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:50.581830 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:40179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 20:16:50.582144 19879 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.61:40179: Network error: Client connection negotiation failed: client connection to 127.14.181.61:40179: connect: Connection refused (error 111)
I20260809 20:16:50.650362 19879 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.61" port: 40179 } attempt: 2
I20260809 20:16:50.651449 19884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:50.650961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:40179 (local address 127.0.0.1:59690)
0809 20:16:50.651216 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:50.651311 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:40179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 20:16:50.652562 19884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:50.652216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:40179 (local address 127.0.0.1:59698)
0809 20:16:50.652349 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:50.652420 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:40179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 20:16:50.652762 19879 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.61:40179: Network error: Client connection negotiation failed: client connection to 127.14.181.61:40179: connect: Connection refused (error 111)
I20260809 20:16:50.743980 19879 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.61" port: 40179 } attempt: 3
I20260809 20:16:50.745112 19884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:50.744695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:40179 (local address 127.0.0.1:59704)
0809 20:16:50.744888 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:50.744980 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:40179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260809 20:16:50.746078 19884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:50.745747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:40179 (local address 127.0.0.1:59708)
0809 20:16:50.745878 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:50.745946 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:40179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 20:16:50.746273 19879 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.61:40179: Network error: Client connection negotiation failed: client connection to 127.14.181.61:40179: connect: Connection refused (error 111)
W20260809 20:16:50.881157 19891 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 20:16:50.881454 19891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:50.881524 19891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:50.881600 19891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:50.888540 19891 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:16:50.888616 19891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:50.888669 19891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:50.888720 19891 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:16:50.888800 19891 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:16:50.889505 19879 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.61" port: 40179 } attempt: 4
I20260809 20:16:50.890713 19884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:50.890166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:40179 (local address 127.0.0.1:59720)
0809 20:16:50.890463 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:50.890581 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:40179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150}
I20260809 20:16:50.891683 19884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:50.891353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:40179 (local address 127.0.0.1:59736)
0809 20:16:50.891483 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:50.891565 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.61:40179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 20:16:50.891870 19879 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.61:40179: Network error: Client connection negotiation failed: client connection to 127.14.181.61:40179: connect: Connection refused (error 111)
I20260809 20:16:50.901376 19891 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:42393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:39945,127.14.181.61:40179,127.14.181.60:41385
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.61.keytab
--principal=kudu/127.14.181.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.61:40179
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.14.181.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:50.904247 19891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:50.905755 19891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 20:16:50.918670 19898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:50.918965 19903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:50.918731 19900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:50.919685 19891 server_base.cc:1034] running on GCE node
I20260809 20:16:50.920526 19891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:50.922278 19891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:50.923573 19891 hybrid_clock.cc:648] HybridClock initialized: now 1786306610923474 us; error 52 us; skew 500 ppm
I20260809 20:16:50.924010 19891 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:16:50 dist-test-slave-6zbq krb5kdc[19743](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306610, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:16:50.927654 19891 init.cc:377] Logged in from keytab as kudu/127.14.181.61@KRBTEST.COM (short username kudu)
I20260809 20:16:50.929232 19891 webserver.cc:460] Webserver started at http://127.14.181.61:36095/ using document root <none> and password file <none>
I20260809 20:16:50.930055 19891 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:50.930167 19891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:50.930550 19891 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:50.934581 19891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-1/data/instance:
uuid: "3f4acf9e64554e4981f8d1e53e45c9b1"
format_stamp: "Formatted at 2026-08-09 20:16:50 on dist-test-slave-6zbq"
server_key: "82048b10d2210f027ccc6fa8122158cb"
server_key_iv: "c1517b065afd951876d47fdee8f71507"
server_key_version: "encryptionkey@0"
I20260809 20:16:50.935635 19891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-1/wal/instance:
uuid: "3f4acf9e64554e4981f8d1e53e45c9b1"
format_stamp: "Formatted at 2026-08-09 20:16:50 on dist-test-slave-6zbq"
server_key: "82048b10d2210f027ccc6fa8122158cb"
server_key_iv: "c1517b065afd951876d47fdee8f71507"
server_key_version: "encryptionkey@0"
I20260809 20:16:50.942664 19891 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260809 20:16:50.947134 19916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:50.948486 19891 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260809 20:16:50.948655 19891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-1/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-1/wal
uuid: "3f4acf9e64554e4981f8d1e53e45c9b1"
format_stamp: "Formatted at 2026-08-09 20:16:50 on dist-test-slave-6zbq"
server_key: "82048b10d2210f027ccc6fa8122158cb"
server_key_iv: "c1517b065afd951876d47fdee8f71507"
server_key_version: "encryptionkey@0"
I20260809 20:16:50.948856 19891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:50.963341 19891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:50.967223 19891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:50.967454 19891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:50.983886 19891 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.61:40179
I20260809 20:16:50.983904 20015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.61:40179 every 8 connection(s)
I20260809 20:16:50.985057 19891 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-1/data/info.pb
I20260809 20:16:50.988391 20016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:50.990435 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 19891
I20260809 20:16:50.990603 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-1/wal/instance
I20260809 20:16:50.991029 15060 external_mini_cluster.cc:1428] Setting key a82ea13af80b252856e64582380b72e1
I20260809 20:16:50.994632 20016 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39945 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 20:16:51 dist-test-slave-6zbq krb5kdc[19743](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306610, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.61@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:16:51.018214 19885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:50.997025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59128 (local address 127.14.181.62:39945)
0809 20:16:50.997186 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:50.997190 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:50.998445 (+ 1255us) server_negotiation.cc:407] Connection header received
0809 20:16:51.000252 (+ 1807us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:51.000258 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:51.000338 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:51.000427 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:51.001869 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.002586 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.004364 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.004792 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.004902 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:51.012542 (+ 7640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:51.012547 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:51.012551 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:51.012585 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:51.015170 (+ 2585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:51.015974 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:51.015977 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:51.015979 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:51.016089 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:51.016548 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:51.016551 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:51.016554 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:51.016842 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:51.016959 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:51.017831 (+ 872us) server_negotiation.cc:299] Negotiation successful
0809 20:16:51.017998 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 20:16:51.019683 20019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:50.997573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39945 (local address 127.0.0.1:59128)
0809 20:16:50.998267 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:50.998304 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:50.999984 (+ 1680us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:51.000662 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:51.000670 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:51.001176 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:16:51.001690 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:51.001707 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.002743 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.002747 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:51.004196 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:51.004212 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.005019 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.005026 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:51.005305 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:51.009636 (+ 4331us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:16:51.009670 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:16:51.012304 (+ 2634us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:16:51.015312 (+ 3008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:51.015321 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:51.015337 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:51.015879 (+ 542us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:51.016195 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:51.016200 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:51.016203 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:51.016447 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:51.016974 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:16:51.016983 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:16:51.017458 (+ 475us) client_negotiation.cc:769] Sending connection context
0809 20:16:51.017784 (+ 326us) client_negotiation.cc:240] Negotiation successful
0809 20:16:51.018306 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":288,"threads_started":1}
WARNING: no policy specified for kudu/127.14.181.60@KRBTEST.COM; defaulting to no policy
I20260809 20:16:51.021387 20016 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.61" port: 40179 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.14.181.60@KRBTEST.COM" created.
Aug 09 20:16:51 dist-test-slave-6zbq krb5kdc[19743](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306610, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.61@KRBTEST.COM for kudu/127.14.181.61@KRBTEST.COM
I20260809 20:16:51.035247 20019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.022084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:40179 (local address 127.0.0.1:59738)
0809 20:16:51.022272 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:51.022293 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:51.022411 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:51.023379 (+ 968us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:51.023384 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:51.023824 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:16:51.024001 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:51.024012 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.025332 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.025338 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:51.026490 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:51.026505 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.027249 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.027260 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:51.027420 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:51.027931 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:16:51.027957 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:16:51.030022 (+ 2065us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:16:51.032917 (+ 2895us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:51.032922 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:51.032926 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:51.033268 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:51.033610 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:51.033615 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:51.033619 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:51.033735 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:51.034324 (+ 589us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:16:51.034328 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:16:51.034490 (+ 162us) client_negotiation.cc:769] Sending connection context
0809 20:16:51.034634 (+ 144us) client_negotiation.cc:240] Negotiation successful
0809 20:16:51.034918 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 20:16:51.035349 20021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.022231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59738 (local address 127.14.181.61:40179)
0809 20:16:51.022902 (+ 671us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:51.022910 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:51.022940 (+ 30us) server_negotiation.cc:407] Connection header received
0809 20:16:51.022995 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:51.023003 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:51.023219 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:51.023349 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:51.024164 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.025200 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.026609 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.027114 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.027207 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:51.030213 (+ 3006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:51.030225 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:51.030237 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:51.030265 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:51.032803 (+ 2538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:51.033381 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:51.033386 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:51.033389 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:51.033498 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:51.033855 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:51.033859 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:51.033861 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:51.034177 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:51.034354 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:51.034741 (+ 387us) server_negotiation.cc:299] Negotiation successful
0809 20:16:51.035035 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":92,"server-negotiator.queue_time_us":512,"thread_start_us":365,"threads_started":1}
I20260809 20:16:51.037461 20016 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } has no permanent_uuid. Determining permanent_uuid...
I20260809 20:16:51.038492 20019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.037988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41385 (local address 127.0.0.1:32938)
0809 20:16:51.038147 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:51.038287 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:41385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260809 20:16:51.038755 19920 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.181.60:41385: connect: Connection refused (error 111)
I20260809 20:16:51.040227 20019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.039864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41385 (local address 127.0.0.1:32944)
0809 20:16:51.040025 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:51.040120 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:41385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260809 20:16:51.040455 20016 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.60:41385: Network error: Client connection negotiation failed: client connection to 127.14.181.60:41385: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.14.181.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.60.keytab.
Entry for principal kudu/127.14.181.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.60.keytab.
I20260809 20:16:51.054951 15060 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
/tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.60:41385
--webserver_interface=127.14.181.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.60.keytab
--principal=kudu/127.14.181.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.14.181.20:42393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.181.62:39945,127.14.181.61:40179,127.14.181.60:41385
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 20:16:51.089738 20016 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } attempt: 1
I20260809 20:16:51.090791 20019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.090269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41385 (local address 127.0.0.1:32960)
0809 20:16:51.090498 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:51.090618 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:41385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260809 20:16:51.091777 20019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.091407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41385 (local address 127.0.0.1:32974)
0809 20:16:51.091541 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:51.091646 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:41385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 20:16:51.092013 20016 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.60:41385: Network error: Client connection negotiation failed: client connection to 127.14.181.60:41385: connect: Connection refused (error 111)
I20260809 20:16:51.160240 20016 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } attempt: 2
I20260809 20:16:51.161348 20019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.160900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41385 (local address 127.0.0.1:32982)
0809 20:16:51.161098 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:51.161192 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:41385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260809 20:16:51.162307 20019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.161977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41385 (local address 127.0.0.1:32994)
0809 20:16:51.162123 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:51.162193 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:41385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 20:16:51.162550 20016 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.60:41385: Network error: Client connection negotiation failed: client connection to 127.14.181.60:41385: connect: Connection refused (error 111)
I20260809 20:16:51.191103 19879 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.61" port: 40179 } attempt: 5
Aug 09 20:16:51 dist-test-slave-6zbq krb5kdc[19743](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306610, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for kudu/127.14.181.61@KRBTEST.COM
I20260809 20:16:51.203922 19884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.191846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:40179 (local address 127.0.0.1:59754)
0809 20:16:51.192029 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:51.192050 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:51.192178 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:51.192550 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:51.192556 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:51.192935 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:16:51.193118 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:51.193128 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.194103 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.194109 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:51.194979 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:51.194992 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.195720 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.195727 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:51.195920 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:51.196526 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:16:51.196544 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:16:51.198750 (+ 2206us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:16:51.201606 (+ 2856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:51.201612 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:51.201617 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:51.201979 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:51.202328 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:51.202333 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:51.202359 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:51.202503 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:51.203006 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:16:51.203011 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:16:51.203182 (+ 171us) client_negotiation.cc:769] Sending connection context
0809 20:16:51.203296 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 20:16:51.203568 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260809 20:16:51.203948 20021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.191964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59754 (local address 127.14.181.61:40179)
0809 20:16:51.192131 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:51.192137 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:51.192158 (+ 21us) server_negotiation.cc:407] Connection header received
0809 20:16:51.192340 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:51.192344 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:51.192409 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:51.192490 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:51.193274 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.193968 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.195126 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.195579 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.195689 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:51.198944 (+ 3255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:51.198949 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:51.198952 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:51.198984 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:51.201480 (+ 2496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:51.202092 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:51.202097 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:51.202100 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:51.202222 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:51.202614 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:51.202618 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:51.202620 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:51.202889 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:51.203026 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:51.203442 (+ 416us) server_negotiation.cc:299] Negotiation successful
0809 20:16:51.203664 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 20:16:51.205041 19879 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } has no permanent_uuid. Determining permanent_uuid...
I20260809 20:16:51.206092 19884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.205709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41385 (local address 127.0.0.1:33006)
0809 20:16:51.205886 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:51.205957 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:41385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260809 20:16:51.207118 19884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.206733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41385 (local address 127.0.0.1:33018)
0809 20:16:51.206880 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:51.206986 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:41385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 20:16:51.207336 19879 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.60:41385: Network error: Client connection negotiation failed: client connection to 127.14.181.60:41385: connect: Connection refused (error 111)
I20260809 20:16:51.253738 20016 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } attempt: 3
I20260809 20:16:51.254879 20019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.254446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41385 (local address 127.0.0.1:33028)
0809 20:16:51.254639 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:51.254735 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:41385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 20:16:51.255935 20019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.255529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41385 (local address 127.0.0.1:33038)
0809 20:16:51.255742 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:51.255821 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:41385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
W20260809 20:16:51.256151 20016 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.60:41385: Network error: Client connection negotiation failed: client connection to 127.14.181.60:41385: connect: Connection refused (error 111)
I20260809 20:16:51.258524 19879 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } attempt: 1
I20260809 20:16:51.259455 19884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.258988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41385 (local address 127.0.0.1:33052)
0809 20:16:51.259168 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:51.259276 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:41385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 20:16:51.260429 19884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.260061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41385 (local address 127.0.0.1:33068)
0809 20:16:51.260208 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:51.260302 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:41385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 20:16:51.260620 19879 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.60:41385: Network error: Client connection negotiation failed: client connection to 127.14.181.60:41385: connect: Connection refused (error 111)
I20260809 20:16:51.328842 19879 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } attempt: 2
I20260809 20:16:51.330050 19884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.329493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41385 (local address 127.0.0.1:33078)
0809 20:16:51.329730 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:51.329842 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:41385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260809 20:16:51.331138 19884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.330750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41385 (local address 127.0.0.1:33094)
0809 20:16:51.330907 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:51.330994 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:41385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 20:16:51.331367 19879 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.60:41385: Network error: Client connection negotiation failed: client connection to 127.14.181.60:41385: connect: Connection refused (error 111)
W20260809 20:16:51.369994 20029 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 20:16:51.370251 20029 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 20:16:51.370321 20029 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 20:16:51.370414 20029 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 20:16:51.377314 20029 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 20:16:51.377388 20029 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 20:16:51.377451 20029 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 20:16:51.377499 20029 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 20:16:51.377558 20029 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 20:16:51.387998 20029 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.181.20:42393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.14.181.62:39945,127.14.181.61:40179,127.14.181.60:41385
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/krb5kdc/kudu_127.14.181.60.keytab
--principal=kudu/127.14.181.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.181.60:41385
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.14.181.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 18:55:23 UTC on ccycloud.quasar-joeceo.root.comops.site
build id 4576685
ASAN enabled
I20260809 20:16:51.389101 20029 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 20:16:51.390286 20029 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 20:16:51.399351 20016 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } attempt: 4
I20260809 20:16:51.400694 20019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.400052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41385 (local address 127.0.0.1:33110)
0809 20:16:51.400407 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:51.400510 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:41385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165}
W20260809 20:16:51.400918 20038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:51.400863 20039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 20:16:51.401149 20041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 20:16:51.402067 20019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.401653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41385 (local address 127.0.0.1:33122)
0809 20:16:51.401838 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:51.401929 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:41385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 20:16:51.402302 20029 server_base.cc:1034] running on GCE node
W20260809 20:16:51.402304 20016 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.60:41385: Network error: Client connection negotiation failed: client connection to 127.14.181.60:41385: connect: Connection refused (error 111)
I20260809 20:16:51.402992 20029 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 20:16:51.404212 20029 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 20:16:51.405416 20029 hybrid_clock.cc:648] HybridClock initialized: now 1786306611405356 us; error 29 us; skew 500 ppm
I20260809 20:16:51.405704 20029 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 20:16:51 dist-test-slave-6zbq krb5kdc[19743](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306611, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 20:16:51.408609 20029 init.cc:377] Logged in from keytab as kudu/127.14.181.60@KRBTEST.COM (short username kudu)
I20260809 20:16:51.409878 20029 webserver.cc:460] Webserver started at http://127.14.181.60:38361/ using document root <none> and password file <none>
I20260809 20:16:51.410503 20029 fs_manager.cc:359] Metadata directory not provided
I20260809 20:16:51.410597 20029 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 20:16:51.410848 20029 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 20:16:51.413494 20029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-2/data/instance:
uuid: "f437283a484a4c4090311dcbcc7041ec"
format_stamp: "Formatted at 2026-08-09 20:16:51 on dist-test-slave-6zbq"
server_key: "5e35975e613456396c5f3ea4e92f3972"
server_key_iv: "2d31b6ce15e2b1cdef44986085dbdd46"
server_key_version: "encryptionkey@0"
I20260809 20:16:51.414191 20029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-2/wal/instance:
uuid: "f437283a484a4c4090311dcbcc7041ec"
format_stamp: "Formatted at 2026-08-09 20:16:51 on dist-test-slave-6zbq"
server_key: "5e35975e613456396c5f3ea4e92f3972"
server_key_iv: "2d31b6ce15e2b1cdef44986085dbdd46"
server_key_version: "encryptionkey@0"
I20260809 20:16:51.418709 20029 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 20:16:51.421756 20048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 20:16:51.422950 20029 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 20:16:51.423102 20029 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-2/data,/tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-2/wal
uuid: "f437283a484a4c4090311dcbcc7041ec"
format_stamp: "Formatted at 2026-08-09 20:16:51 on dist-test-slave-6zbq"
server_key: "5e35975e613456396c5f3ea4e92f3972"
server_key_iv: "2d31b6ce15e2b1cdef44986085dbdd46"
server_key_version: "encryptionkey@0"
I20260809 20:16:51.423290 20029 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 20:16:51.437451 20029 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 20:16:51.437597 19879 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } attempt: 3
I20260809 20:16:51.438531 19884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.438064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41385 (local address 127.0.0.1:33132)
0809 20:16:51.438265 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:51.438372 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:41385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 20:16:51.439465 19884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.439133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41385 (local address 127.0.0.1:33138)
0809 20:16:51.439301 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:51.439366 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.181.60:41385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 20:16:51.439659 19879 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.14.181.60:41385: Network error: Client connection negotiation failed: client connection to 127.14.181.60:41385: connect: Connection refused (error 111)
I20260809 20:16:51.441447 20029 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 20:16:51.441672 20029 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 20:16:51.457749 20029 rpc_server.cc:307] RPC server started. Bound to: 127.14.181.60:41385
I20260809 20:16:51.457760 20136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.14.181.60:41385 every 8 connection(s)
I20260809 20:16:51.458897 20029 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-2/data/info.pb
I20260809 20:16:51.462108 20137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 20:16:51.466969 15060 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu as pid 20029
I20260809 20:16:51.467140 15060 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpWWQ8t/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786306256699363-15060-0/minicluster-data/master-2/wal/instance
I20260809 20:16:51.467546 15060 external_mini_cluster.cc:1428] Setting key 741fbd744b1e7c134675148ec3051358
I20260809 20:16:51.468140 20137 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39945 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 20:16:51 dist-test-slave-6zbq krb5kdc[19743](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306611, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.60@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
Aug 09 20:16:51 dist-test-slave-6zbq krb5kdc[19743](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306609, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.60@KRBTEST.COM
I20260809 20:16:51.485759 19885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.470689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59132 (local address 127.14.181.62:39945)
0809 20:16:51.470879 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:51.470885 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:51.471579 (+ 694us) server_negotiation.cc:407] Connection header received
0809 20:16:51.471979 (+ 400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:51.471984 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:51.472059 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:51.472159 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:51.473693 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.474753 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.476579 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.477078 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.477193 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:51.480336 (+ 3143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:51.480341 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:51.480344 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:51.480375 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:51.482952 (+ 2577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:51.483681 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:51.483687 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:51.483691 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:51.483823 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:51.484206 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:51.484212 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:51.484215 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:51.484458 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:51.484596 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:51.485195 (+ 599us) server_negotiation.cc:299] Negotiation successful
0809 20:16:51.485413 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 20:16:51.486711 20141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.469053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33144 (local address 127.14.181.60:41385)
0809 20:16:51.469777 (+ 724us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:51.469786 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:51.469824 (+ 38us) server_negotiation.cc:407] Connection header received
0809 20:16:51.471742 (+ 1918us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:51.471761 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:51.472010 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:51.472213 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:51.473881 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.475327 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.476923 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.477651 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.477742 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:51.481345 (+ 3603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:51.481352 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:51.481363 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:51.481389 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:51.483835 (+ 2446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:51.484442 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:51.484447 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:51.484450 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:51.484566 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:51.484909 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:51.484914 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:51.484917 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:51.485236 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:51.485515 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:51.485914 (+ 399us) server_negotiation.cc:299] Negotiation successful
0809 20:16:51.486131 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":547,"thread_start_us":342,"threads_started":1}
I20260809 20:16:51.486740 20142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.470688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.62:39945 (local address 127.0.0.1:59132)
0809 20:16:51.471436 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:51.471476 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:51.471775 (+ 299us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:51.472248 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:51.472255 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:51.473006 (+ 751us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:16:51.473506 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:51.473531 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.474894 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.474898 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:51.476439 (+ 1541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:51.476454 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.477291 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.477296 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:51.477517 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:51.478138 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:16:51.478159 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:16:51.480165 (+ 2006us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:16:51.483071 (+ 2906us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:51.483082 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:51.483092 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:51.483569 (+ 477us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:51.483926 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:51.483931 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:51.483935 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:51.484101 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:51.484588 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:16:51.484595 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:16:51.484867 (+ 272us) client_negotiation.cc:769] Sending connection context
0809 20:16:51.485083 (+ 216us) client_negotiation.cc:240] Negotiation successful
0809 20:16:51.485510 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"mutex_wait_us":21,"thread_start_us":314,"threads_started":1}
I20260809 20:16:51.488132 20137 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.61" port: 40179 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 20:16:51 dist-test-slave-6zbq krb5kdc[19743](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306611, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.60@KRBTEST.COM for kudu/127.14.181.61@KRBTEST.COM
Aug 09 20:16:51 dist-test-slave-6zbq krb5kdc[19743](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306609, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.62@KRBTEST.COM
I20260809 20:16:51.502074 20142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.488832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.61:40179 (local address 127.0.0.1:59764)
0809 20:16:51.488967 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:51.488984 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:51.489077 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:51.489408 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:51.489411 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:51.489801 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:16:51.489984 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:51.489996 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.491280 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.491284 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:51.492503 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:51.492517 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.493432 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.493438 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:51.493629 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:51.494148 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:16:51.494169 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:16:51.496434 (+ 2265us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:16:51.499769 (+ 3335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:51.499774 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:51.499777 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:51.500233 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:51.500571 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:51.500576 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:51.500580 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:51.500717 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:51.501267 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:16:51.501272 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:16:51.501404 (+ 132us) client_negotiation.cc:769] Sending connection context
0809 20:16:51.501516 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 20:16:51.501752 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 20:16:51.502314 20021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.488794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59764 (local address 127.14.181.61:40179)
0809 20:16:51.488969 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:51.488975 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:51.489030 (+ 55us) server_negotiation.cc:407] Connection header received
0809 20:16:51.489199 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:51.489204 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:51.489279 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:51.489379 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:51.490130 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.491151 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.492653 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.493282 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.493396 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:51.496634 (+ 3238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:51.496641 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:51.496646 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:51.496686 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:51.499641 (+ 2955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:51.500331 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:51.500334 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:51.500336 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:51.500459 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:51.500818 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:51.500822 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:51.500824 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:51.501145 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:51.501287 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:51.501618 (+ 331us) server_negotiation.cc:299] Negotiation successful
0809 20:16:51.501820 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 20:16:51.503185 20137 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } has no permanent_uuid. Determining permanent_uuid...
I20260809 20:16:51.505026 19885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.489834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59148 (local address 127.14.181.62:39945)
0809 20:16:51.489996 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:51.490001 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:51.490019 (+ 18us) server_negotiation.cc:407] Connection header received
0809 20:16:51.490062 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:51.490067 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:51.490132 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:51.490200 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:51.491532 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.492631 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.493954 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.494616 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.494736 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:51.498987 (+ 4251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:51.498993 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:51.498997 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:51.499039 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:51.502164 (+ 3125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:51.502912 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:51.502918 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:51.502922 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:51.503080 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:51.503469 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:51.503472 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:51.503474 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:51.503790 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:51.504045 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:51.504552 (+ 507us) server_negotiation.cc:299] Negotiation successful
0809 20:16:51.504772 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
Aug 09 20:16:51 dist-test-slave-6zbq krb5kdc[19743](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306611, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.60@KRBTEST.COM for kudu/127.14.181.60@KRBTEST.COM
Aug 09 20:16:51 dist-test-slave-6zbq krb5kdc[19743](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306609, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.14.181.61@KRBTEST.COM
I20260809 20:16:51.514212 20142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.503765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41385 (local address 127.0.0.1:33158)
0809 20:16:51.503917 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:51.503932 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:51.504009 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:51.504241 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:51.504244 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:51.504538 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:16:51.504661 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:51.504668 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.505712 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.505727 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:51.506705 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:51.506725 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.507346 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.507352 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:51.507524 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:51.507956 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:16:51.507971 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:16:51.509572 (+ 1601us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:16:51.512088 (+ 2516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:51.512092 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:51.512096 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:51.512411 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:51.512721 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:51.512726 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:51.512730 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:51.512839 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:51.513310 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:16:51.513314 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:16:51.513438 (+ 124us) client_negotiation.cc:769] Sending connection context
0809 20:16:51.513554 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 20:16:51.513810 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 20:16:51.514252 20141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.503898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33158 (local address 127.14.181.60:41385)
0809 20:16:51.504025 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:51.504029 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:51.504045 (+ 16us) server_negotiation.cc:407] Connection header received
0809 20:16:51.504087 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:51.504091 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:51.504150 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:51.504239 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:51.504781 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.505606 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.506828 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.507223 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.507331 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:51.509731 (+ 2400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:51.509736 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:51.509739 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:51.509764 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:51.511975 (+ 2211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:51.512509 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:51.512514 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:51.512516 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:51.512619 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:51.512932 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:51.512937 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:51.512940 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:51.513202 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:51.513327 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:51.513652 (+ 325us) server_negotiation.cc:299] Negotiation successful
0809 20:16:51.513959 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":109,"server-negotiator.queue_time_us":33}
I20260809 20:16:51.519281 20021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.506577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59780 (local address 127.14.181.61:40179)
0809 20:16:51.506745 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:51.506749 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:51.506761 (+ 12us) server_negotiation.cc:407] Connection header received
0809 20:16:51.506794 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:51.506797 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:51.506842 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:51.506914 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:51.507993 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.508664 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.509859 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.510271 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.510394 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:51.513956 (+ 3562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:51.513960 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:51.513963 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:51.513990 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:51.516961 (+ 2971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:51.517548 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:51.517553 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:51.517556 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:51.517703 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:51.517996 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:51.518000 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:51.518003 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:51.518333 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:51.518594 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:51.518764 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 20:16:51.518966 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 20:16:51.519510 20137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f437283a484a4c4090311dcbcc7041ec: Bootstrap starting.
I20260809 20:16:51.522814 20137 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f437283a484a4c4090311dcbcc7041ec: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:51.523518 15060 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 20:16:51.523782 20137 log.cc:824] T 00000000000000000000000000000000 P f437283a484a4c4090311dcbcc7041ec: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:51.526521 20137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f437283a484a4c4090311dcbcc7041ec: No bootstrap required, opened a new log
I20260809 20:16:51.526149 19840 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "3e70598fd6a04d199f9dcd29c06d77dc"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59148
I20260809 20:16:51.536703 20137 raft_consensus.cc:348] T 00000000000000000000000000000000 P f437283a484a4c4090311dcbcc7041ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39945 } } peers { permanent_uuid: "3f4acf9e64554e4981f8d1e53e45c9b1" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 40179 } } peers { permanent_uuid: "f437283a484a4c4090311dcbcc7041ec" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } }
I20260809 20:16:51.537048 20137 raft_consensus.cc:729] T 00000000000000000000000000000000 P f437283a484a4c4090311dcbcc7041ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f437283a484a4c4090311dcbcc7041ec, State: Initialized, Role: FOLLOWER
I20260809 20:16:51.537495 20137 consensus_queue.cc:260] T 00000000000000000000000000000000 P f437283a484a4c4090311dcbcc7041ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39945 } } peers { permanent_uuid: "3f4acf9e64554e4981f8d1e53e45c9b1" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 40179 } } peers { permanent_uuid: "f437283a484a4c4090311dcbcc7041ec" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } }
I20260809 20:16:51.538333 20146 sys_catalog.cc:455] T 00000000000000000000000000000000 P f437283a484a4c4090311dcbcc7041ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39945 } } peers { permanent_uuid: "3f4acf9e64554e4981f8d1e53e45c9b1" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 40179 } } peers { permanent_uuid: "f437283a484a4c4090311dcbcc7041ec" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } } }
I20260809 20:16:51.538671 20146 sys_catalog.cc:458] T 00000000000000000000000000000000 P f437283a484a4c4090311dcbcc7041ec [sys.catalog]: This master's current role is: FOLLOWER
I20260809 20:16:51.539422 20137 sys_catalog.cc:564] T 00000000000000000000000000000000 P f437283a484a4c4090311dcbcc7041ec [sys.catalog]: configured and running, proceeding with master startup.
W20260809 20:16:51.548019 20165 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f437283a484a4c4090311dcbcc7041ec: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 20:16:51.548142 20165 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 20:16:51.545949 20029 master_runner.cc:186] Error getting master registration for 127.14.181.62:39945: OK, instance_id { permanent_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" instance_seqno: 1786306610487681 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 20:16:51.555150 20029 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 20:16:51.616868 19879 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } attempt: 4
Aug 09 20:16:51 dist-test-slave-6zbq krb5kdc[19743](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306610, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.62@KRBTEST.COM for kudu/127.14.181.60@KRBTEST.COM
I20260809 20:16:51.632892 19884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.617553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41385 (local address 127.0.0.1:33170)
0809 20:16:51.617731 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:51.617751 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:51.617851 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:51.618175 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:51.618179 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:51.618706 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:16:51.618936 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:51.618950 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.620374 (+ 1424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.620380 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:51.621877 (+ 1497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:51.621894 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.622933 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.622939 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:51.623166 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:51.623804 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:16:51.623837 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:16:51.626260 (+ 2423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:16:51.630217 (+ 3957us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:51.630223 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:51.630228 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:51.630744 (+ 516us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:51.631118 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:51.631123 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:51.631127 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:51.631295 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:51.631931 (+ 636us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:16:51.631936 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:16:51.632094 (+ 158us) client_negotiation.cc:769] Sending connection context
0809 20:16:51.632235 (+ 141us) client_negotiation.cc:240] Negotiation successful
0809 20:16:51.632495 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 20:16:51.632925 20141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.617648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33170 (local address 127.14.181.60:41385)
0809 20:16:51.617825 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:51.617831 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:51.617854 (+ 23us) server_negotiation.cc:407] Connection header received
0809 20:16:51.617946 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:51.617951 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:51.618033 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:51.618141 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:51.619091 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.620241 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.622024 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.622783 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.622911 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:51.626446 (+ 3535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:51.626453 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:51.626458 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:51.626495 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:51.630091 (+ 3596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:51.630851 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:51.630857 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:51.630861 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:51.631006 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:51.631397 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:51.631403 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:51.631406 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:51.631822 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:51.631976 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:51.632338 (+ 362us) server_negotiation.cc:299] Negotiation successful
0809 20:16:51.632543 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 20:16:51.638741 19879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc: Bootstrap starting.
I20260809 20:16:51.642693 19879 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:51.643930 19879 log.cc:824] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:51.647141 19879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc: No bootstrap required, opened a new log
I20260809 20:16:51.654695 19879 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39945 } } peers { permanent_uuid: "3f4acf9e64554e4981f8d1e53e45c9b1" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 40179 } } peers { permanent_uuid: "f437283a484a4c4090311dcbcc7041ec" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } }
I20260809 20:16:51.655061 19879 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e70598fd6a04d199f9dcd29c06d77dc, State: Initialized, Role: FOLLOWER
I20260809 20:16:51.655537 19879 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39945 } } peers { permanent_uuid: "3f4acf9e64554e4981f8d1e53e45c9b1" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 40179 } } peers { permanent_uuid: "f437283a484a4c4090311dcbcc7041ec" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } }
I20260809 20:16:51.656663 20170 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39945 } } peers { permanent_uuid: "3f4acf9e64554e4981f8d1e53e45c9b1" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 40179 } } peers { permanent_uuid: "f437283a484a4c4090311dcbcc7041ec" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } } }
I20260809 20:16:51.657229 20170 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc [sys.catalog]: This master's current role is: FOLLOWER
I20260809 20:16:51.657745 19879 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:16:51.657820 19840 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 20:16:51.657984 19840 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:51.661326 19840 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39945 } } peers { permanent_uuid: "3f4acf9e64554e4981f8d1e53e45c9b1" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 40179 } } peers { permanent_uuid: "f437283a484a4c4090311dcbcc7041ec" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } }
I20260809 20:16:51.664644 20092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f437283a484a4c4090311dcbcc7041ec"
I20260809 20:16:51.665100 20092 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f437283a484a4c4090311dcbcc7041ec [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:51.665572 19840 leader_election.cc:288] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc [CANDIDATE]: Term 1 election: Requested vote from peers 3f4acf9e64554e4981f8d1e53e45c9b1 (127.14.181.61:40179), f437283a484a4c4090311dcbcc7041ec (127.14.181.60:41385)
I20260809 20:16:51.668491 20092 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f437283a484a4c4090311dcbcc7041ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e70598fd6a04d199f9dcd29c06d77dc in term 1.
I20260809 20:16:51.669060 19798 leader_election.cc:302] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e70598fd6a04d199f9dcd29c06d77dc, f437283a484a4c4090311dcbcc7041ec; no voters:
I20260809 20:16:51.670977 20170 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 20:16:51.674822 20170 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc [term 1 LEADER]: Becoming Leader. State: Replica: 3e70598fd6a04d199f9dcd29c06d77dc, State: Running, Role: LEADER
I20260809 20:16:51.675345 20170 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39945 } } peers { permanent_uuid: "3f4acf9e64554e4981f8d1e53e45c9b1" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 40179 } } peers { permanent_uuid: "f437283a484a4c4090311dcbcc7041ec" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } }
W20260809 20:16:51.679963 20184 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 20:16:51.680137 20184 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 20:16:51.672621 19769 master_runner.cc:186] Error getting master registration for 127.14.181.61:40179: OK, instance_id { permanent_uuid: "3f4acf9e64554e4981f8d1e53e45c9b1" instance_seqno: 1786306610979264 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 20:16:51.684291 19769 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 20:16:51.693430 20057 tablet.cc:2369] T 00000000000000000000000000000000 P f437283a484a4c4090311dcbcc7041ec: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:16:51.693586 20189 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3e70598fd6a04d199f9dcd29c06d77dc. Latest consensus state: current_term: 1 leader_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39945 } } peers { permanent_uuid: "3f4acf9e64554e4981f8d1e53e45c9b1" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 40179 } } peers { permanent_uuid: "f437283a484a4c4090311dcbcc7041ec" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } } }
I20260809 20:16:51.693939 20189 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:51.694977 20195 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 20:16:51.698453 20195 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 20:16:51.701524 20016 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } attempt: 5
Aug 09 20:16:51 dist-test-slave-6zbq krb5kdc[19743](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786306610, etypes {rep=17 tkt=17 ses=17}, kudu/127.14.181.61@KRBTEST.COM for kudu/127.14.181.60@KRBTEST.COM
I20260809 20:16:51.719125 20141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.702765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33178 (local address 127.14.181.60:41385)
0809 20:16:51.702922 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:51.702928 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:51.702944 (+ 16us) server_negotiation.cc:407] Connection header received
0809 20:16:51.702994 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:51.703000 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:51.703084 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:51.703187 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:51.704262 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.705347 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.707161 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.707797 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.707909 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:51.712055 (+ 4146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:51.712062 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:51.712067 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:51.712118 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:51.715463 (+ 3345us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:51.716323 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:51.716330 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:51.716335 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:51.716486 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:51.716907 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:51.716913 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:51.716917 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:51.717257 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:51.717403 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:51.718538 (+ 1135us) server_negotiation.cc:299] Negotiation successful
0809 20:16:51.718781 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 20:16:51.719643 20019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.702052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.181.60:41385 (local address 127.0.0.1:33178)
0809 20:16:51.702444 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0809 20:16:51.702463 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 20:16:51.702572 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 20:16:51.703367 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 20:16:51.703372 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 20:16:51.703868 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0809 20:16:51.704073 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:51.704086 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.705512 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.705518 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:51.706977 (+ 1459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 20:16:51.706993 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.708121 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.708128 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 20:16:51.708364 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:51.709023 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 20:16:51.709049 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 20:16:51.711849 (+ 2800us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 20:16:51.715620 (+ 3771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:51.715626 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:51.715631 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:51.716182 (+ 551us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:51.716611 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 20:16:51.716615 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 20:16:51.716619 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 20:16:51.716781 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 20:16:51.717468 (+ 687us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 20:16:51.717474 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 20:16:51.717707 (+ 233us) client_negotiation.cc:769] Sending connection context
0809 20:16:51.717915 (+ 208us) client_negotiation.cc:240] Negotiation successful
0809 20:16:51.718215 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252}
I20260809 20:16:51.723827 20092 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f437283a484a4c4090311dcbcc7041ec [term 1 FOLLOWER]: Refusing update from remote peer 3e70598fd6a04d199f9dcd29c06d77dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:16:51.724753 20189 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f437283a484a4c4090311dcbcc7041ec" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:16:51.726015 20016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f4acf9e64554e4981f8d1e53e45c9b1: Bootstrap starting.
W20260809 20:16:51.728204 19806 tablet.cc:2369] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 20:16:51.733242 20016 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f4acf9e64554e4981f8d1e53e45c9b1: Neither blocks nor log segments found. Creating new log.
I20260809 20:16:51.735131 20016 log.cc:824] T 00000000000000000000000000000000 P 3f4acf9e64554e4981f8d1e53e45c9b1: Log is configured to *not* fsync() on all Append() calls
I20260809 20:16:51.747344 20016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f4acf9e64554e4981f8d1e53e45c9b1: No bootstrap required, opened a new log
I20260809 20:16:51.747803 20146 sys_catalog.cc:455] T 00000000000000000000000000000000 P f437283a484a4c4090311dcbcc7041ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3e70598fd6a04d199f9dcd29c06d77dc. Latest consensus state: current_term: 1 leader_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39945 } } peers { permanent_uuid: "3f4acf9e64554e4981f8d1e53e45c9b1" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 40179 } } peers { permanent_uuid: "f437283a484a4c4090311dcbcc7041ec" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } } }
I20260809 20:16:51.748098 20146 sys_catalog.cc:458] T 00000000000000000000000000000000 P f437283a484a4c4090311dcbcc7041ec [sys.catalog]: This master's current role is: FOLLOWER
I20260809 20:16:51.751466 20197 mvcc.cc:205] Tried to move back new op lower bound from 7316711881611329536 to 7316711881427087360. Current Snapshot: MvccSnapshot[applied={T|T < 7316711881611329536}]
I20260809 20:16:51.753625 20170 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39945 } } peers { permanent_uuid: "3f4acf9e64554e4981f8d1e53e45c9b1" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 40179 } } peers { permanent_uuid: "f437283a484a4c4090311dcbcc7041ec" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } } }
I20260809 20:16:51.753926 20170 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:51.755224 20207 mvcc.cc:205] Tried to move back new op lower bound from 7316711881611329536 to 7316711881427087360. Current Snapshot: MvccSnapshot[applied={T|T < 7316711881611329536}]
I20260809 20:16:51.761034 20195 catalog_manager.cc:1347] Generated new cluster ID: 79360fbaa1af46878ce8cbfde3abd5f4
I20260809 20:16:51.761154 20195 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 20:16:51.768546 20146 sys_catalog.cc:455] T 00000000000000000000000000000000 P f437283a484a4c4090311dcbcc7041ec [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39945 } } peers { permanent_uuid: "3f4acf9e64554e4981f8d1e53e45c9b1" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 40179 } } peers { permanent_uuid: "f437283a484a4c4090311dcbcc7041ec" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } } }
I20260809 20:16:51.768800 20146 sys_catalog.cc:458] T 00000000000000000000000000000000 P f437283a484a4c4090311dcbcc7041ec [sys.catalog]: This master's current role is: FOLLOWER
I20260809 20:16:51.771610 20016 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f4acf9e64554e4981f8d1e53e45c9b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39945 } } peers { permanent_uuid: "3f4acf9e64554e4981f8d1e53e45c9b1" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 40179 } } peers { permanent_uuid: "f437283a484a4c4090311dcbcc7041ec" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } }
I20260809 20:16:51.772253 20016 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f4acf9e64554e4981f8d1e53e45c9b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f4acf9e64554e4981f8d1e53e45c9b1, State: Initialized, Role: FOLLOWER
I20260809 20:16:51.772970 20016 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f4acf9e64554e4981f8d1e53e45c9b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39945 } } peers { permanent_uuid: "3f4acf9e64554e4981f8d1e53e45c9b1" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 40179 } } peers { permanent_uuid: "f437283a484a4c4090311dcbcc7041ec" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } }
I20260809 20:16:51.783643 20016 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f4acf9e64554e4981f8d1e53e45c9b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 20:16:51.784452 19971 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f4acf9e64554e4981f8d1e53e45c9b1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 20:16:51.783671 19972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3f4acf9e64554e4981f8d1e53e45c9b1"
I20260809 20:16:51.788987 19971 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3f4acf9e64554e4981f8d1e53e45c9b1 [term 1 FOLLOWER]: Refusing update from remote peer 3e70598fd6a04d199f9dcd29c06d77dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 20:16:51.792294 19972 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3f4acf9e64554e4981f8d1e53e45c9b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e70598fd6a04d199f9dcd29c06d77dc in term 1.
I20260809 20:16:51.794176 20189 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f4acf9e64554e4981f8d1e53e45c9b1" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 20:16:51.797950 20021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.715755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59784 (local address 127.14.181.61:40179)
0809 20:16:51.715921 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:51.715927 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:51.743059 (+ 27132us) server_negotiation.cc:407] Connection header received
0809 20:16:51.743306 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:51.743311 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:51.743390 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:51.743459 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:51.756560 (+ 13101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.757609 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.759413 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.760053 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.760159 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:51.780664 (+ 20505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:51.780672 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:51.780677 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:51.780716 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:51.789287 (+ 8571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:51.795380 (+ 6093us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:51.795386 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:51.795390 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:51.795550 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:51.796001 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:51.796006 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:51.796010 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:51.796346 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:51.796569 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:51.797360 (+ 791us) server_negotiation.cc:299] Negotiation successful
0809 20:16:51.797587 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 20:16:51.802742 20141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.734226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33192 (local address 127.14.181.60:41385)
0809 20:16:51.734397 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:51.734403 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:51.744704 (+ 10301us) server_negotiation.cc:407] Connection header received
0809 20:16:51.744932 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:51.744936 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:51.745071 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:51.745155 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:51.754105 (+ 8950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.755185 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.763843 (+ 8658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.764501 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.764632 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:51.784085 (+ 19453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:51.784092 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:51.784096 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:51.784134 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:51.787734 (+ 3600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:51.797023 (+ 9289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:51.797029 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:51.797032 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:51.797174 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:51.799801 (+ 2627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:51.799806 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:51.799810 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:51.800171 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:51.800435 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:51.802064 (+ 1629us) server_negotiation.cc:299] Negotiation successful
0809 20:16:51.802321 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 20:16:51.810092 19885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:51.714031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59156 (local address 127.14.181.62:39945)
0809 20:16:51.714202 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:51.714207 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:51.736544 (+ 22337us) server_negotiation.cc:407] Connection header received
0809 20:16:51.737555 (+ 1011us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:51.737560 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:51.737638 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:51.737712 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:51.755353 (+ 17641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.756378 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.762864 (+ 6486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:51.763551 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:51.763679 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:51.788577 (+ 24898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 20:16:51.788584 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 20:16:51.788588 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 20:16:51.788639 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 20:16:51.792226 (+ 3587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:51.801048 (+ 8822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:51.801054 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:51.801057 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:51.801240 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 20:16:51.805084 (+ 3844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 20:16:51.805090 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 20:16:51.805094 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 20:16:51.805451 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 20:16:51.805742 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:51.809448 (+ 3706us) server_negotiation.cc:299] Negotiation successful
0809 20:16:51.809711 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":52}
I20260809 20:16:51.816702 20195 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 20:16:51.818456 20195 catalog_manager.cc:1504] Loading token signing keys...
I20260809 20:16:51.837855 20195 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc: Generated new TSK 0
I20260809 20:16:51.838909 20195 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 20:16:51.863174 20218 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f4acf9e64554e4981f8d1e53e45c9b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3e70598fd6a04d199f9dcd29c06d77dc. Latest consensus state: current_term: 1 leader_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39945 } } peers { permanent_uuid: "3f4acf9e64554e4981f8d1e53e45c9b1" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 40179 } } peers { permanent_uuid: "f437283a484a4c4090311dcbcc7041ec" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } } }
I20260809 20:16:51.863659 20218 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f4acf9e64554e4981f8d1e53e45c9b1 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 20:16:51.864741 20216 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f4acf9e64554e4981f8d1e53e45c9b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39945 } } peers { permanent_uuid: "3f4acf9e64554e4981f8d1e53e45c9b1" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 40179 } } peers { permanent_uuid: "f437283a484a4c4090311dcbcc7041ec" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } } }
I20260809 20:16:51.865113 20216 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f4acf9e64554e4981f8d1e53e45c9b1 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 20:16:51.865806 20225 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f4acf9e64554e4981f8d1e53e45c9b1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39945 } } peers { permanent_uuid: "3f4acf9e64554e4981f8d1e53e45c9b1" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 40179 } } peers { permanent_uuid: "f437283a484a4c4090311dcbcc7041ec" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } } }
I20260809 20:16:51.866094 20225 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f4acf9e64554e4981f8d1e53e45c9b1 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 20:16:51.871616 20189 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e70598fd6a04d199f9dcd29c06d77dc" member_type: VOTER last_known_addr { host: "127.14.181.62" port: 39945 } } peers { permanent_uuid: "3f4acf9e64554e4981f8d1e53e45c9b1" member_type: VOTER last_known_addr { host: "127.14.181.61" port: 40179 } } peers { permanent_uuid: "f437283a484a4c4090311dcbcc7041ec" member_type: VOTER last_known_addr { host: "127.14.181.60" port: 41385 } } }
I20260809 20:16:51.871891 20189 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e70598fd6a04d199f9dcd29c06d77dc [sys.catalog]: This master's current role is: LEADER
I20260809 20:16:51.906958 20243 catalog_manager.cc:1259] Loaded cluster ID: 79360fbaa1af46878ce8cbfde3abd5f4
I20260809 20:16:51.907063 20243 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3f4acf9e64554e4981f8d1e53e45c9b1: loading cluster ID for follower catalog manager: success
I20260809 20:16:51.910661 20243 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3f4acf9e64554e4981f8d1e53e45c9b1: acquiring CA information for follower catalog manager: success
I20260809 20:16:51.913007 20243 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3f4acf9e64554e4981f8d1e53e45c9b1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 20:16:51.980516 19885 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:16:51.959402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59162 (local address 127.14.181.62:39945)
0809 20:16:51.959607 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:51.959613 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:51.976489 (+ 16876us) server_negotiation.cc:407] Connection header received
0809 20:16:51.978952 (+ 2463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:51.978958 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:51.979040 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:51.979127 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:51.980264 (+ 1137us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59162: BlockingRecv error: recv got EOF from 127.0.0.1:59162 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260809 20:16:51.984745 20141 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:16:51.977010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33206 (local address 127.14.181.60:41385)
0809 20:16:51.977188 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:51.977194 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:51.982832 (+ 5638us) server_negotiation.cc:407] Connection header received
0809 20:16:51.983047 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:51.983053 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:51.983141 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:51.983215 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:51.984520 (+ 1305us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33206: BlockingRecv error: recv got EOF from 127.0.0.1:33206 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260809 20:16:51.986066 20021 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:16:51.961151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59792 (local address 127.14.181.61:40179)
0809 20:16:51.961343 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:51.961350 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:51.982258 (+ 20908us) server_negotiation.cc:407] Connection header received
0809 20:16:51.983450 (+ 1192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:51.983455 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:51.983535 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:51.983611 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:51.985869 (+ 2258us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59792: BlockingRecv error: recv got EOF from 127.0.0.1:59792 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 20:16:52.036695 20021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:52.017512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59808 (local address 127.14.181.61:40179)
0809 20:16:52.017680 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:52.017686 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:52.028994 (+ 11308us) server_negotiation.cc:407] Connection header received
0809 20:16:52.029516 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:52.029522 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:52.029704 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:52.029838 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:16:52.030606 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:52.031754 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:52.033746 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:52.034442 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:52.034541 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:52.035258 (+ 717us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:16:52.035892 (+ 634us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:16:52.036016 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:52.036263 (+ 247us) server_negotiation.cc:299] Negotiation successful
0809 20:16:52.036363 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
W20260809 20:16:52.071249 20141 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:16:52.068992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33220 (local address 127.14.181.60:41385)
0809 20:16:52.069183 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:52.069189 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:52.069654 (+ 465us) server_negotiation.cc:407] Connection header received
0809 20:16:52.069855 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:52.069861 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:52.069981 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:52.070092 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:52.070998 (+ 906us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33220: BlockingRecv error: recv got EOF from 127.0.0.1:33220 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 20:16:52.081809 20021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:52.075286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59814 (local address 127.14.181.61:40179)
0809 20:16:52.075450 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:52.075456 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:52.075906 (+ 450us) server_negotiation.cc:407] Connection header received
0809 20:16:52.076116 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:52.076122 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:52.076210 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:52.076303 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:16:52.076709 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:52.077841 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:52.079750 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:52.080439 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:52.080569 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:52.080984 (+ 415us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:16:52.081163 (+ 179us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:16:52.081257 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:52.081405 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 20:16:52.081491 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
W20260809 20:16:52.090392 20141 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:16:52.088928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33222 (local address 127.14.181.60:41385)
0809 20:16:52.089090 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:52.089096 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:52.089122 (+ 26us) server_negotiation.cc:407] Connection header received
0809 20:16:52.089182 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:52.089187 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:52.089279 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:52.089378 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:52.090163 (+ 785us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33222: BlockingRecv error: recv got EOF from 127.0.0.1:33222 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 20:16:52.101816 20021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:52.095590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59828 (local address 127.14.181.61:40179)
0809 20:16:52.095760 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:52.095765 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:52.095871 (+ 106us) server_negotiation.cc:407] Connection header received
0809 20:16:52.096100 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:52.096105 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:52.096190 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:52.096289 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:16:52.096733 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:52.097848 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:52.099801 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:52.100440 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:52.100577 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:52.101024 (+ 447us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:16:52.101203 (+ 179us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:16:52.101295 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:52.101440 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 20:16:52.101513 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
W20260809 20:16:52.117568 20141 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:16:52.115723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33228 (local address 127.14.181.60:41385)
0809 20:16:52.115883 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:52.115889 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:52.116073 (+ 184us) server_negotiation.cc:407] Connection header received
0809 20:16:52.116332 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:52.116337 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:52.116419 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:52.116482 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:52.117365 (+ 883us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33228: BlockingRecv error: recv got EOF from 127.0.0.1:33228 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 20:16:52.133705 20021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:52.127222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59834 (local address 127.14.181.61:40179)
0809 20:16:52.127426 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:52.127432 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:52.127944 (+ 512us) server_negotiation.cc:407] Connection header received
0809 20:16:52.128109 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:52.128114 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:52.128189 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:52.128279 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:16:52.128698 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:52.129804 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:52.131685 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:52.132431 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:52.132550 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:52.133005 (+ 455us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:16:52.133145 (+ 140us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:16:52.133230 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:52.133394 (+ 164us) server_negotiation.cc:299] Negotiation successful
0809 20:16:52.133471 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
W20260809 20:16:52.152370 20141 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:16:52.146289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33234 (local address 127.14.181.60:41385)
0809 20:16:52.146535 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:52.146541 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:52.150865 (+ 4324us) server_negotiation.cc:407] Connection header received
0809 20:16:52.151121 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:52.151126 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:52.151222 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:52.151319 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:52.152105 (+ 786us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33234: BlockingRecv error: recv got EOF from 127.0.0.1:33234 (error 108)
Metrics: {"server-negotiator.queue_time_us":146}
I20260809 20:16:52.170696 20021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:52.163825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59842 (local address 127.14.181.61:40179)
0809 20:16:52.163977 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:52.163982 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:52.164462 (+ 480us) server_negotiation.cc:407] Connection header received
0809 20:16:52.164604 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:52.164609 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:52.164691 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:52.164783 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:16:52.165595 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:52.166721 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:52.168683 (+ 1962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:52.169377 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:52.169505 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:52.169920 (+ 415us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:16:52.170079 (+ 159us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:16:52.170179 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:52.170306 (+ 127us) server_negotiation.cc:299] Negotiation successful
0809 20:16:52.170412 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260809 20:16:52.178910 20141 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:16:52.176816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33248 (local address 127.14.181.60:41385)
0809 20:16:52.176971 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:52.176976 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:52.177474 (+ 498us) server_negotiation.cc:407] Connection header received
0809 20:16:52.177614 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:52.177619 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:52.177725 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:52.177819 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:52.178722 (+ 903us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33248: BlockingRecv error: recv got EOF from 127.0.0.1:33248 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 20:16:52.205149 20021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:52.198538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59852 (local address 127.14.181.61:40179)
0809 20:16:52.198696 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:52.198701 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:52.199213 (+ 512us) server_negotiation.cc:407] Connection header received
0809 20:16:52.199385 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:52.199390 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:52.199482 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:52.199586 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:16:52.200025 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:52.201216 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:52.203134 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:52.203775 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:52.203903 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:52.204401 (+ 498us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:16:52.204565 (+ 164us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:16:52.204655 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:52.204788 (+ 133us) server_negotiation.cc:299] Negotiation successful
0809 20:16:52.204880 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260809 20:16:52.213321 20141 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:16:52.211547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33252 (local address 127.14.181.60:41385)
0809 20:16:52.211727 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:52.211732 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:52.211751 (+ 19us) server_negotiation.cc:407] Connection header received
0809 20:16:52.211925 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:52.211932 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:52.212022 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:52.212087 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:52.213084 (+ 997us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33252: BlockingRecv error: recv got EOF from 127.0.0.1:33252 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 20:16:52.254151 20021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:52.248069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59866 (local address 127.14.181.61:40179)
0809 20:16:52.248248 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:52.248255 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:52.248608 (+ 353us) server_negotiation.cc:407] Connection header received
0809 20:16:52.248828 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:52.248832 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:52.248933 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:52.249008 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:16:52.249462 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:52.250646 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:52.252193 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:52.252913 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:52.253074 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:52.253443 (+ 369us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:16:52.253575 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:16:52.253666 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:52.253748 (+ 82us) server_negotiation.cc:299] Negotiation successful
0809 20:16:52.253826 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260809 20:16:52.263016 20141 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:16:52.261003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33268 (local address 127.14.181.60:41385)
0809 20:16:52.261202 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:52.261208 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:52.261673 (+ 465us) server_negotiation.cc:407] Connection header received
0809 20:16:52.261842 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:52.261846 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:52.261913 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:52.261987 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:52.262844 (+ 857us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33268: BlockingRecv error: recv got EOF from 127.0.0.1:33268 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 20:16:52.336154 20021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:52.330512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59872 (local address 127.14.181.61:40179)
0809 20:16:52.330733 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:52.330740 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:52.331083 (+ 343us) server_negotiation.cc:407] Connection header received
0809 20:16:52.331241 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:52.331247 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:52.331332 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:52.331435 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:16:52.331828 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:52.332983 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:52.334297 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:52.335006 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:52.335126 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:52.335482 (+ 356us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:16:52.335618 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:16:52.335697 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:52.335791 (+ 94us) server_negotiation.cc:299] Negotiation successful
0809 20:16:52.335868 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260809 20:16:52.343487 20141 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:16:52.341469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33274 (local address 127.14.181.60:41385)
0809 20:16:52.341685 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:52.341691 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:52.342221 (+ 530us) server_negotiation.cc:407] Connection header received
0809 20:16:52.342454 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:52.342460 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:52.342545 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:52.342637 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:52.343305 (+ 668us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33274: BlockingRecv error: recv got EOF from 127.0.0.1:33274 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 20:16:52.479158 20021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:52.474628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59874 (local address 127.14.181.61:40179)
0809 20:16:52.474809 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:52.474813 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:52.475266 (+ 453us) server_negotiation.cc:407] Connection header received
0809 20:16:52.475430 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:52.475434 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:52.475503 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:52.475570 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:16:52.475884 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:52.476558 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:52.477798 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:52.478206 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:52.478296 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:52.478639 (+ 343us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:16:52.478736 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:16:52.478795 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:52.478883 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 20:16:52.478946 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
W20260809 20:16:52.485852 20141 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 20:16:52.484090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33290 (local address 127.14.181.60:41385)
0809 20:16:52.484276 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:52.484282 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:52.484535 (+ 253us) server_negotiation.cc:407] Connection header received
0809 20:16:52.484720 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:52.484726 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:52.484811 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:52.484891 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 20:16:52.485631 (+ 740us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33290: BlockingRecv error: recv got EOF from 127.0.0.1:33290 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 20:16:52.549968 20165 catalog_manager.cc:1259] Loaded cluster ID: 79360fbaa1af46878ce8cbfde3abd5f4
I20260809 20:16:52.550057 20165 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f437283a484a4c4090311dcbcc7041ec: loading cluster ID for follower catalog manager: success
I20260809 20:16:52.552732 20165 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f437283a484a4c4090311dcbcc7041ec: acquiring CA information for follower catalog manager: success
I20260809 20:16:52.554483 20165 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f437283a484a4c4090311dcbcc7041ec: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 20:16:52.751899 20021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:52.747310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59878 (local address 127.14.181.61:40179)
0809 20:16:52.747521 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:52.747527 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:52.747788 (+ 261us) server_negotiation.cc:407] Connection header received
0809 20:16:52.747941 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:52.747945 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:52.748025 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:52.748122 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:16:52.748482 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:52.749186 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:52.750481 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:52.750872 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:52.750966 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:52.751313 (+ 347us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:16:52.751426 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:16:52.751484 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:52.751595 (+ 111us) server_negotiation.cc:299] Negotiation successful
0809 20:16:52.751659 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 20:16:52.762168 20141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:52.757291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33296 (local address 127.14.181.60:41385)
0809 20:16:52.757514 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:52.757520 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:52.757662 (+ 142us) server_negotiation.cc:407] Connection header received
0809 20:16:52.757830 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:52.757834 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:52.757985 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:52.758083 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:16:52.758434 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:52.759117 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:52.760364 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:52.760734 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:52.760817 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:52.761211 (+ 394us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:16:52.761720 (+ 509us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:16:52.761822 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:52.761858 (+ 36us) server_negotiation.cc:299] Negotiation successful
0809 20:16:52.761918 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260809 20:16:52.781002 20021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:52.767276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59882 (local address 127.14.181.61:40179)
0809 20:16:52.767419 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:52.767424 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:52.774833 (+ 7409us) server_negotiation.cc:407] Connection header received
0809 20:16:52.775066 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:52.775071 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:52.775161 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:52.775222 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:16:52.776542 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:52.777277 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:52.779333 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:52.779758 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:52.779871 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:52.780294 (+ 423us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:16:52.780412 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:16:52.780501 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:52.780646 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 20:16:52.780720 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 20:16:52.781541 20141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:52.774953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33300 (local address 127.14.181.60:41385)
0809 20:16:52.775102 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:52.775107 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:52.775610 (+ 503us) server_negotiation.cc:407] Connection header received
0809 20:16:52.775785 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:52.775789 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:52.775864 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:52.775950 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:16:52.776615 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:52.777597 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:52.779675 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:52.780250 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:52.780366 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:52.780813 (+ 447us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:16:52.780933 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:16:52.780992 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:52.781244 (+ 252us) server_negotiation.cc:299] Negotiation successful
0809 20:16:52.781315 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 20:16:52.781956 20446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 20:16:52.767278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59172 (local address 127.14.181.62:39945)
0809 20:16:52.774720 (+ 7442us) server_negotiation.cc:206] Beginning negotiation
0809 20:16:52.774726 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 20:16:52.774744 (+ 18us) server_negotiation.cc:407] Connection header received
0809 20:16:52.774869 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 20:16:52.774874 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 20:16:52.775091 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 20:16:52.775262 (+ 171us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 20:16:52.775829 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:52.776709 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:52.779389 (+ 2680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 20:16:52.779929 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 20:16:52.780046 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 20:16:52.780676 (+ 630us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 20:16:52.781112 (+ 436us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 20:16:52.781201 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 20:16:52.781453 (+ 252us) server_negotiation.cc:299] Negotiation successful
0809 20:16:52.781532 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7327,"thread_start_us":7224,"threads_started":1}
I20260809 20:16:52.785840 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 19769
I20260809 20:16:52.786778 19873 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:16:52.892992 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 19769
W20260809 20:16:52.919006 20051 connection.cc:535] server connection from 127.0.0.1:33170 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 20:16:52.919468 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 19891
I20260809 20:16:52.920419 20010 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:16:53.024046 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 19891
I20260809 20:16:53.048467 15060 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu pid 20029
I20260809 20:16:53.049512 20127 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 20:16:53.151283 15060 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpWWQ8t/build/asan/bin/kudu with pid 20029
2026-08-09T20:16:53Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (4546 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (9449 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (356375 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST